2024-04-04T22:25:08.039925746Z ..... 2024-04-04T22:25:08.691697349Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-04T22:25:10.167961680Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-04T22:25:28.316439176Z 2024-04-04T22:25:29.703544331Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-04T22:25:31.246122378Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-04T22:25:37.929092643Z ____________ _____________ 2024-04-04T22:25:37.929108433Z ____ |__( )_________ __/__ /________ __ 2024-04-04T22:25:37.929111607Z ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / / 2024-04-04T22:25:37.929114526Z ___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / 2024-04-04T22:25:37.929117541Z _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/ 2024-04-04T22:25:37.929121338Z [2024-04-04T22:25:37.928+0000] {scheduler_job.py:714} INFO - Starting the scheduler 2024-04-04T22:25:37.931110946Z [2024-04-04T22:25:37.929+0000] {scheduler_job.py:719} INFO - Processing each file at most -1 times 2024-04-04T22:25:38.603256722Z [2024-04-04T22:25:38.602+0000] {executor_loader.py:107} INFO - Loaded executor: CeleryExecutor 2024-04-04T22:25:38.637782536Z [2024-04-04T22:25:38.622+0000] {manager.py:165} INFO - Launched DagFileProcessorManager with pid: 16 2024-04-04T22:25:38.651638224Z [2024-04-04T22:25:38.648+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-04T22:25:38.665870937Z [2024-04-04T22:25:38.660+0000] {settings.py:59} INFO - Configured default timezone Timezone('UTC') 2024-04-04T22:25:38.669217808Z [2024-04-04T22:25:38.668+0000] {settings.py:549} INFO - Loaded airflow_local_settings from /opt/airflow/config/airflow_local_settings.py . 2024-04-04T22:26:41.800709596Z [2024-04-04T22:26:41.794+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:26:41.904633165Z [2024-04-04T22:26:41.902+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:26:41.904661833Z 2024-04-04T22:26:41.904668405Z [2024-04-04T22:26:41.902+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T22:26:41.904673790Z [2024-04-04T22:26:41.903+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:26:41.904678593Z 2024-04-04T22:26:41.911696105Z [2024-04-04T22:26:41.906+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T22:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:26:41.911716384Z [2024-04-04T22:26:41.907+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T22:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T22:26:42.232832562Z [2024-04-04T22:26:42.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:24:00+00:00 exited with status queued for try_number 1 2024-04-04T22:26:42.247848767Z [2024-04-04T22:26:42.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad759ae0-2cb4-4a15-a29f-d9d7e46fa1ae 2024-04-04T22:27:12.323148648Z [2024-04-04T22:27:12.322+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:27:12.323371859Z [2024-04-04T22:27:12.323+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 22:24:00+00:00, run_id=scheduled__2024-04-04T22:24:00+00:00, run_start_date=2024-04-04 22:26:41.816755+00:00, run_end_date=2024-04-04 22:27:12.323080+00:00, run_duration=30.506325, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:24:00+00:00, data_interval_end=2024-04-04 22:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T22:27:12.333483537Z [2024-04-04T22:27:12.333+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T22:26:00+00:00, run_after=2024-04-04T22:28:00+00:00 2024-04-04T22:27:13.562151093Z [2024-04-04T22:27:13.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:24:00+00:00 exited with status success for try_number 1 2024-04-04T22:27:13.573779608Z [2024-04-04T22:27:13.573+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T22:24:00+00:00, map_index=-1, run_start_date=2024-04-04 22:26:43.111213+00:00, run_end_date=2024-04-04 22:27:12.229167+00:00, run_duration=29.117954, state=success, executor_state=success, try_number=1, max_tries=1, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:26:41.903729+00:00, queued_by_job_id=1, pid=50 2024-04-04T22:28:00.883450678Z [2024-04-04T22:28:00.882+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:28:00.936527813Z [2024-04-04T22:28:00.936+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:28:00.936560778Z 2024-04-04T22:28:00.936777738Z [2024-04-04T22:28:00.936+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T22:28:00.937427015Z [2024-04-04T22:28:00.937+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:28:00.937444609Z 2024-04-04T22:28:00.939894914Z [2024-04-04T22:28:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T22:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:28:00.940169439Z [2024-04-04T22:28:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T22:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T22:28:01.018600053Z [2024-04-04T22:28:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:26:00+00:00 exited with status queued for try_number 1 2024-04-04T22:28:01.023956482Z [2024-04-04T22:28:01.023+0000] {scheduler_job.py:635} INFO - Setting external_id for to f556b8b6-f16d-4653-9afa-bd3490cb5ffd 2024-04-04T22:28:03.222434239Z [2024-04-04T22:28:03.221+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:28:03.222701296Z [2024-04-04T22:28:03.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 22:26:00+00:00, run_id=scheduled__2024-04-04T22:26:00+00:00, run_start_date=2024-04-04 22:28:00.899405+00:00, run_end_date=2024-04-04 22:28:03.222235+00:00, run_duration=2.32283, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:26:00+00:00, data_interval_end=2024-04-04 22:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T22:28:03.232257362Z [2024-04-04T22:28:03.231+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T22:28:00+00:00, run_after=2024-04-04T22:30:00+00:00 2024-04-04T22:28:03.266289250Z [2024-04-04T22:28:03.265+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:26:00+00:00 exited with status success for try_number 1 2024-04-04T22:28:03.272699108Z [2024-04-04T22:28:03.272+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T22:26:00+00:00, map_index=-1, run_start_date=2024-04-04 22:28:01.966146+00:00, run_end_date=2024-04-04 22:28:02.407015+00:00, run_duration=0.440869, state=success, executor_state=success, try_number=1, max_tries=1, job_id=4, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:28:00.937846+00:00, queued_by_job_id=1, pid=70 2024-04-04T22:30:00.570295060Z [2024-04-04T22:30:00.569+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:30:00.607091288Z [2024-04-04T22:30:00.606+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:30:00.607130584Z 2024-04-04T22:30:00.607140920Z [2024-04-04T22:30:00.606+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T22:30:00.607530496Z [2024-04-04T22:30:00.607+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:30:00.607546633Z 2024-04-04T22:30:00.609505170Z [2024-04-04T22:30:00.609+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T22:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:30:00.609627899Z [2024-04-04T22:30:00.609+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T22:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T22:30:00.662534980Z [2024-04-04T22:30:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:28:00+00:00 exited with status queued for try_number 1 2024-04-04T22:30:00.676419971Z [2024-04-04T22:30:00.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to 247556d3-88ce-4287-a2bc-e6c20c1c2b9a 2024-04-04T22:30:01.855754823Z [2024-04-04T22:30:01.848+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:30:01.855777554Z [2024-04-04T22:30:01.853+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 22:28:00+00:00, run_id=scheduled__2024-04-04T22:28:00+00:00, run_start_date=2024-04-04 22:30:00.581507+00:00, run_end_date=2024-04-04 22:30:01.853719+00:00, run_duration=1.272212, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:28:00+00:00, data_interval_end=2024-04-04 22:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T22:30:01.874244604Z [2024-04-04T22:30:01.873+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T22:30:00+00:00, run_after=2024-04-04T22:32:00+00:00 2024-04-04T22:30:01.898735333Z [2024-04-04T22:30:01.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:28:00+00:00 exited with status success for try_number 1 2024-04-04T22:30:01.904906788Z [2024-04-04T22:30:01.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T22:28:00+00:00, map_index=-1, run_start_date=2024-04-04 22:30:01.344499+00:00, run_end_date=2024-04-04 22:30:01.688281+00:00, run_duration=0.343782, state=success, executor_state=success, try_number=1, max_tries=1, job_id=5, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:30:00.607778+00:00, queued_by_job_id=1, pid=104 2024-04-04T22:30:38.965366039Z [2024-04-04T22:30:38.962+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-04T22:32:00.491539632Z [2024-04-04T22:32:00.491+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:32:00.547921567Z [2024-04-04T22:32:00.547+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:32:00.547945105Z 2024-04-04T22:32:00.548175117Z [2024-04-04T22:32:00.547+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T22:32:00.549180368Z [2024-04-04T22:32:00.548+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:32:00.549207727Z 2024-04-04T22:32:00.552452903Z [2024-04-04T22:32:00.552+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:32:00.552735872Z [2024-04-04T22:32:00.552+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T22:32:00.624436281Z [2024-04-04T22:32:00.624+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:30:00+00:00 exited with status queued for try_number 1 2024-04-04T22:32:00.629521839Z [2024-04-04T22:32:00.629+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81aa4458-260c-4ecf-b5b3-cddf32cbd2ab 2024-04-04T22:32:01.336691662Z [2024-04-04T22:32:01.336+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:30:00+00:00, run_after=2024-04-04T22:35:00+00:00 2024-04-04T22:32:01.400290452Z [2024-04-04T22:32:01.399+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:32:01.400314681Z 2024-04-04T22:32:01.400393229Z [2024-04-04T22:32:01.400+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:32:01.401050332Z [2024-04-04T22:32:01.400+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:32:01.401066797Z 2024-04-04T22:32:01.403309817Z [2024-04-04T22:32:01.403+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T22:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T22:32:01.403399928Z [2024-04-04T22:32:01.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:32:01.508272277Z [2024-04-04T22:32:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status queued for try_number 1 2024-04-04T22:32:01.514032453Z [2024-04-04T22:32:01.513+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1da488a2-5eb9-41a8-8861-557809786943 2024-04-04T22:32:02.677106616Z [2024-04-04T22:32:02.676+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:32:02.677337473Z [2024-04-04T22:32:02.677+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 22:30:00+00:00, run_id=scheduled__2024-04-04T22:30:00+00:00, run_start_date=2024-04-04 22:32:00.514228+00:00, run_end_date=2024-04-04 22:32:02.677033+00:00, run_duration=2.162805, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:30:00+00:00, data_interval_end=2024-04-04 22:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T22:32:02.688103891Z [2024-04-04T22:32:02.687+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T22:32:00+00:00, run_after=2024-04-04T22:34:00+00:00 2024-04-04T22:32:02.734962324Z [2024-04-04T22:32:02.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:30:00+00:00 exited with status success for try_number 1 2024-04-04T22:32:02.744410857Z [2024-04-04T22:32:02.743+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T22:30:00+00:00, map_index=-1, run_start_date=2024-04-04 22:32:01.447360+00:00, run_end_date=2024-04-04 22:32:01.974191+00:00, run_duration=0.526831, state=success, executor_state=success, try_number=1, max_tries=1, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:32:00.549672+00:00, queued_by_job_id=1, pid=138 2024-04-04T22:32:04.497915477Z [2024-04-04T22:32:04.497+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:32:04.497952187Z 2024-04-04T22:32:04.498215117Z [2024-04-04T22:32:04.497+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:32:04.499110645Z [2024-04-04T22:32:04.498+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:32:04.499147877Z 2024-04-04T22:32:04.503921835Z [2024-04-04T22:32:04.503+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-04T22:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T22:32:04.504328570Z [2024-04-04T22:32:04.504+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-04T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:32:04.561490107Z [2024-04-04T22:32:04.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status queued for try_number 1 2024-04-04T22:32:04.561515961Z [2024-04-04T22:32:04.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status success for try_number 1 2024-04-04T22:32:04.568497529Z [2024-04-04T22:32:04.568+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9639e9d9-c7f8-4199-9351-7bc133b1b5f1 2024-04-04T22:32:04.568935888Z [2024-04-04T22:32:04.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T22:25:00+00:00, map_index=-1, run_start_date=2024-04-04 22:32:03.577036+00:00, run_end_date=2024-04-04 22:32:03.965583+00:00, run_duration=0.388547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=7, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:32:01.401402+00:00, queued_by_job_id=1, pid=150 2024-04-04T22:32:07.870182546Z [2024-04-04T22:32:07.869+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:32:07.870208137Z 2024-04-04T22:32:07.870414407Z [2024-04-04T22:32:07.870+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:32:07.870950056Z [2024-04-04T22:32:07.870+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:32:07.870962759Z 2024-04-04T22:32:07.872997516Z [2024-04-04T22:32:07.872+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-04T22:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T22:32:07.873227063Z [2024-04-04T22:32:07.872+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-04T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T22:32:07.917737550Z [2024-04-04T22:32:07.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status queued for try_number 1 2024-04-04T22:32:07.917951890Z [2024-04-04T22:32:07.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status success for try_number 1 2024-04-04T22:32:07.927909904Z [2024-04-04T22:32:07.927+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a98628a-f64f-4e5b-9a1a-0be3a8376ed8 2024-04-04T22:32:07.928191225Z [2024-04-04T22:32:07.927+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-04T22:25:00+00:00, map_index=-1, run_start_date=2024-04-04 22:32:06.341869+00:00, run_end_date=2024-04-04 22:32:06.683080+00:00, run_duration=0.341211, state=success, executor_state=success, try_number=1, max_tries=1, job_id=8, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:32:04.499699+00:00, queued_by_job_id=1, pid=163 2024-04-04T22:32:10.505353539Z [2024-04-04T22:32:10.504+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:32:10.505379459Z 2024-04-04T22:32:10.505763593Z [2024-04-04T22:32:10.505+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:32:10.506823169Z [2024-04-04T22:32:10.506+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:32:10.506829756Z 2024-04-04T22:32:10.510309149Z [2024-04-04T22:32:10.510+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-04T22:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:32:10.510585253Z [2024-04-04T22:32:10.510+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-04T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:32:10.564911605Z [2024-04-04T22:32:10.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status queued for try_number 1 2024-04-04T22:32:10.565294427Z [2024-04-04T22:32:10.564+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status success for try_number 1 2024-04-04T22:32:10.573805524Z [2024-04-04T22:32:10.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ee7b215-f312-4c68-9150-9e732fac74a0 2024-04-04T22:32:10.574005124Z [2024-04-04T22:32:10.573+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-04T22:25:00+00:00, map_index=0, run_start_date=2024-04-04 22:32:09.446633+00:00, run_end_date=2024-04-04 22:32:09.731264+00:00, run_duration=0.284631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=9, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:32:07.871287+00:00, queued_by_job_id=1, pid=181 2024-04-04T22:32:12.646781370Z [2024-04-04T22:32:12.644+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:32:12.647035875Z [2024-04-04T22:32:12.646+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:25:00+00:00, run_id=scheduled__2024-04-04T22:25:00+00:00, run_start_date=2024-04-04 22:32:01.347136+00:00, run_end_date=2024-04-04 22:32:12.646747+00:00, run_duration=11.299611, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:25:00+00:00, data_interval_end=2024-04-04 22:30:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-04T22:32:12.653022180Z [2024-04-04T22:32:12.652+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:30:00+00:00, run_after=2024-04-04T22:35:00+00:00 2024-04-04T22:32:12.678718744Z [2024-04-04T22:32:12.678+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status success for try_number 1 2024-04-04T22:32:12.683080352Z [2024-04-04T22:32:12.682+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-04T22:25:00+00:00, map_index=-1, run_start_date=2024-04-04 22:32:12.061453+00:00, run_end_date=2024-04-04 22:32:12.335431+00:00, run_duration=0.273978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=10, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:32:10.507465+00:00, queued_by_job_id=1, pid=192 2024-04-04T22:32:29.790013125Z [2024-04-04T22:32:29.789+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:32:00+00:00, run_after=2024-04-04T22:33:00+00:00 2024-04-04T22:32:29.799439873Z [2024-04-04T22:32:29.799+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:32:29.845787863Z [2024-04-04T22:32:29.845+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-04T22:32:29.845812285Z 2024-04-04T22:32:29.845816066Z 2024-04-04T22:32:29.845965751Z [2024-04-04T22:32:29.845+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:32:29.846115323Z [2024-04-04T22:32:29.845+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:32:29.846711454Z [2024-04-04T22:32:29.846+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:32:29.846717444Z 2024-04-04T22:32:29.846720722Z 2024-04-04T22:32:29.849648796Z [2024-04-04T22:32:29.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:32:29.849759430Z [2024-04-04T22:32:29.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:32:29.849989192Z [2024-04-04T22:32:29.849+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:32:29.850147620Z [2024-04-04T22:32:29.849+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:32:30.014242697Z [2024-04-04T22:32:30.013+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:31:00+00:00 exited with status queued for try_number 1 2024-04-04T22:32:30.014327464Z [2024-04-04T22:32:30.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:31:00+00:00 exited with status queued for try_number 1 2024-04-04T22:32:30.020703156Z [2024-04-04T22:32:30.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50c2248a-3406-43e2-b8cb-1e147719c313 2024-04-04T22:32:30.020987168Z [2024-04-04T22:32:30.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6792fb6-8539-4d60-8002-7a95f7682362 2024-04-04T22:32:31.358603043Z [2024-04-04T22:32:31.358+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:32:00+00:00, run_after=2024-04-04T22:33:00+00:00 2024-04-04T22:32:31.529221160Z [2024-04-04T22:32:31.528+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:32:31.529246382Z 2024-04-04T22:32:31.529545371Z [2024-04-04T22:32:31.529+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:32:31.530170576Z [2024-04-04T22:32:31.529+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:32:31.530182414Z 2024-04-04T22:32:31.533028811Z [2024-04-04T22:32:31.532+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:32:31.535802692Z [2024-04-04T22:32:31.532+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:32:31.764590491Z [2024-04-04T22:32:31.762+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:31:00+00:00 exited with status queued for try_number 1 2024-04-04T22:32:31.777144226Z [2024-04-04T22:32:31.775+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ddc32a8-ca9b-4b09-be3d-a767e0d14af7 2024-04-04T22:32:34.520379819Z [2024-04-04T22:32:34.519+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:32:34.520775601Z [2024-04-04T22:32:34.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:31:00+00:00, run_id=scheduled__2024-04-04T22:31:00+00:00, run_start_date=2024-04-04 22:32:31.436804+00:00, run_end_date=2024-04-04 22:32:34.520264+00:00, run_duration=3.08346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:31:00+00:00, data_interval_end=2024-04-04 22:32:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:32:34.528987644Z [2024-04-04T22:32:34.528+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:32:00+00:00, run_after=2024-04-04T22:33:00+00:00 2024-04-04T22:32:34.566079270Z [2024-04-04T22:32:34.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:31:00+00:00 exited with status success for try_number 1 2024-04-04T22:32:34.575255230Z [2024-04-04T22:32:34.574+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:31:00+00:00, map_index=-1, run_start_date=2024-04-04 22:32:33.344702+00:00, run_end_date=2024-04-04 22:32:34.038454+00:00, run_duration=0.693752, state=success, executor_state=success, try_number=1, max_tries=1, job_id=11, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:32:31.530651+00:00, queued_by_job_id=1, pid=213 2024-04-04T22:32:36.242031733Z [2024-04-04T22:32:36.241+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:32:36.242215266Z [2024-04-04T22:32:36.241+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:31:00+00:00, run_id=scheduled__2024-04-04T22:31:00+00:00, run_start_date=2024-04-04 22:32:29.809430+00:00, run_end_date=2024-04-04 22:32:36.241822+00:00, run_duration=6.432392, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:31:00+00:00, data_interval_end=2024-04-04 22:32:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:32:36.252311911Z [2024-04-04T22:32:36.251+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:32:00+00:00, run_after=2024-04-04T22:33:00+00:00 2024-04-04T22:32:36.258421057Z [2024-04-04T22:32:36.258+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:32:36.258707661Z [2024-04-04T22:32:36.258+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:31:00+00:00, run_id=scheduled__2024-04-04T22:31:00+00:00, run_start_date=2024-04-04 22:32:29.809958+00:00, run_end_date=2024-04-04 22:32:36.258362+00:00, run_duration=6.448404, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:31:00+00:00, data_interval_end=2024-04-04 22:32:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:32:36.269567658Z [2024-04-04T22:32:36.269+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:32:00+00:00, run_after=2024-04-04T22:33:00+00:00 2024-04-04T22:32:36.316024131Z [2024-04-04T22:32:36.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:31:00+00:00 exited with status success for try_number 1 2024-04-04T22:32:36.316128296Z [2024-04-04T22:32:36.315+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:31:00+00:00 exited with status success for try_number 1 2024-04-04T22:32:36.327296715Z [2024-04-04T22:32:36.326+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:31:00+00:00, map_index=-1, run_start_date=2024-04-04 22:32:33.751076+00:00, run_end_date=2024-04-04 22:32:35.381773+00:00, run_duration=1.630697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=12, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:32:29.847284+00:00, queued_by_job_id=1, pid=218 2024-04-04T22:32:36.327462851Z [2024-04-04T22:32:36.327+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:31:00+00:00, map_index=-1, run_start_date=2024-04-04 22:32:33.890538+00:00, run_end_date=2024-04-04 22:32:36.040781+00:00, run_duration=2.150243, state=success, executor_state=success, try_number=1, max_tries=1, job_id=13, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:32:29.847284+00:00, queued_by_job_id=1, pid=220 2024-04-04T22:33:00.403226138Z [2024-04-04T22:33:00.402+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:33:00+00:00, run_after=2024-04-04T22:34:00+00:00 2024-04-04T22:33:00.421607368Z [2024-04-04T22:33:00.421+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:33:00+00:00, run_after=2024-04-04T22:34:00+00:00 2024-04-04T22:33:00.428781062Z [2024-04-04T22:33:00.428+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:33:00.488723890Z [2024-04-04T22:33:00.488+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T22:33:00.488760629Z 2024-04-04T22:33:00.488779057Z 2024-04-04T22:33:00.488782489Z 2024-04-04T22:33:00.488830853Z [2024-04-04T22:33:00.488+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:33:00.488835251Z [2024-04-04T22:33:00.488+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:33:00.488882190Z [2024-04-04T22:33:00.488+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:33:00.489619165Z [2024-04-04T22:33:00.489+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:33:00.489631230Z 2024-04-04T22:33:00.489634803Z 2024-04-04T22:33:00.489638238Z 2024-04-04T22:33:00.493865728Z [2024-04-04T22:33:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:33:00.493937946Z [2024-04-04T22:33:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:33:00.494326592Z [2024-04-04T22:33:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:33:00.494503715Z [2024-04-04T22:33:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:33:00.494730536Z [2024-04-04T22:33:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:33:00.494844632Z [2024-04-04T22:33:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:33:00.892587188Z [2024-04-04T22:33:00.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:32:00+00:00 exited with status queued for try_number 1 2024-04-04T22:33:00.892801321Z [2024-04-04T22:33:00.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:32:00+00:00 exited with status queued for try_number 1 2024-04-04T22:33:00.892877993Z [2024-04-04T22:33:00.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:32:00+00:00 exited with status queued for try_number 1 2024-04-04T22:33:00.932743337Z [2024-04-04T22:33:00.932+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e8039d5-40ef-4590-b5c5-bbda73eef3d3 2024-04-04T22:33:00.932824070Z [2024-04-04T22:33:00.932+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0f7c985-d9d5-4a14-a4a6-4e34fdec1bed 2024-04-04T22:33:00.932921728Z [2024-04-04T22:33:00.932+0000] {scheduler_job.py:635} INFO - Setting external_id for to e043de2a-88c4-4ca8-8942-7e6c142b8667 2024-04-04T22:33:03.121032583Z [2024-04-04T22:33:03.120+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:33:03.170889405Z [2024-04-04T22:33:03.170+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:33:03.171596758Z [2024-04-04T22:33:03.171+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:32:00+00:00, run_id=scheduled__2024-04-04T22:32:00+00:00, run_start_date=2024-04-04 22:33:00.438297+00:00, run_end_date=2024-04-04 22:33:03.171072+00:00, run_duration=2.732775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:32:00+00:00, data_interval_end=2024-04-04 22:33:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:33:03.190814981Z [2024-04-04T22:33:03.190+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:33:00+00:00, run_after=2024-04-04T22:34:00+00:00 2024-04-04T22:33:03.236003025Z [2024-04-04T22:33:03.235+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:33:03.236027565Z 2024-04-04T22:33:03.236498100Z [2024-04-04T22:33:03.236+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 has 0/16 running and queued tasks 2024-04-04T22:33:03.237982616Z [2024-04-04T22:33:03.237+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:33:03.237997794Z 2024-04-04T22:33:03.242307283Z [2024-04-04T22:33:03.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:33:03.242755140Z [2024-04-04T22:33:03.242+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:33:03.309346218Z [2024-04-04T22:33:03.308+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:32:00+00:00 exited with status queued for try_number 1 2024-04-04T22:33:03.309865395Z [2024-04-04T22:33:03.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:32:00+00:00 exited with status success for try_number 1 2024-04-04T22:33:03.316703242Z [2024-04-04T22:33:03.316+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:32:00+00:00, map_index=-1, run_start_date=2024-04-04 22:33:02.168440+00:00, run_end_date=2024-04-04 22:33:02.804715+00:00, run_duration=0.636275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=14, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:33:00.490724+00:00, queued_by_job_id=1, pid=239 2024-04-04T22:33:03.317310829Z [2024-04-04T22:33:03.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to d94d3055-43e4-45a5-84b8-031d2ee43dc5 2024-04-04T22:33:04.536771682Z [2024-04-04T22:33:04.536+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 to 2024-04-04T22:33:00+00:00, run_after=2024-04-04T22:34:00+00:00 2024-04-04T22:33:04.635318902Z [2024-04-04T22:33:04.634+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:33:04.635364797Z 2024-04-04T22:33:04.635448160Z [2024-04-04T22:33:04.635+0000] {scheduler_job.py:425} INFO - DAG vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 has 0/16 running and queued tasks 2024-04-04T22:33:04.636393698Z [2024-04-04T22:33:04.636+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:33:04.636428946Z 2024-04-04T22:33:04.641194050Z [2024-04-04T22:33:04.640+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:33:04.641380324Z [2024-04-04T22:33:04.641+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:33:04.750422282Z [2024-04-04T22:33:04.749+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:32:00+00:00 exited with status queued for try_number 1 2024-04-04T22:33:04.769397026Z [2024-04-04T22:33:04.768+0000] {scheduler_job.py:635} INFO - Setting external_id for to fddaf51b-8132-4f89-baac-0524220bae46 2024-04-04T22:33:07.089040545Z [2024-04-04T22:33:07.088+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:33:07.089283201Z [2024-04-04T22:33:07.088+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:32:00+00:00, run_id=scheduled__2024-04-04T22:32:00+00:00, run_start_date=2024-04-04 22:33:00.439612+00:00, run_end_date=2024-04-04 22:33:07.088869+00:00, run_duration=6.649257, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:32:00+00:00, data_interval_end=2024-04-04 22:33:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:33:07.098142754Z [2024-04-04T22:33:07.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:33:00+00:00, run_after=2024-04-04T22:34:00+00:00 2024-04-04T22:33:07.108191022Z [2024-04-04T22:33:07.107+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:33:07.108237592Z [2024-04-04T22:33:07.107+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:32:00+00:00, run_id=scheduled__2024-04-04T22:32:00+00:00, run_start_date=2024-04-04 22:33:00.440604+00:00, run_end_date=2024-04-04 22:33:07.107849+00:00, run_duration=6.667245, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:32:00+00:00, data_interval_end=2024-04-04 22:33:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:33:07.117081438Z [2024-04-04T22:33:07.116+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:33:00+00:00, run_after=2024-04-04T22:34:00+00:00 2024-04-04T22:33:07.156617880Z [2024-04-04T22:33:07.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:32:00+00:00 exited with status success for try_number 1 2024-04-04T22:33:07.156641657Z [2024-04-04T22:33:07.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:32:00+00:00 exited with status success for try_number 1 2024-04-04T22:33:07.165278011Z [2024-04-04T22:33:07.164+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:32:00+00:00, map_index=-1, run_start_date=2024-04-04 22:33:03.871979+00:00, run_end_date=2024-04-04 22:33:05.945154+00:00, run_duration=2.073175, state=success, executor_state=success, try_number=1, max_tries=1, job_id=16, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:33:00.490724+00:00, queued_by_job_id=1, pid=259 2024-04-04T22:33:07.165511419Z [2024-04-04T22:33:07.165+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:32:00+00:00, map_index=-1, run_start_date=2024-04-04 22:33:03.815006+00:00, run_end_date=2024-04-04 22:33:06.436620+00:00, run_duration=2.621614, state=success, executor_state=success, try_number=1, max_tries=1, job_id=15, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:33:00.490724+00:00, queued_by_job_id=1, pid=258 2024-04-04T22:33:08.209797973Z [2024-04-04T22:33:08.209+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 to 2024-04-04T22:30:00+00:00, run_after=2024-04-04T22:35:00+00:00 2024-04-04T22:33:08.254435448Z [2024-04-04T22:33:08.254+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:33:08.254711896Z [2024-04-04T22:33:08.254+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5, execution_date=2024-04-04 22:32:00+00:00, run_id=scheduled__2024-04-04T22:32:00+00:00, run_start_date=2024-04-04 22:33:03.139534+00:00, run_end_date=2024-04-04 22:33:08.254292+00:00, run_duration=5.114758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:32:00+00:00, data_interval_end=2024-04-04 22:33:00+00:00, dag_hash=4a9f48dfbd4eeba04eb427e159adfbef 2024-04-04T22:33:08.264238947Z [2024-04-04T22:33:08.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 to 2024-04-04T22:33:00+00:00, run_after=2024-04-04T22:34:00+00:00 2024-04-04T22:33:08.268707555Z [2024-04-04T22:33:08.268+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:33:08.268938774Z [2024-04-04T22:33:08.268+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5, execution_date=2024-04-04 22:32:00+00:00, run_id=scheduled__2024-04-04T22:32:00+00:00, run_start_date=2024-04-04 22:33:04.555508+00:00, run_end_date=2024-04-04 22:33:08.268598+00:00, run_duration=3.71309, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:32:00+00:00, data_interval_end=2024-04-04 22:33:00+00:00, dag_hash=5932a57a71d96d85ef8835a07eac6a05 2024-04-04T22:33:08.277601871Z [2024-04-04T22:33:08.277+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 to 2024-04-04T22:33:00+00:00, run_after=2024-04-04T22:34:00+00:00 2024-04-04T22:33:08.287751204Z [2024-04-04T22:33:08.287+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:33:08.287776038Z 2024-04-04T22:33:08.287783303Z [2024-04-04T22:33:08.287+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 has 0/16 running and queued tasks 2024-04-04T22:33:08.288315624Z [2024-04-04T22:33:08.288+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:33:08.288334778Z 2024-04-04T22:33:08.290157049Z [2024-04-04T22:33:08.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T22:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T22:33:08.290356762Z [2024-04-04T22:33:08.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:33:08.341970658Z [2024-04-04T22:33:08.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status queued for try_number 1 2024-04-04T22:33:08.344401608Z [2024-04-04T22:33:08.341+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:32:00+00:00 exited with status success for try_number 1 2024-04-04T22:33:08.350359007Z [2024-04-04T22:33:08.350+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:32:00+00:00, map_index=-1, run_start_date=2024-04-04 22:33:05.583577+00:00, run_end_date=2024-04-04 22:33:07.535037+00:00, run_duration=1.95146, state=success, executor_state=success, try_number=1, max_tries=1, job_id=17, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:33:03.238685+00:00, queued_by_job_id=1, pid=277 2024-04-04T22:33:08.350741023Z [2024-04-04T22:33:08.350+0000] {scheduler_job.py:635} INFO - Setting external_id for to 249805ab-b3e5-4f17-a8fe-5fd3d4acc72d 2024-04-04T22:33:08.425609914Z [2024-04-04T22:33:08.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:32:00+00:00 exited with status success for try_number 1 2024-04-04T22:33:08.431674721Z [2024-04-04T22:33:08.431+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:32:00+00:00, map_index=-1, run_start_date=2024-04-04 22:33:07.032130+00:00, run_end_date=2024-04-04 22:33:08.196811+00:00, run_duration=1.164681, state=success, executor_state=success, try_number=1, max_tries=1, job_id=18, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:33:04.636868+00:00, queued_by_job_id=1, pid=289 2024-04-04T22:33:10.552292103Z [2024-04-04T22:33:10.551+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:33:10.552319830Z 2024-04-04T22:33:10.552331144Z [2024-04-04T22:33:10.552+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 has 0/16 running and queued tasks 2024-04-04T22:33:10.552823618Z [2024-04-04T22:33:10.552+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:33:10.552834350Z 2024-04-04T22:33:10.554736384Z [2024-04-04T22:33:10.554+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', task_id='split_metrics', run_id='scheduled__2024-04-04T22:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T22:33:10.554859518Z [2024-04-04T22:33:10.554+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', 'split_metrics', 'scheduled__2024-04-04T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:33:10.615355051Z [2024-04-04T22:33:10.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.split_metrics run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status queued for try_number 1 2024-04-04T22:33:10.615621208Z [2024-04-04T22:33:10.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status success for try_number 1 2024-04-04T22:33:10.620250133Z [2024-04-04T22:33:10.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T22:25:00+00:00, map_index=-1, run_start_date=2024-04-04 22:33:09.833760+00:00, run_end_date=2024-04-04 22:33:10.182589+00:00, run_duration=0.348829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=19, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:33:08.288605+00:00, queued_by_job_id=1, pid=312 2024-04-04T22:33:10.620550954Z [2024-04-04T22:33:10.620+0000] {scheduler_job.py:635} INFO - Setting external_id for to d8507617-4217-4fc2-875b-462e46a683cd 2024-04-04T22:33:13.258580521Z [2024-04-04T22:33:13.258+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:33:13.258607059Z 2024-04-04T22:33:13.258749222Z [2024-04-04T22:33:13.258+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 has 0/16 running and queued tasks 2024-04-04T22:33:13.260056031Z [2024-04-04T22:33:13.259+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:33:13.260073337Z 2024-04-04T22:33:13.263175359Z [2024-04-04T22:33:13.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', task_id='collect_metrics', run_id='scheduled__2024-04-04T22:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T22:33:13.263329721Z [2024-04-04T22:33:13.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', 'collect_metrics', 'scheduled__2024-04-04T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T22:33:13.311887515Z [2024-04-04T22:33:13.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.collect_metrics run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status queued for try_number 1 2024-04-04T22:33:13.312159190Z [2024-04-04T22:33:13.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.split_metrics run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status success for try_number 1 2024-04-04T22:33:13.317791753Z [2024-04-04T22:33:13.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5, task_id=split_metrics, run_id=scheduled__2024-04-04T22:25:00+00:00, map_index=-1, run_start_date=2024-04-04 22:33:12.266203+00:00, run_end_date=2024-04-04 22:33:12.562605+00:00, run_duration=0.296402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=20, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:33:10.553066+00:00, queued_by_job_id=1, pid=328 2024-04-04T22:33:13.318099511Z [2024-04-04T22:33:13.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to 625ee733-78cb-4623-836c-11cceeefd542 2024-04-04T22:33:15.536253153Z [2024-04-04T22:33:15.535+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:33:15.536300587Z 2024-04-04T22:33:15.536753573Z [2024-04-04T22:33:15.536+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 has 0/16 running and queued tasks 2024-04-04T22:33:15.538505087Z [2024-04-04T22:33:15.537+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:33:15.538534647Z 2024-04-04T22:33:15.544699096Z [2024-04-04T22:33:15.544+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', task_id='send_prometheus', run_id='scheduled__2024-04-04T22:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:33:15.545121656Z [2024-04-04T22:33:15.544+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', 'send_prometheus', 'scheduled__2024-04-04T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:33:15.622120001Z [2024-04-04T22:33:15.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.send_prometheus run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status queued for try_number 1 2024-04-04T22:33:15.622144883Z [2024-04-04T22:33:15.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.collect_metrics run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status success for try_number 1 2024-04-04T22:33:15.633212930Z [2024-04-04T22:33:15.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5, task_id=collect_metrics, run_id=scheduled__2024-04-04T22:25:00+00:00, map_index=0, run_start_date=2024-04-04 22:33:14.743834+00:00, run_end_date=2024-04-04 22:33:15.036860+00:00, run_duration=0.293026, state=success, executor_state=success, try_number=1, max_tries=1, job_id=21, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:33:13.260783+00:00, queued_by_job_id=1, pid=336 2024-04-04T22:33:15.633551755Z [2024-04-04T22:33:15.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10e4e425-9d00-45dc-9fd8-208817bd32a6 2024-04-04T22:33:18.337741734Z [2024-04-04T22:33:18.337+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:33:18.338037843Z [2024-04-04T22:33:18.337+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5, execution_date=2024-04-04 22:25:00+00:00, run_id=scheduled__2024-04-04T22:25:00+00:00, run_start_date=2024-04-04 22:33:08.218796+00:00, run_end_date=2024-04-04 22:33:18.337589+00:00, run_duration=10.118793, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:25:00+00:00, data_interval_end=2024-04-04 22:30:00+00:00, dag_hash=7d707a95e62dfad6c50d333e7417ae1e 2024-04-04T22:33:18.354764669Z [2024-04-04T22:33:18.354+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 to 2024-04-04T22:30:00+00:00, run_after=2024-04-04T22:35:00+00:00 2024-04-04T22:33:18.393412027Z [2024-04-04T22:33:18.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.send_prometheus run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status success for try_number 1 2024-04-04T22:33:18.400184105Z [2024-04-04T22:33:18.399+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5, task_id=send_prometheus, run_id=scheduled__2024-04-04T22:25:00+00:00, map_index=-1, run_start_date=2024-04-04 22:33:17.068865+00:00, run_end_date=2024-04-04 22:33:17.336626+00:00, run_duration=0.267761, state=success, executor_state=success, try_number=1, max_tries=1, job_id=22, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:33:15.539748+00:00, queued_by_job_id=1, pid=344 2024-04-04T22:33:35.398934476Z [2024-04-04T22:33:35.398+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:33:35.432572209Z [2024-04-04T22:33:35.432+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:33:35.432591309Z 2024-04-04T22:33:35.432600884Z [2024-04-04T22:33:35.432+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c has 0/16 running and queued tasks 2024-04-04T22:33:35.433054271Z [2024-04-04T22:33:35.432+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:33:35.433064563Z 2024-04-04T22:33:35.435100230Z [2024-04-04T22:33:35.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:33:35.435220177Z [2024-04-04T22:33:35.435+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:33:35.509085810Z [2024-04-04T22:33:35.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:32:00+00:00 exited with status queued for try_number 1 2024-04-04T22:33:35.516298566Z [2024-04-04T22:33:35.515+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0c99ec5-a220-4bfa-b490-1ec3f70d10b0 2024-04-04T22:33:35.561887063Z [2024-04-04T22:33:35.561+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c to 2024-04-04T22:33:00+00:00, run_after=2024-04-04T22:34:00+00:00 2024-04-04T22:33:35.601432133Z [2024-04-04T22:33:35.600+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:33:35.601471441Z 2024-04-04T22:33:35.602251915Z [2024-04-04T22:33:35.601+0000] {scheduler_job.py:425} INFO - DAG vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c has 0/16 running and queued tasks 2024-04-04T22:33:35.604328549Z [2024-04-04T22:33:35.603+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:33:35.604354809Z 2024-04-04T22:33:35.608474282Z [2024-04-04T22:33:35.608+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:33:35.608962209Z [2024-04-04T22:33:35.608+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:33:35.712955939Z [2024-04-04T22:33:35.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:32:00+00:00 exited with status queued for try_number 1 2024-04-04T22:33:35.741164517Z [2024-04-04T22:33:35.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20af7ee5-2c33-436a-a5e8-55707f4b7dee 2024-04-04T22:33:38.643226101Z [2024-04-04T22:33:38.642+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:33:38.643974129Z [2024-04-04T22:33:38.643+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c, execution_date=2024-04-04 22:32:00+00:00, run_id=scheduled__2024-04-04T22:32:00+00:00, run_start_date=2024-04-04 22:33:35.570921+00:00, run_end_date=2024-04-04 22:33:38.643309+00:00, run_duration=3.072388, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:32:00+00:00, data_interval_end=2024-04-04 22:33:00+00:00, dag_hash=b38e1c24a2c4f5008e563e88e75085c4 2024-04-04T22:33:38.661418178Z [2024-04-04T22:33:38.660+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c to 2024-04-04T22:33:00+00:00, run_after=2024-04-04T22:34:00+00:00 2024-04-04T22:33:38.707472250Z [2024-04-04T22:33:38.707+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:32:00+00:00 exited with status success for try_number 1 2024-04-04T22:33:38.713140204Z [2024-04-04T22:33:38.712+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:32:00+00:00, map_index=-1, run_start_date=2024-04-04 22:33:37.369956+00:00, run_end_date=2024-04-04 22:33:38.565123+00:00, run_duration=1.195167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=24, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:33:35.605351+00:00, queued_by_job_id=1, pid=360 2024-04-04T22:33:39.401080836Z [2024-04-04T22:33:39.400+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c to 2024-04-04T22:30:00+00:00, run_after=2024-04-04T22:35:00+00:00 2024-04-04T22:33:39.431381175Z [2024-04-04T22:33:39.431+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:33:39.431760904Z [2024-04-04T22:33:39.431+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c, execution_date=2024-04-04 22:32:00+00:00, run_id=scheduled__2024-04-04T22:32:00+00:00, run_start_date=2024-04-04 22:33:35.408818+00:00, run_end_date=2024-04-04 22:33:39.431462+00:00, run_duration=4.022644, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:32:00+00:00, data_interval_end=2024-04-04 22:33:00+00:00, dag_hash=ee8b5324eee9ff30c44d5a9ca79190a4 2024-04-04T22:33:39.441383409Z [2024-04-04T22:33:39.441+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c to 2024-04-04T22:33:00+00:00, run_after=2024-04-04T22:34:00+00:00 2024-04-04T22:33:39.453853556Z [2024-04-04T22:33:39.453+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:33:39.453875253Z 2024-04-04T22:33:39.454068153Z [2024-04-04T22:33:39.453+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c has 0/16 running and queued tasks 2024-04-04T22:33:39.454930585Z [2024-04-04T22:33:39.454+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:33:39.454953179Z 2024-04-04T22:33:39.458081421Z [2024-04-04T22:33:39.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T22:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T22:33:39.458378401Z [2024-04-04T22:33:39.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:33:39.511494595Z [2024-04-04T22:33:39.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status queued for try_number 1 2024-04-04T22:33:39.513605200Z [2024-04-04T22:33:39.511+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:32:00+00:00 exited with status success for try_number 1 2024-04-04T22:33:39.519303624Z [2024-04-04T22:33:39.519+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:32:00+00:00, map_index=-1, run_start_date=2024-04-04 22:33:37.120576+00:00, run_end_date=2024-04-04 22:33:38.718435+00:00, run_duration=1.597859, state=success, executor_state=success, try_number=1, max_tries=1, job_id=23, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:33:35.433429+00:00, queued_by_job_id=1, pid=354 2024-04-04T22:33:39.519506683Z [2024-04-04T22:33:39.519+0000] {scheduler_job.py:635} INFO - Setting external_id for to aacfe3a9-b90c-475d-8e8a-f65d46d749c0 2024-04-04T22:33:42.335132140Z [2024-04-04T22:33:42.334+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:33:42.335165046Z 2024-04-04T22:33:42.335237631Z [2024-04-04T22:33:42.335+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c has 0/16 running and queued tasks 2024-04-04T22:33:42.335915103Z [2024-04-04T22:33:42.335+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:33:42.335924406Z 2024-04-04T22:33:42.338290742Z [2024-04-04T22:33:42.338+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c', task_id='split_metrics', run_id='scheduled__2024-04-04T22:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T22:33:42.338441677Z [2024-04-04T22:33:42.338+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c', 'split_metrics', 'scheduled__2024-04-04T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:33:42.386870996Z [2024-04-04T22:33:42.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c.split_metrics run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status queued for try_number 1 2024-04-04T22:33:42.386903452Z [2024-04-04T22:33:42.386+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status success for try_number 1 2024-04-04T22:33:42.391339921Z [2024-04-04T22:33:42.390+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T22:25:00+00:00, map_index=-1, run_start_date=2024-04-04 22:33:41.042965+00:00, run_end_date=2024-04-04 22:33:41.471523+00:00, run_duration=0.428558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=25, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:33:39.455409+00:00, queued_by_job_id=1, pid=378 2024-04-04T22:33:42.391374868Z [2024-04-04T22:33:42.391+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf06a3ed-ea26-46ee-82f1-f4265050e9e7 2024-04-04T22:33:44.592039238Z [2024-04-04T22:33:44.591+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:33:44.592069331Z 2024-04-04T22:33:44.592389961Z [2024-04-04T22:33:44.592+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c has 0/16 running and queued tasks 2024-04-04T22:33:44.593477524Z [2024-04-04T22:33:44.593+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:33:44.593486539Z 2024-04-04T22:33:44.597141650Z [2024-04-04T22:33:44.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c', task_id='collect_metrics', run_id='scheduled__2024-04-04T22:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T22:33:44.597429364Z [2024-04-04T22:33:44.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c', 'collect_metrics', 'scheduled__2024-04-04T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T22:33:44.649860409Z [2024-04-04T22:33:44.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c.collect_metrics run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status queued for try_number 1 2024-04-04T22:33:44.650147114Z [2024-04-04T22:33:44.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c.split_metrics run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status success for try_number 1 2024-04-04T22:33:44.656154083Z [2024-04-04T22:33:44.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c, task_id=split_metrics, run_id=scheduled__2024-04-04T22:25:00+00:00, map_index=-1, run_start_date=2024-04-04 22:33:43.915239+00:00, run_end_date=2024-04-04 22:33:44.209578+00:00, run_duration=0.294339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=26, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:33:42.336191+00:00, queued_by_job_id=1, pid=391 2024-04-04T22:33:44.656528498Z [2024-04-04T22:33:44.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 448f9349-450a-401a-b9c4-3b9fb8f10cb3 2024-04-04T22:33:46.650194449Z [2024-04-04T22:33:46.649+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:33:46.650224606Z 2024-04-04T22:33:46.650528149Z [2024-04-04T22:33:46.650+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c has 0/16 running and queued tasks 2024-04-04T22:33:46.651384131Z [2024-04-04T22:33:46.651+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:33:46.651399336Z 2024-04-04T22:33:46.654124348Z [2024-04-04T22:33:46.653+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c', task_id='send_prometheus', run_id='scheduled__2024-04-04T22:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:33:46.654576023Z [2024-04-04T22:33:46.654+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c', 'send_prometheus', 'scheduled__2024-04-04T22:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:33:46.713320337Z [2024-04-04T22:33:46.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c.send_prometheus run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status queued for try_number 1 2024-04-04T22:33:46.713706208Z [2024-04-04T22:33:46.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c.collect_metrics run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status success for try_number 1 2024-04-04T22:33:46.722939524Z [2024-04-04T22:33:46.722+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c, task_id=collect_metrics, run_id=scheduled__2024-04-04T22:25:00+00:00, map_index=0, run_start_date=2024-04-04 22:33:46.187167+00:00, run_end_date=2024-04-04 22:33:46.530163+00:00, run_duration=0.342996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=27, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:33:44.594047+00:00, queued_by_job_id=1, pid=399 2024-04-04T22:33:46.723291021Z [2024-04-04T22:33:46.723+0000] {scheduler_job.py:635} INFO - Setting external_id for to d129f1ca-2f89-4868-bffb-0418c426e904 2024-04-04T22:33:48.947349413Z [2024-04-04T22:33:48.946+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:33:48.947622197Z [2024-04-04T22:33:48.947+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c, execution_date=2024-04-04 22:25:00+00:00, run_id=scheduled__2024-04-04T22:25:00+00:00, run_start_date=2024-04-04 22:33:39.411683+00:00, run_end_date=2024-04-04 22:33:48.947083+00:00, run_duration=9.5354, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:25:00+00:00, data_interval_end=2024-04-04 22:30:00+00:00, dag_hash=c21f9725978463d9f053dd40fe91d6f6 2024-04-04T22:33:48.954177743Z [2024-04-04T22:33:48.953+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c to 2024-04-04T22:30:00+00:00, run_after=2024-04-04T22:35:00+00:00 2024-04-04T22:33:48.979395828Z [2024-04-04T22:33:48.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c.send_prometheus run_id=scheduled__2024-04-04T22:25:00+00:00 exited with status success for try_number 1 2024-04-04T22:33:48.983988549Z [2024-04-04T22:33:48.983+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c, task_id=send_prometheus, run_id=scheduled__2024-04-04T22:25:00+00:00, map_index=-1, run_start_date=2024-04-04 22:33:48.139875+00:00, run_end_date=2024-04-04 22:33:48.458634+00:00, run_duration=0.318759, state=success, executor_state=success, try_number=1, max_tries=1, job_id=28, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:33:46.651968+00:00, queued_by_job_id=1, pid=407 2024-04-04T22:34:00.038960747Z [2024-04-04T22:34:00.038+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:34:00.072181553Z [2024-04-04T22:34:00.071+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:34:00+00:00, run_after=2024-04-04T22:35:00+00:00 2024-04-04T22:34:00.107985349Z [2024-04-04T22:34:00.107+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c to 2024-04-04T22:34:00+00:00, run_after=2024-04-04T22:35:00+00:00 2024-04-04T22:34:00.121803862Z [2024-04-04T22:34:00.120+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:34:00.149133305Z [2024-04-04T22:34:00.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 to 2024-04-04T22:34:00+00:00, run_after=2024-04-04T22:35:00+00:00 2024-04-04T22:34:00.156727432Z [2024-04-04T22:34:00.156+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:34:00.167360094Z [2024-04-04T22:34:00.167+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:34:00.181648245Z [2024-04-04T22:34:00.181+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:34:00+00:00, run_after=2024-04-04T22:35:00+00:00 2024-04-04T22:34:00.299679956Z [2024-04-04T22:34:00.299+0000] {scheduler_job.py:360} INFO - 8 tasks up for execution: 2024-04-04T22:34:00.299702471Z 2024-04-04T22:34:00.299707029Z 2024-04-04T22:34:00.299710276Z 2024-04-04T22:34:00.299713380Z 2024-04-04T22:34:00.299716562Z 2024-04-04T22:34:00.299719681Z 2024-04-04T22:34:00.299722650Z 2024-04-04T22:34:00.299725724Z 2024-04-04T22:34:00.300284946Z [2024-04-04T22:34:00.299+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T22:34:00.300497134Z [2024-04-04T22:34:00.300+0000] {scheduler_job.py:425} INFO - DAG vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c has 0/16 running and queued tasks 2024-04-04T22:34:00.300639775Z [2024-04-04T22:34:00.300+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 has 0/16 running and queued tasks 2024-04-04T22:34:00.300779039Z [2024-04-04T22:34:00.300+0000] {scheduler_job.py:425} INFO - DAG vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 has 0/16 running and queued tasks 2024-04-04T22:34:00.300909181Z [2024-04-04T22:34:00.300+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:34:00.301043124Z [2024-04-04T22:34:00.300+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c has 0/16 running and queued tasks 2024-04-04T22:34:00.301156400Z [2024-04-04T22:34:00.301+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:34:00.303845233Z [2024-04-04T22:34:00.301+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:34:00.306653472Z [2024-04-04T22:34:00.306+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:34:00.306665362Z 2024-04-04T22:34:00.306669241Z 2024-04-04T22:34:00.306672329Z 2024-04-04T22:34:00.306675390Z 2024-04-04T22:34:00.306678408Z 2024-04-04T22:34:00.306681317Z 2024-04-04T22:34:00.306684159Z 2024-04-04T22:34:00.306687202Z 2024-04-04T22:34:00.312535800Z [2024-04-04T22:34:00.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T22:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:34:00.312682155Z [2024-04-04T22:34:00.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T22:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T22:34:00.312914695Z [2024-04-04T22:34:00.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:34:00.313160223Z [2024-04-04T22:34:00.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:34:00.313459910Z [2024-04-04T22:34:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:34:00.313769948Z [2024-04-04T22:34:00.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:34:00.314000882Z [2024-04-04T22:34:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:34:00.314111257Z [2024-04-04T22:34:00.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:34:00.314312600Z [2024-04-04T22:34:00.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:34:00.314434305Z [2024-04-04T22:34:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:34:00.314632398Z [2024-04-04T22:34:00.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:34:00.314769263Z [2024-04-04T22:34:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:34:00.315032478Z [2024-04-04T22:34:00.314+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:34:00.315264713Z [2024-04-04T22:34:00.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:34:00.315468904Z [2024-04-04T22:34:00.315+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:34:00.315611610Z [2024-04-04T22:34:00.315+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:34:01.217412749Z [2024-04-04T22:34:01.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:32:00+00:00 exited with status queued for try_number 1 2024-04-04T22:34:01.219656132Z [2024-04-04T22:34:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status queued for try_number 1 2024-04-04T22:34:01.219686166Z [2024-04-04T22:34:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status queued for try_number 1 2024-04-04T22:34:01.219690278Z [2024-04-04T22:34:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status queued for try_number 1 2024-04-04T22:34:01.219706821Z [2024-04-04T22:34:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status queued for try_number 1 2024-04-04T22:34:01.219710451Z [2024-04-04T22:34:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status queued for try_number 1 2024-04-04T22:34:01.219713537Z [2024-04-04T22:34:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status queued for try_number 1 2024-04-04T22:34:01.219716763Z [2024-04-04T22:34:01.217+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status queued for try_number 1 2024-04-04T22:34:01.313040937Z [2024-04-04T22:34:01.312+0000] {scheduler_job.py:635} INFO - Setting external_id for to 183af0af-cb61-417c-8374-b27361f106a9 2024-04-04T22:34:01.322662717Z [2024-04-04T22:34:01.312+0000] {scheduler_job.py:635} INFO - Setting external_id for to 110d71d3-e1aa-4d60-9068-6a909ea557b3 2024-04-04T22:34:01.326501487Z [2024-04-04T22:34:01.326+0000] {scheduler_job.py:635} INFO - Setting external_id for to c773f6bb-8e23-4e68-937c-5bb86072c1c5 2024-04-04T22:34:01.330406101Z [2024-04-04T22:34:01.330+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f5e0017-8c31-4d74-abc0-8d592fe827c5 2024-04-04T22:34:01.331981991Z [2024-04-04T22:34:01.330+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b703de7-883e-4277-96a8-87170d6bd481 2024-04-04T22:34:01.332004708Z [2024-04-04T22:34:01.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05f998e1-ed55-49aa-bbb4-adb4218164c2 2024-04-04T22:34:01.332027599Z [2024-04-04T22:34:01.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to b599b75a-945e-49a3-b3b5-797fd9b24e73 2024-04-04T22:34:01.332037488Z [2024-04-04T22:34:01.331+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26da76cf-1c7a-469f-840e-088112b69bdf 2024-04-04T22:34:03.959311717Z [2024-04-04T22:34:03.958+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:34:03.959836017Z [2024-04-04T22:34:03.959+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 22:32:00+00:00, run_id=scheduled__2024-04-04T22:32:00+00:00, run_start_date=2024-04-04 22:34:00.195274+00:00, run_end_date=2024-04-04 22:34:03.959406+00:00, run_duration=3.764132, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:32:00+00:00, data_interval_end=2024-04-04 22:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T22:34:03.976338967Z [2024-04-04T22:34:03.975+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T22:34:00+00:00, run_after=2024-04-04T22:36:00+00:00 2024-04-04T22:34:04.228597277Z [2024-04-04T22:34:04.228+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:32:00+00:00 exited with status success for try_number 1 2024-04-04T22:34:04.240468584Z [2024-04-04T22:34:04.240+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T22:32:00+00:00, map_index=-1, run_start_date=2024-04-04 22:34:02.290604+00:00, run_end_date=2024-04-04 22:34:03.033633+00:00, run_duration=0.743029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=29, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:34:00.308085+00:00, queued_by_job_id=1, pid=416 2024-04-04T22:34:05.327994861Z [2024-04-04T22:34:05.327+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:34:05.330742626Z [2024-04-04T22:34:05.330+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:33:00+00:00, run_id=scheduled__2024-04-04T22:33:00+00:00, run_start_date=2024-04-04 22:34:00.203857+00:00, run_end_date=2024-04-04 22:34:05.330306+00:00, run_duration=5.126449, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:33:00+00:00, data_interval_end=2024-04-04 22:34:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:34:05.346784575Z [2024-04-04T22:34:05.346+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:34:00+00:00, run_after=2024-04-04T22:35:00+00:00 2024-04-04T22:34:05.480460176Z [2024-04-04T22:34:05.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status failed for try_number 1 2024-04-04T22:34:05.480608589Z [2024-04-04T22:34:05.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status success for try_number 1 2024-04-04T22:34:05.494502576Z [2024-04-04T22:34:05.494+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:34:00.308085+00:00, queued_by_job_id=1, pid=None 2024-04-04T22:34:05.495100482Z [2024-04-04T22:34:05.494+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:34:05.505617057Z [2024-04-04T22:34:05.505+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:34:05.546451788Z [2024-04-04T22:34:05.545+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240404T223300, start_date=, end_date=20240404T223405 2024-04-04T22:34:05.576987026Z [2024-04-04T22:34:05.576+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:33:00+00:00, map_index=-1, run_start_date=2024-04-04 22:34:03.688115+00:00, run_end_date=2024-04-04 22:34:04.558606+00:00, run_duration=0.870491, state=success, executor_state=success, try_number=1, max_tries=1, job_id=30, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:34:00.308085+00:00, queued_by_job_id=1, pid=428 2024-04-04T22:34:06.699380075Z [2024-04-04T22:34:06.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status failed for try_number 1 2024-04-04T22:34:06.701186932Z [2024-04-04T22:34:06.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status failed for try_number 1 2024-04-04T22:34:06.701217925Z [2024-04-04T22:34:06.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status failed for try_number 1 2024-04-04T22:34:06.715969981Z [2024-04-04T22:34:06.715+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:34:00.308085+00:00, queued_by_job_id=1, pid=None 2024-04-04T22:34:06.716673077Z [2024-04-04T22:34:06.716+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:34:06.719515340Z [2024-04-04T22:34:06.719+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:34:06.734044670Z [2024-04-04T22:34:06.733+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240404T223300, start_date=, end_date=20240404T223406 2024-04-04T22:34:06.741964606Z [2024-04-04T22:34:06.741+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:34:00.308085+00:00, queued_by_job_id=1, pid=None 2024-04-04T22:34:06.742749217Z [2024-04-04T22:34:06.742+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:34:06.744954935Z [2024-04-04T22:34:06.744+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:34:06.759723980Z [2024-04-04T22:34:06.759+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240404T223300, start_date=, end_date=20240404T223406 2024-04-04T22:34:06.767742477Z [2024-04-04T22:34:06.767+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:34:00.308085+00:00, queued_by_job_id=1, pid=None 2024-04-04T22:34:06.768687101Z [2024-04-04T22:34:06.768+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:34:06.771017853Z [2024-04-04T22:34:06.770+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:34:06.791872964Z [2024-04-04T22:34:06.791+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240404T223300, start_date=, end_date=20240404T223406 2024-04-04T22:34:09.322244877Z [2024-04-04T22:34:09.321+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:34:09.322822269Z [2024-04-04T22:34:09.322+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:33:00+00:00, run_id=scheduled__2024-04-04T22:33:00+00:00, run_start_date=2024-04-04 22:34:00.201636+00:00, run_end_date=2024-04-04 22:34:09.322123+00:00, run_duration=9.120487, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:33:00+00:00, data_interval_end=2024-04-04 22:34:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:34:09.333230667Z [2024-04-04T22:34:09.332+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:34:00+00:00, run_after=2024-04-04T22:35:00+00:00 2024-04-04T22:34:09.340746730Z [2024-04-04T22:34:09.340+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:34:09.341224750Z [2024-04-04T22:34:09.340+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:33:00+00:00, run_id=scheduled__2024-04-04T22:33:00+00:00, run_start_date=2024-04-04 22:34:00.204935+00:00, run_end_date=2024-04-04 22:34:09.340633+00:00, run_duration=9.135698, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:33:00+00:00, data_interval_end=2024-04-04 22:34:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:34:09.366623545Z [2024-04-04T22:34:09.366+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:34:00+00:00, run_after=2024-04-04T22:35:00+00:00 2024-04-04T22:34:09.468145274Z [2024-04-04T22:34:09.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status success for try_number 1 2024-04-04T22:34:09.468746645Z [2024-04-04T22:34:09.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status success for try_number 1 2024-04-04T22:34:09.477583873Z [2024-04-04T22:34:09.477+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:33:00+00:00, map_index=-1, run_start_date=2024-04-04 22:34:04.956396+00:00, run_end_date=2024-04-04 22:34:08.285753+00:00, run_duration=3.329357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=31, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:34:00.308085+00:00, queued_by_job_id=1, pid=450 2024-04-04T22:34:09.477945298Z [2024-04-04T22:34:09.477+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:33:00+00:00, map_index=-1, run_start_date=2024-04-04 22:34:05.988011+00:00, run_end_date=2024-04-04 22:34:08.412494+00:00, run_duration=2.424483, state=success, executor_state=success, try_number=1, max_tries=1, job_id=32, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:34:00.308085+00:00, queued_by_job_id=1, pid=495 2024-04-04T22:34:16.281490382Z [2024-04-04T22:34:16.281+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:34:16.281515110Z 2024-04-04T22:34:16.281577541Z [2024-04-04T22:34:16.281+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c has 0/16 running and queued tasks 2024-04-04T22:34:16.282375811Z [2024-04-04T22:34:16.282+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:34:16.282403205Z 2024-04-04T22:34:16.285339817Z [2024-04-04T22:34:16.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:33:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:34:16.285541549Z [2024-04-04T22:34:16.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:34:16.332573800Z [2024-04-04T22:34:16.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status queued for try_number 2 2024-04-04T22:34:16.341667582Z [2024-04-04T22:34:16.341+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ffd5b87-6619-4a0e-97a3-3f2cd95cfdb8 2024-04-04T22:34:17.361248285Z [2024-04-04T22:34:17.360+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T22:34:17.361299683Z 2024-04-04T22:34:17.361303787Z 2024-04-04T22:34:17.361307225Z 2024-04-04T22:34:17.361453589Z [2024-04-04T22:34:17.361+0000] {scheduler_job.py:425} INFO - DAG vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c has 0/16 running and queued tasks 2024-04-04T22:34:17.361617813Z [2024-04-04T22:34:17.361+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 has 0/16 running and queued tasks 2024-04-04T22:34:17.361746324Z [2024-04-04T22:34:17.361+0000] {scheduler_job.py:425} INFO - DAG vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 has 0/16 running and queued tasks 2024-04-04T22:34:17.362350933Z [2024-04-04T22:34:17.362+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:34:17.362357343Z 2024-04-04T22:34:17.362361038Z 2024-04-04T22:34:17.362364675Z 2024-04-04T22:34:17.365088021Z [2024-04-04T22:34:17.364+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:33:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:34:17.365216301Z [2024-04-04T22:34:17.365+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:34:17.365482342Z [2024-04-04T22:34:17.365+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:33:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:34:17.365634787Z [2024-04-04T22:34:17.365+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:34:17.365873173Z [2024-04-04T22:34:17.365+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:33:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:34:17.366000454Z [2024-04-04T22:34:17.365+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:34:17.596520065Z [2024-04-04T22:34:17.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status queued for try_number 2 2024-04-04T22:34:17.597285310Z [2024-04-04T22:34:17.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status queued for try_number 2 2024-04-04T22:34:17.597494450Z [2024-04-04T22:34:17.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status queued for try_number 2 2024-04-04T22:34:17.611689455Z [2024-04-04T22:34:17.607+0000] {scheduler_job.py:635} INFO - Setting external_id for to feaf2c4c-512f-4ab3-ab23-870635134d61 2024-04-04T22:34:17.611714392Z [2024-04-04T22:34:17.608+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40abced6-3b58-4303-9317-369e8101b0ee 2024-04-04T22:34:17.611718236Z [2024-04-04T22:34:17.608+0000] {scheduler_job.py:635} INFO - Setting external_id for to f04f588f-c748-4546-b1b6-145c49fe1399 2024-04-04T22:34:19.023690333Z [2024-04-04T22:34:19.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status failed for try_number 2 2024-04-04T22:34:19.023704166Z [2024-04-04T22:34:19.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status failed for try_number 2 2024-04-04T22:34:19.023708283Z [2024-04-04T22:34:19.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status failed for try_number 2 2024-04-04T22:34:19.029894409Z [2024-04-04T22:34:19.029+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-04 22:34:06.748006+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:34:17.363168+00:00, queued_by_job_id=1, pid=None 2024-04-04T22:34:19.030235194Z [2024-04-04T22:34:19.030+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:34:19.032053990Z [2024-04-04T22:34:19.031+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:34:19.045498612Z [2024-04-04T22:34:19.045+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240404T223300, start_date=, end_date=20240404T223419 2024-04-04T22:34:19.056634121Z [2024-04-04T22:34:19.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-04 22:34:06.774559+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:34:17.363168+00:00, queued_by_job_id=1, pid=None 2024-04-04T22:34:19.057204159Z [2024-04-04T22:34:19.056+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:34:19.059130041Z [2024-04-04T22:34:19.058+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:34:19.074511709Z [2024-04-04T22:34:19.074+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240404T223300, start_date=, end_date=20240404T223419 2024-04-04T22:34:19.083632199Z [2024-04-04T22:34:19.083+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-04 22:34:05.513679+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:34:16.282988+00:00, queued_by_job_id=1, pid=None 2024-04-04T22:34:19.083946257Z [2024-04-04T22:34:19.083+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:34:19.086582951Z [2024-04-04T22:34:19.086+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:34:19.099376140Z [2024-04-04T22:34:19.099+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240404T223300, start_date=, end_date=20240404T223419 2024-04-04T22:34:20.146363888Z [2024-04-04T22:34:20.145+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-04T22:34:20.146768744Z [2024-04-04T22:34:20.146+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5, execution_date=2024-04-04 22:33:00+00:00, run_id=scheduled__2024-04-04T22:33:00+00:00, run_start_date=2024-04-04 22:34:00.198393+00:00, run_end_date=2024-04-04 22:34:20.146422+00:00, run_duration=19.948029, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:33:00+00:00, data_interval_end=2024-04-04 22:34:00+00:00, dag_hash=4a9f48dfbd4eeba04eb427e159adfbef 2024-04-04T22:34:20.155857366Z [2024-04-04T22:34:20.155+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 to 2024-04-04T22:34:00+00:00, run_after=2024-04-04T22:35:00+00:00 2024-04-04T22:34:20.162995696Z [2024-04-04T22:34:20.162+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-04T22:34:20.163835142Z [2024-04-04T22:34:20.163+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5, execution_date=2024-04-04 22:33:00+00:00, run_id=scheduled__2024-04-04T22:33:00+00:00, run_start_date=2024-04-04 22:34:00.200242+00:00, run_end_date=2024-04-04 22:34:20.162886+00:00, run_duration=19.962644, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:33:00+00:00, data_interval_end=2024-04-04 22:34:00+00:00, dag_hash=5932a57a71d96d85ef8835a07eac6a05 2024-04-04T22:34:20.179252346Z [2024-04-04T22:34:20.178+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ce8c28c9-55c2-4f1f-9654-53b04106dcf5 to 2024-04-04T22:34:00+00:00, run_after=2024-04-04T22:35:00+00:00 2024-04-04T22:34:20.186815972Z [2024-04-04T22:34:20.186+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-04T22:34:20.187016382Z [2024-04-04T22:34:20.186+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c, execution_date=2024-04-04 22:33:00+00:00, run_id=scheduled__2024-04-04T22:33:00+00:00, run_start_date=2024-04-04 22:34:00.202746+00:00, run_end_date=2024-04-04 22:34:20.186695+00:00, run_duration=19.983949, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:33:00+00:00, data_interval_end=2024-04-04 22:34:00+00:00, dag_hash=ee8b5324eee9ff30c44d5a9ca79190a4 2024-04-04T22:34:20.196281902Z [2024-04-04T22:34:20.195+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c to 2024-04-04T22:34:00+00:00, run_after=2024-04-04T22:35:00+00:00 2024-04-04T22:34:20.233329421Z [2024-04-04T22:34:20.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:33:00+00:00 exited with status failed for try_number 2 2024-04-04T22:34:20.240128037Z [2024-04-04T22:34:20.239+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:33:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-04 22:34:06.722703+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:34:17.363168+00:00, queued_by_job_id=1, pid=None 2024-04-04T22:34:20.240592763Z [2024-04-04T22:34:20.240+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:34:20.243482451Z [2024-04-04T22:34:20.243+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:34:20.256316826Z [2024-04-04T22:34:20.256+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240404T223300, start_date=, end_date=20240404T223420 2024-04-04T22:34:21.310304285Z [2024-04-04T22:34:21.309+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-04T22:34:21.310469375Z [2024-04-04T22:34:21.310+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c, execution_date=2024-04-04 22:33:00+00:00, run_id=scheduled__2024-04-04T22:33:00+00:00, run_start_date=2024-04-04 22:34:00.196990+00:00, run_end_date=2024-04-04 22:34:21.310196+00:00, run_duration=21.113206, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:33:00+00:00, data_interval_end=2024-04-04 22:34:00+00:00, dag_hash=b38e1c24a2c4f5008e563e88e75085c4 2024-04-04T22:34:21.319242551Z [2024-04-04T22:34:21.318+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_c42364e0-1f70-4b91-9e97-7c1f0488a24c to 2024-04-04T22:34:00+00:00, run_after=2024-04-04T22:35:00+00:00 2024-04-04T22:35:00.216040959Z [2024-04-04T22:35:00.215+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:35:00.231220676Z [2024-04-04T22:35:00.230+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c to 2024-04-04T22:35:00+00:00, run_after=2024-04-04T22:40:00+00:00 2024-04-04T22:35:00.244407475Z [2024-04-04T22:35:00.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:35:00+00:00, run_after=2024-04-04T22:40:00+00:00 2024-04-04T22:35:00.258004204Z [2024-04-04T22:35:00.257+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:35:00+00:00, run_after=2024-04-04T22:36:00+00:00 2024-04-04T22:35:00.274778669Z [2024-04-04T22:35:00.274+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:35:00+00:00, run_after=2024-04-04T22:36:00+00:00 2024-04-04T22:35:00.365841168Z [2024-04-04T22:35:00.365+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-04T22:35:00.365989426Z 2024-04-04T22:35:00.366000099Z 2024-04-04T22:35:00.366009269Z 2024-04-04T22:35:00.366015745Z 2024-04-04T22:35:00.366047734Z 2024-04-04T22:35:00.366070533Z [2024-04-04T22:35:00.365+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c has 0/16 running and queued tasks 2024-04-04T22:35:00.366134844Z [2024-04-04T22:35:00.365+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:35:00.366347441Z [2024-04-04T22:35:00.366+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:35:00.366474201Z [2024-04-04T22:35:00.366+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:35:00.366608453Z [2024-04-04T22:35:00.366+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:35:00.367224429Z [2024-04-04T22:35:00.367+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:35:00.367234397Z 2024-04-04T22:35:00.367239813Z 2024-04-04T22:35:00.367245191Z 2024-04-04T22:35:00.367250521Z 2024-04-04T22:35:00.367255814Z 2024-04-04T22:35:00.371517568Z [2024-04-04T22:35:00.371+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T22:35:00.371665908Z [2024-04-04T22:35:00.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:35:00.371975840Z [2024-04-04T22:35:00.371+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T22:35:00.372068379Z [2024-04-04T22:35:00.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:35:00.372289019Z [2024-04-04T22:35:00.372+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:35:00.372407838Z [2024-04-04T22:35:00.372+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:35:00.372638995Z [2024-04-04T22:35:00.372+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:35:00.372753043Z [2024-04-04T22:35:00.372+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:35:00.372970120Z [2024-04-04T22:35:00.372+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:35:00.373120484Z [2024-04-04T22:35:00.372+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:35:01.255945745Z [2024-04-04T22:35:01.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:30:00+00:00 exited with status queued for try_number 1 2024-04-04T22:35:01.261817862Z [2024-04-04T22:35:01.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:30:00+00:00 exited with status queued for try_number 1 2024-04-04T22:35:01.261845389Z [2024-04-04T22:35:01.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:34:00+00:00 exited with status queued for try_number 1 2024-04-04T22:35:01.261849427Z [2024-04-04T22:35:01.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:34:00+00:00 exited with status queued for try_number 1 2024-04-04T22:35:01.261867216Z [2024-04-04T22:35:01.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:34:00+00:00 exited with status queued for try_number 1 2024-04-04T22:35:01.401354656Z [2024-04-04T22:35:01.401+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68e293fa-77bc-4391-9bc5-d0e4c818b65e 2024-04-04T22:35:01.404099881Z [2024-04-04T22:35:01.403+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea2183a6-3b5b-4b96-b38b-731234744b08 2024-04-04T22:35:01.404311105Z [2024-04-04T22:35:01.404+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d5e83b6-fc68-449f-be8a-067b67181eef 2024-04-04T22:35:01.404486813Z [2024-04-04T22:35:01.404+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac9121af-3060-41a3-b25b-b15275a92bb3 2024-04-04T22:35:01.404665386Z [2024-04-04T22:35:01.404+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6756cea0-17f9-440c-b422-8997580178c2 2024-04-04T22:35:02.795037743Z [2024-04-04T22:35:02.794+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:35:02.795755118Z [2024-04-04T22:35:02.795+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:34:00+00:00, run_id=scheduled__2024-04-04T22:34:00+00:00, run_start_date=2024-04-04 22:35:00.289463+00:00, run_end_date=2024-04-04 22:35:02.794952+00:00, run_duration=2.505489, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:34:00+00:00, data_interval_end=2024-04-04 22:35:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:35:02.809571438Z [2024-04-04T22:35:02.809+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:35:00+00:00, run_after=2024-04-04T22:36:00+00:00 2024-04-04T22:35:02.922376318Z [2024-04-04T22:35:02.921+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:34:00+00:00 exited with status success for try_number 1 2024-04-04T22:35:02.936100767Z [2024-04-04T22:35:02.935+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:34:00+00:00, map_index=-1, run_start_date=2024-04-04 22:35:01.959725+00:00, run_end_date=2024-04-04 22:35:02.510128+00:00, run_duration=0.550403, state=success, executor_state=success, try_number=1, max_tries=1, job_id=33, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:35:00.368129+00:00, queued_by_job_id=1, pid=572 2024-04-04T22:35:04.500217416Z [2024-04-04T22:35:04.499+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:35:04.500248302Z 2024-04-04T22:35:04.500598265Z [2024-04-04T22:35:04.500+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:35:04.504174376Z [2024-04-04T22:35:04.503+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:35:04.504213020Z 2024-04-04T22:35:04.509085142Z [2024-04-04T22:35:04.508+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-04T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T22:35:04.509758210Z [2024-04-04T22:35:04.509+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-04T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:35:04.559666401Z [2024-04-04T22:35:04.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T22:30:00+00:00 exited with status queued for try_number 1 2024-04-04T22:35:04.559846231Z [2024-04-04T22:35:04.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:30:00+00:00 exited with status failed for try_number 1 2024-04-04T22:35:04.560053662Z [2024-04-04T22:35:04.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:30:00+00:00 exited with status success for try_number 1 2024-04-04T22:35:04.573284635Z [2024-04-04T22:35:04.572+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T22:30:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:35:00.368129+00:00, queued_by_job_id=1, pid=None 2024-04-04T22:35:04.573774286Z [2024-04-04T22:35:04.573+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:35:04.576581180Z [2024-04-04T22:35:04.576+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:35:04.589673256Z [2024-04-04T22:35:04.589+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c, task_id=extract_metrics_from_vnfrs, execution_date=20240404T223000, start_date=, end_date=20240404T223504 2024-04-04T22:35:04.599356742Z [2024-04-04T22:35:04.598+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T22:30:00+00:00, map_index=-1, run_start_date=2024-04-04 22:35:03.406210+00:00, run_end_date=2024-04-04 22:35:03.929716+00:00, run_duration=0.523506, state=success, executor_state=success, try_number=1, max_tries=1, job_id=34, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:35:00.368129+00:00, queued_by_job_id=1, pid=597 2024-04-04T22:35:04.599580036Z [2024-04-04T22:35:04.599+0000] {scheduler_job.py:635} INFO - Setting external_id for to 469b8df4-c4e8-403a-a278-e353cb12d2f4 2024-04-04T22:35:05.785709090Z [2024-04-04T22:35:05.784+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:35:05.786223079Z [2024-04-04T22:35:05.785+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:34:00+00:00, run_id=scheduled__2024-04-04T22:34:00+00:00, run_start_date=2024-04-04 22:35:00.288444+00:00, run_end_date=2024-04-04 22:35:05.785603+00:00, run_duration=5.497159, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:34:00+00:00, data_interval_end=2024-04-04 22:35:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:35:05.804364293Z [2024-04-04T22:35:05.803+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:35:00+00:00, run_after=2024-04-04T22:36:00+00:00 2024-04-04T22:35:05.817231152Z [2024-04-04T22:35:05.816+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:35:05.817854098Z [2024-04-04T22:35:05.817+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:34:00+00:00, run_id=scheduled__2024-04-04T22:34:00+00:00, run_start_date=2024-04-04 22:35:00.290412+00:00, run_end_date=2024-04-04 22:35:05.817174+00:00, run_duration=5.526762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:34:00+00:00, data_interval_end=2024-04-04 22:35:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:35:05.838978390Z [2024-04-04T22:35:05.838+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:35:00+00:00, run_after=2024-04-04T22:36:00+00:00 2024-04-04T22:35:05.942819175Z [2024-04-04T22:35:05.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:34:00+00:00 exited with status success for try_number 1 2024-04-04T22:35:05.943075897Z [2024-04-04T22:35:05.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:34:00+00:00 exited with status success for try_number 1 2024-04-04T22:35:05.954927861Z [2024-04-04T22:35:05.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:34:00+00:00, map_index=-1, run_start_date=2024-04-04 22:35:03.448008+00:00, run_end_date=2024-04-04 22:35:05.089935+00:00, run_duration=1.641927, state=success, executor_state=success, try_number=1, max_tries=1, job_id=35, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:35:00.368129+00:00, queued_by_job_id=1, pid=598 2024-04-04T22:35:05.955815307Z [2024-04-04T22:35:05.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:34:00+00:00, map_index=-1, run_start_date=2024-04-04 22:35:03.459977+00:00, run_end_date=2024-04-04 22:35:04.768518+00:00, run_duration=1.308541, state=success, executor_state=success, try_number=1, max_tries=1, job_id=36, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:35:00.368129+00:00, queued_by_job_id=1, pid=599 2024-04-04T22:35:07.041222021Z [2024-04-04T22:35:07.040+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:35:07.041275639Z 2024-04-04T22:35:07.041664936Z [2024-04-04T22:35:07.041+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:35:07.042833022Z [2024-04-04T22:35:07.042+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:35:07.042849136Z 2024-04-04T22:35:07.046437745Z [2024-04-04T22:35:07.046+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-04T22:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T22:35:07.046780754Z [2024-04-04T22:35:07.046+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-04T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T22:35:07.108365005Z [2024-04-04T22:35:07.106+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T22:30:00+00:00 exited with status queued for try_number 1 2024-04-04T22:35:07.108467477Z [2024-04-04T22:35:07.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T22:30:00+00:00 exited with status success for try_number 1 2024-04-04T22:35:07.118321596Z [2024-04-04T22:35:07.117+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-04T22:30:00+00:00, map_index=-1, run_start_date=2024-04-04 22:35:06.394905+00:00, run_end_date=2024-04-04 22:35:06.703160+00:00, run_duration=0.308255, state=success, executor_state=success, try_number=1, max_tries=1, job_id=37, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:35:04.505009+00:00, queued_by_job_id=1, pid=632 2024-04-04T22:35:07.118613867Z [2024-04-04T22:35:07.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0299332b-0e3d-432d-93a9-e98d9564bef1 2024-04-04T22:35:09.642785530Z [2024-04-04T22:35:09.642+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:35:09.642838126Z 2024-04-04T22:35:09.643156537Z [2024-04-04T22:35:09.642+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:35:09.643947159Z [2024-04-04T22:35:09.643+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:35:09.643961487Z 2024-04-04T22:35:09.648172956Z [2024-04-04T22:35:09.647+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-04T22:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:35:09.648457044Z [2024-04-04T22:35:09.648+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-04T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:35:09.781315378Z [2024-04-04T22:35:09.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T22:30:00+00:00 exited with status queued for try_number 1 2024-04-04T22:35:09.781512395Z [2024-04-04T22:35:09.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T22:30:00+00:00 exited with status success for try_number 1 2024-04-04T22:35:09.789247629Z [2024-04-04T22:35:09.788+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-04T22:30:00+00:00, map_index=0, run_start_date=2024-04-04 22:35:08.725513+00:00, run_end_date=2024-04-04 22:35:09.121099+00:00, run_duration=0.395586, state=success, executor_state=success, try_number=1, max_tries=1, job_id=38, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:35:07.043475+00:00, queued_by_job_id=1, pid=640 2024-04-04T22:35:09.789956907Z [2024-04-04T22:35:09.789+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7262e23-a6f8-4935-9b6d-f4a1509cc2bd 2024-04-04T22:35:12.464636258Z [2024-04-04T22:35:12.463+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:35:12.465118567Z [2024-04-04T22:35:12.464+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:30:00+00:00, run_id=scheduled__2024-04-04T22:30:00+00:00, run_start_date=2024-04-04 22:35:00.287376+00:00, run_end_date=2024-04-04 22:35:12.464538+00:00, run_duration=12.177162, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:30:00+00:00, data_interval_end=2024-04-04 22:35:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-04T22:35:12.473762514Z [2024-04-04T22:35:12.473+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:35:00+00:00, run_after=2024-04-04T22:40:00+00:00 2024-04-04T22:35:12.521103407Z [2024-04-04T22:35:12.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T22:30:00+00:00 exited with status success for try_number 1 2024-04-04T22:35:12.548823836Z [2024-04-04T22:35:12.548+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-04T22:30:00+00:00, map_index=-1, run_start_date=2024-04-04 22:35:11.970398+00:00, run_end_date=2024-04-04 22:35:12.376022+00:00, run_duration=0.405624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=39, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:35:09.644964+00:00, queued_by_job_id=1, pid=661 2024-04-04T22:35:14.637027348Z [2024-04-04T22:35:14.636+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:35:14.637060128Z 2024-04-04T22:35:14.637142470Z [2024-04-04T22:35:14.636+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c has 0/16 running and queued tasks 2024-04-04T22:35:14.637726317Z [2024-04-04T22:35:14.637+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:35:14.637743037Z 2024-04-04T22:35:14.640324538Z [2024-04-04T22:35:14.640+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T22:30:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-04-04T22:35:14.640528683Z [2024-04-04T22:35:14.640+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T22:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:35:14.686989996Z [2024-04-04T22:35:14.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:30:00+00:00 exited with status queued for try_number 2 2024-04-04T22:35:14.694312455Z [2024-04-04T22:35:14.693+0000] {scheduler_job.py:635} INFO - Setting external_id for to 717428c4-81a4-40e7-8067-0b414ef22f35 2024-04-04T22:35:16.964528864Z [2024-04-04T22:35:16.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:30:00+00:00 exited with status failed for try_number 2 2024-04-04T22:35:16.970625042Z [2024-04-04T22:35:16.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T22:30:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-04 22:35:04.579346+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:35:14.638067+00:00, queued_by_job_id=1, pid=None 2024-04-04T22:35:16.971181557Z [2024-04-04T22:35:16.970+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:35:16.973935527Z [2024-04-04T22:35:16.973+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:35:16.988403281Z [2024-04-04T22:35:16.987+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c, task_id=extract_metrics_from_vnfrs, execution_date=20240404T223000, start_date=, end_date=20240404T223516 2024-04-04T22:35:20.748716020Z [2024-04-04T22:35:20.748+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-04T22:35:20.749061239Z [2024-04-04T22:35:20.748+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c, execution_date=2024-04-04 22:30:00+00:00, run_id=scheduled__2024-04-04T22:30:00+00:00, run_start_date=2024-04-04 22:35:00.285861+00:00, run_end_date=2024-04-04 22:35:20.748685+00:00, run_duration=20.462824, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:30:00+00:00, data_interval_end=2024-04-04 22:35:00+00:00, dag_hash=c21f9725978463d9f053dd40fe91d6f6 2024-04-04T22:35:20.755829490Z [2024-04-04T22:35:20.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_c42364e0-1f70-4b91-9e97-7c1f0488a24c to 2024-04-04T22:35:00+00:00, run_after=2024-04-04T22:40:00+00:00 2024-04-04T22:35:39.023323651Z [2024-04-04T22:35:39.022+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-04T22:36:00.166965637Z [2024-04-04T22:36:00.166+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:36:00.176981831Z [2024-04-04T22:36:00.176+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:36:00.192042936Z [2024-04-04T22:36:00.191+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:36:00+00:00, run_after=2024-04-04T22:37:00+00:00 2024-04-04T22:36:00.204492836Z [2024-04-04T22:36:00.204+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:36:00+00:00, run_after=2024-04-04T22:37:00+00:00 2024-04-04T22:36:00.304401353Z [2024-04-04T22:36:00.302+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T22:36:00.304423924Z 2024-04-04T22:36:00.304428195Z 2024-04-04T22:36:00.304431429Z 2024-04-04T22:36:00.304434777Z 2024-04-04T22:36:00.304441149Z [2024-04-04T22:36:00.303+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T22:36:00.304444416Z [2024-04-04T22:36:00.303+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:36:00.304460507Z [2024-04-04T22:36:00.303+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:36:00.304463745Z [2024-04-04T22:36:00.303+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:36:00.306556691Z [2024-04-04T22:36:00.306+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:36:00.306573309Z 2024-04-04T22:36:00.306578465Z 2024-04-04T22:36:00.306582043Z 2024-04-04T22:36:00.306585314Z 2024-04-04T22:36:00.311270770Z [2024-04-04T22:36:00.310+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T22:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:36:00.313829411Z [2024-04-04T22:36:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T22:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T22:36:00.313859844Z [2024-04-04T22:36:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:36:00.313863954Z [2024-04-04T22:36:00.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:36:00.313867212Z [2024-04-04T22:36:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:36:00.313870370Z [2024-04-04T22:36:00.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:36:00.314031528Z [2024-04-04T22:36:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:36:00.314124732Z [2024-04-04T22:36:00.314+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:36:00.838645684Z [2024-04-04T22:36:00.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:34:00+00:00 exited with status queued for try_number 1 2024-04-04T22:36:00.840366984Z [2024-04-04T22:36:00.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:35:00+00:00 exited with status queued for try_number 1 2024-04-04T22:36:00.840519811Z [2024-04-04T22:36:00.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:35:00+00:00 exited with status queued for try_number 1 2024-04-04T22:36:00.840579695Z [2024-04-04T22:36:00.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:35:00+00:00 exited with status queued for try_number 1 2024-04-04T22:36:00.869541017Z [2024-04-04T22:36:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 44c6f59c-a3bd-4061-888c-1fe13fb87eb6 2024-04-04T22:36:00.869611914Z [2024-04-04T22:36:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 255cfbf7-892b-46a3-aba5-31eee1ee1252 2024-04-04T22:36:00.869749378Z [2024-04-04T22:36:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 682a40e8-f90e-4966-95bb-84cedfcc1e64 2024-04-04T22:36:00.869952035Z [2024-04-04T22:36:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9f16dae-5f3b-4953-9e0e-5c1233c492f1 2024-04-04T22:36:03.304153542Z [2024-04-04T22:36:03.303+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:36:03.304475637Z [2024-04-04T22:36:03.304+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 22:34:00+00:00, run_id=scheduled__2024-04-04T22:34:00+00:00, run_start_date=2024-04-04 22:36:00.214299+00:00, run_end_date=2024-04-04 22:36:03.304055+00:00, run_duration=3.089756, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:34:00+00:00, data_interval_end=2024-04-04 22:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T22:36:03.313218941Z [2024-04-04T22:36:03.312+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T22:36:00+00:00, run_after=2024-04-04T22:38:00+00:00 2024-04-04T22:36:03.321780822Z [2024-04-04T22:36:03.321+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:36:03.322068100Z [2024-04-04T22:36:03.321+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:35:00+00:00, run_id=scheduled__2024-04-04T22:35:00+00:00, run_start_date=2024-04-04 22:36:00.216550+00:00, run_end_date=2024-04-04 22:36:03.321654+00:00, run_duration=3.105104, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:35:00+00:00, data_interval_end=2024-04-04 22:36:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:36:03.334260983Z [2024-04-04T22:36:03.333+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:36:00+00:00, run_after=2024-04-04T22:37:00+00:00 2024-04-04T22:36:03.394464569Z [2024-04-04T22:36:03.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:34:00+00:00 exited with status success for try_number 1 2024-04-04T22:36:03.394509270Z [2024-04-04T22:36:03.394+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:35:00+00:00 exited with status success for try_number 1 2024-04-04T22:36:03.403719692Z [2024-04-04T22:36:03.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T22:34:00+00:00, map_index=-1, run_start_date=2024-04-04 22:36:01.746316+00:00, run_end_date=2024-04-04 22:36:02.370219+00:00, run_duration=0.623903, state=success, executor_state=success, try_number=1, max_tries=1, job_id=40, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:36:00.307667+00:00, queued_by_job_id=1, pid=683 2024-04-04T22:36:03.404180166Z [2024-04-04T22:36:03.403+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:35:00+00:00, map_index=-1, run_start_date=2024-04-04 22:36:01.762261+00:00, run_end_date=2024-04-04 22:36:02.416626+00:00, run_duration=0.654365, state=success, executor_state=success, try_number=1, max_tries=1, job_id=41, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:36:00.307667+00:00, queued_by_job_id=1, pid=684 2024-04-04T22:36:05.260815492Z [2024-04-04T22:36:05.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:36:05.261105495Z [2024-04-04T22:36:05.260+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:35:00+00:00, run_id=scheduled__2024-04-04T22:35:00+00:00, run_start_date=2024-04-04 22:36:00.217495+00:00, run_end_date=2024-04-04 22:36:05.260651+00:00, run_duration=5.043156, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:35:00+00:00, data_interval_end=2024-04-04 22:36:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:36:05.270315430Z [2024-04-04T22:36:05.269+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:36:00+00:00, run_after=2024-04-04T22:37:00+00:00 2024-04-04T22:36:05.308155229Z [2024-04-04T22:36:05.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:35:00+00:00 exited with status success for try_number 1 2024-04-04T22:36:05.312863197Z [2024-04-04T22:36:05.312+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:35:00+00:00, map_index=-1, run_start_date=2024-04-04 22:36:03.124885+00:00, run_end_date=2024-04-04 22:36:04.916345+00:00, run_duration=1.79146, state=success, executor_state=success, try_number=1, max_tries=1, job_id=42, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:36:00.307667+00:00, queued_by_job_id=1, pid=707 2024-04-04T22:36:06.346531762Z [2024-04-04T22:36:06.346+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:36:06.346872596Z [2024-04-04T22:36:06.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:35:00+00:00, run_id=scheduled__2024-04-04T22:35:00+00:00, run_start_date=2024-04-04 22:36:00.215550+00:00, run_end_date=2024-04-04 22:36:06.346427+00:00, run_duration=6.130877, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:35:00+00:00, data_interval_end=2024-04-04 22:36:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:36:06.357812131Z [2024-04-04T22:36:06.357+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:36:00+00:00, run_after=2024-04-04T22:37:00+00:00 2024-04-04T22:36:06.388955074Z [2024-04-04T22:36:06.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:35:00+00:00 exited with status success for try_number 1 2024-04-04T22:36:06.402843420Z [2024-04-04T22:36:06.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:35:00+00:00, map_index=-1, run_start_date=2024-04-04 22:36:03.236522+00:00, run_end_date=2024-04-04 22:36:05.940842+00:00, run_duration=2.70432, state=success, executor_state=success, try_number=1, max_tries=1, job_id=43, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:36:00.307667+00:00, queued_by_job_id=1, pid=708 2024-04-04T22:37:00.055714708Z [2024-04-04T22:37:00.055+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:37:00.093564420Z [2024-04-04T22:37:00.093+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:37:00+00:00, run_after=2024-04-04T22:38:00+00:00 2024-04-04T22:37:00.117973688Z [2024-04-04T22:37:00.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:37:00+00:00, run_after=2024-04-04T22:38:00+00:00 2024-04-04T22:37:00.461003340Z [2024-04-04T22:37:00.460+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T22:37:00.461065325Z 2024-04-04T22:37:00.461069719Z 2024-04-04T22:37:00.461073481Z 2024-04-04T22:37:00.461539347Z [2024-04-04T22:37:00.460+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:37:00.461896779Z [2024-04-04T22:37:00.461+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:37:00.462124799Z [2024-04-04T22:37:00.461+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:37:00.464990060Z [2024-04-04T22:37:00.464+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:37:00.465041673Z 2024-04-04T22:37:00.465046045Z 2024-04-04T22:37:00.465049262Z 2024-04-04T22:37:00.472772942Z [2024-04-04T22:37:00.472+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:37:00.473716231Z [2024-04-04T22:37:00.472+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:37:00.474272018Z [2024-04-04T22:37:00.474+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:37:00.479426801Z [2024-04-04T22:37:00.474+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:37:00.480151613Z [2024-04-04T22:37:00.479+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:37:00.480404892Z [2024-04-04T22:37:00.480+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:37:01.544179133Z [2024-04-04T22:37:01.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:36:00+00:00 exited with status queued for try_number 1 2024-04-04T22:37:01.544786339Z [2024-04-04T22:37:01.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:36:00+00:00 exited with status queued for try_number 1 2024-04-04T22:37:01.548118486Z [2024-04-04T22:37:01.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:36:00+00:00 exited with status queued for try_number 1 2024-04-04T22:37:01.571363730Z [2024-04-04T22:37:01.570+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73360960-3d18-4696-919b-88044260f3ed 2024-04-04T22:37:01.580184725Z [2024-04-04T22:37:01.579+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43b361b3-9e8a-43e9-bb3f-230157a26ebe 2024-04-04T22:37:01.583297149Z [2024-04-04T22:37:01.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb1e9544-4602-4baf-9fd1-ff6a2d421ba8 2024-04-04T22:37:05.495636236Z [2024-04-04T22:37:05.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:37:05.503217848Z [2024-04-04T22:37:05.502+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:36:00+00:00, run_id=scheduled__2024-04-04T22:36:00+00:00, run_start_date=2024-04-04 22:37:00.184035+00:00, run_end_date=2024-04-04 22:37:05.502126+00:00, run_duration=5.318091, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:36:00+00:00, data_interval_end=2024-04-04 22:37:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:37:05.517161970Z [2024-04-04T22:37:05.516+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:37:00+00:00, run_after=2024-04-04T22:38:00+00:00 2024-04-04T22:37:06.794577768Z [2024-04-04T22:37:06.794+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:36:00+00:00 exited with status success for try_number 1 2024-04-04T22:37:06.801220169Z [2024-04-04T22:37:06.800+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:36:00+00:00, map_index=-1, run_start_date=2024-04-04 22:37:04.415195+00:00, run_end_date=2024-04-04 22:37:05.431656+00:00, run_duration=1.016461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=44, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:37:00.465999+00:00, queued_by_job_id=1, pid=741 2024-04-04T22:37:07.853033514Z [2024-04-04T22:37:07.852+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:37:07.853342226Z [2024-04-04T22:37:07.852+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:36:00+00:00, run_id=scheduled__2024-04-04T22:36:00+00:00, run_start_date=2024-04-04 22:37:00.187972+00:00, run_end_date=2024-04-04 22:37:07.852869+00:00, run_duration=7.664897, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:36:00+00:00, data_interval_end=2024-04-04 22:37:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:37:07.863636435Z [2024-04-04T22:37:07.863+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:37:00+00:00, run_after=2024-04-04T22:38:00+00:00 2024-04-04T22:37:07.897980282Z [2024-04-04T22:37:07.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:36:00+00:00 exited with status success for try_number 1 2024-04-04T22:37:07.904266908Z [2024-04-04T22:37:07.903+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:36:00+00:00, map_index=-1, run_start_date=2024-04-04 22:37:05.817513+00:00, run_end_date=2024-04-04 22:37:07.215865+00:00, run_duration=1.398352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=45, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:37:00.465999+00:00, queued_by_job_id=1, pid=753 2024-04-04T22:37:08.946257693Z [2024-04-04T22:37:08.945+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:37:08.946652706Z [2024-04-04T22:37:08.946+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:36:00+00:00, run_id=scheduled__2024-04-04T22:36:00+00:00, run_start_date=2024-04-04 22:37:00.175712+00:00, run_end_date=2024-04-04 22:37:08.946176+00:00, run_duration=8.770464, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:36:00+00:00, data_interval_end=2024-04-04 22:37:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:37:08.961481314Z [2024-04-04T22:37:08.960+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:37:00+00:00, run_after=2024-04-04T22:38:00+00:00 2024-04-04T22:37:08.991521932Z [2024-04-04T22:37:08.991+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:36:00+00:00 exited with status success for try_number 1 2024-04-04T22:37:08.996413100Z [2024-04-04T22:37:08.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:36:00+00:00, map_index=-1, run_start_date=2024-04-04 22:37:06.714580+00:00, run_end_date=2024-04-04 22:37:08.557976+00:00, run_duration=1.843396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=46, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:37:00.465999+00:00, queued_by_job_id=1, pid=764 2024-04-04T22:38:00.832023604Z [2024-04-04T22:38:00.831+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:38:00+00:00, run_after=2024-04-04T22:39:00+00:00 2024-04-04T22:38:00.851665532Z [2024-04-04T22:38:00.851+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:38:00+00:00, run_after=2024-04-04T22:39:00+00:00 2024-04-04T22:38:00.860710379Z [2024-04-04T22:38:00.860+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:38:00.869773788Z [2024-04-04T22:38:00.869+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:38:00.963441885Z [2024-04-04T22:38:00.962+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T22:38:00.963469274Z 2024-04-04T22:38:00.963474515Z 2024-04-04T22:38:00.963478285Z 2024-04-04T22:38:00.963497557Z 2024-04-04T22:38:00.963725800Z [2024-04-04T22:38:00.963+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T22:38:00.963873487Z [2024-04-04T22:38:00.963+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:38:00.964094157Z [2024-04-04T22:38:00.963+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:38:00.964381293Z [2024-04-04T22:38:00.964+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:38:00.965098131Z [2024-04-04T22:38:00.964+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:38:00.965110508Z 2024-04-04T22:38:00.965114245Z 2024-04-04T22:38:00.965117336Z 2024-04-04T22:38:00.965120384Z 2024-04-04T22:38:00.968669244Z [2024-04-04T22:38:00.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T22:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:38:00.968969125Z [2024-04-04T22:38:00.968+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T22:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T22:38:00.969369704Z [2024-04-04T22:38:00.969+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:38:00.969709370Z [2024-04-04T22:38:00.969+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:38:00.970056130Z [2024-04-04T22:38:00.969+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:38:00.970269326Z [2024-04-04T22:38:00.970+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:38:00.970544878Z [2024-04-04T22:38:00.970+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:38:00.970723444Z [2024-04-04T22:38:00.970+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:38:01.590578743Z [2024-04-04T22:38:01.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:36:00+00:00 exited with status queued for try_number 1 2024-04-04T22:38:01.592013147Z [2024-04-04T22:38:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:37:00+00:00 exited with status queued for try_number 1 2024-04-04T22:38:01.592219251Z [2024-04-04T22:38:01.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:37:00+00:00 exited with status queued for try_number 1 2024-04-04T22:38:01.592379299Z [2024-04-04T22:38:01.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:37:00+00:00 exited with status queued for try_number 1 2024-04-04T22:38:01.627605763Z [2024-04-04T22:38:01.626+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5b84616-b3cc-4c8e-8630-42b7e8ff984e 2024-04-04T22:38:01.629518436Z [2024-04-04T22:38:01.628+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65a5fd61-2ba3-452f-886f-b1e686f05323 2024-04-04T22:38:01.631742568Z [2024-04-04T22:38:01.630+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa3b8e63-2580-4111-8c31-ff390828feea 2024-04-04T22:38:01.632177410Z [2024-04-04T22:38:01.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17e8c33e-449d-4189-b6a3-80b19b8c973a 2024-04-04T22:38:04.026395616Z [2024-04-04T22:38:04.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:38:04.027209259Z [2024-04-04T22:38:04.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 22:36:00+00:00, run_id=scheduled__2024-04-04T22:36:00+00:00, run_start_date=2024-04-04 22:38:00.887682+00:00, run_end_date=2024-04-04 22:38:04.026692+00:00, run_duration=3.13901, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:36:00+00:00, data_interval_end=2024-04-04 22:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T22:38:04.038472421Z [2024-04-04T22:38:04.038+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T22:38:00+00:00, run_after=2024-04-04T22:40:00+00:00 2024-04-04T22:38:04.059109017Z [2024-04-04T22:38:04.058+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:38:04.059671511Z [2024-04-04T22:38:04.059+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:37:00+00:00, run_id=scheduled__2024-04-04T22:37:00+00:00, run_start_date=2024-04-04 22:38:00.891808+00:00, run_end_date=2024-04-04 22:38:04.059225+00:00, run_duration=3.167417, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:37:00+00:00, data_interval_end=2024-04-04 22:38:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:38:04.080250494Z [2024-04-04T22:38:04.079+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:38:00+00:00, run_after=2024-04-04T22:39:00+00:00 2024-04-04T22:38:04.136735556Z [2024-04-04T22:38:04.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:36:00+00:00 exited with status success for try_number 1 2024-04-04T22:38:04.136963278Z [2024-04-04T22:38:04.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:37:00+00:00 exited with status success for try_number 1 2024-04-04T22:38:04.148220674Z [2024-04-04T22:38:04.147+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T22:36:00+00:00, map_index=-1, run_start_date=2024-04-04 22:38:03.139375+00:00, run_end_date=2024-04-04 22:38:03.645610+00:00, run_duration=0.506235, state=success, executor_state=success, try_number=1, max_tries=1, job_id=48, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:38:00.965948+00:00, queued_by_job_id=1, pid=794 2024-04-04T22:38:04.148490683Z [2024-04-04T22:38:04.148+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:37:00+00:00, map_index=-1, run_start_date=2024-04-04 22:38:02.601753+00:00, run_end_date=2024-04-04 22:38:03.330353+00:00, run_duration=0.7286, state=success, executor_state=success, try_number=1, max_tries=1, job_id=47, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:38:00.965948+00:00, queued_by_job_id=1, pid=793 2024-04-04T22:38:07.954642189Z [2024-04-04T22:38:07.954+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:38:07.955032404Z [2024-04-04T22:38:07.954+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:37:00+00:00, run_id=scheduled__2024-04-04T22:37:00+00:00, run_start_date=2024-04-04 22:38:00.889788+00:00, run_end_date=2024-04-04 22:38:07.954508+00:00, run_duration=7.06472, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:37:00+00:00, data_interval_end=2024-04-04 22:38:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:38:07.963337533Z [2024-04-04T22:38:07.963+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:38:00+00:00, run_after=2024-04-04T22:39:00+00:00 2024-04-04T22:38:07.969909297Z [2024-04-04T22:38:07.969+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:38:07.970260661Z [2024-04-04T22:38:07.970+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:37:00+00:00, run_id=scheduled__2024-04-04T22:37:00+00:00, run_start_date=2024-04-04 22:38:00.893186+00:00, run_end_date=2024-04-04 22:38:07.969820+00:00, run_duration=7.076634, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:37:00+00:00, data_interval_end=2024-04-04 22:38:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:38:07.982611165Z [2024-04-04T22:38:07.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:38:00+00:00, run_after=2024-04-04T22:39:00+00:00 2024-04-04T22:38:08.009448472Z [2024-04-04T22:38:08.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:37:00+00:00 exited with status success for try_number 1 2024-04-04T22:38:08.009588264Z [2024-04-04T22:38:08.009+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:37:00+00:00 exited with status success for try_number 1 2024-04-04T22:38:08.016198030Z [2024-04-04T22:38:08.015+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:37:00+00:00, map_index=-1, run_start_date=2024-04-04 22:38:04.300597+00:00, run_end_date=2024-04-04 22:38:07.081928+00:00, run_duration=2.781331, state=success, executor_state=success, try_number=1, max_tries=1, job_id=49, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:38:00.965948+00:00, queued_by_job_id=1, pid=817 2024-04-04T22:38:08.016318109Z [2024-04-04T22:38:08.016+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:37:00+00:00, map_index=-1, run_start_date=2024-04-04 22:38:04.460390+00:00, run_end_date=2024-04-04 22:38:07.008780+00:00, run_duration=2.54839, state=success, executor_state=success, try_number=1, max_tries=1, job_id=50, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:38:00.965948+00:00, queued_by_job_id=1, pid=818 2024-04-04T22:39:00.719584148Z [2024-04-04T22:39:00.718+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:39:00+00:00, run_after=2024-04-04T22:40:00+00:00 2024-04-04T22:39:00.744866847Z [2024-04-04T22:39:00.744+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:39:00+00:00, run_after=2024-04-04T22:40:00+00:00 2024-04-04T22:39:00.762569713Z [2024-04-04T22:39:00.762+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:39:00.888096470Z [2024-04-04T22:39:00.887+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T22:39:00.888125341Z 2024-04-04T22:39:00.888129268Z 2024-04-04T22:39:00.888133152Z 2024-04-04T22:39:00.888566335Z [2024-04-04T22:39:00.888+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:39:00.888768351Z [2024-04-04T22:39:00.888+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:39:00.888965958Z [2024-04-04T22:39:00.888+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:39:00.889747182Z [2024-04-04T22:39:00.889+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:39:00.889759401Z 2024-04-04T22:39:00.889762717Z 2024-04-04T22:39:00.889766005Z 2024-04-04T22:39:00.894472814Z [2024-04-04T22:39:00.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:39:00.894658238Z [2024-04-04T22:39:00.894+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:39:00.894983784Z [2024-04-04T22:39:00.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:39:00.895203424Z [2024-04-04T22:39:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:39:00.895551117Z [2024-04-04T22:39:00.895+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:39:00.895802881Z [2024-04-04T22:39:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:39:01.361303549Z [2024-04-04T22:39:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:38:00+00:00 exited with status queued for try_number 1 2024-04-04T22:39:01.361336499Z [2024-04-04T22:39:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:38:00+00:00 exited with status queued for try_number 1 2024-04-04T22:39:01.361340316Z [2024-04-04T22:39:01.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:38:00+00:00 exited with status queued for try_number 1 2024-04-04T22:39:01.370589041Z [2024-04-04T22:39:01.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 719da338-fa8b-4b58-beb8-b2ab722a38e7 2024-04-04T22:39:01.370633844Z [2024-04-04T22:39:01.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to caf8dec0-a46b-435f-9075-7678f0809288 2024-04-04T22:39:01.370702762Z [2024-04-04T22:39:01.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to d12f4d8a-87ff-4335-a328-e5645cb56525 2024-04-04T22:39:03.662857591Z [2024-04-04T22:39:03.662+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:39:03.663639962Z [2024-04-04T22:39:03.663+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:38:00+00:00, run_id=scheduled__2024-04-04T22:38:00+00:00, run_start_date=2024-04-04 22:39:00.788972+00:00, run_end_date=2024-04-04 22:39:03.662950+00:00, run_duration=2.873978, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:38:00+00:00, data_interval_end=2024-04-04 22:39:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:39:03.679272102Z [2024-04-04T22:39:03.678+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:39:00+00:00, run_after=2024-04-04T22:40:00+00:00 2024-04-04T22:39:03.727668009Z [2024-04-04T22:39:03.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:38:00+00:00 exited with status success for try_number 1 2024-04-04T22:39:03.731688404Z [2024-04-04T22:39:03.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:38:00+00:00, map_index=-1, run_start_date=2024-04-04 22:39:02.079316+00:00, run_end_date=2024-04-04 22:39:02.585729+00:00, run_duration=0.506413, state=success, executor_state=success, try_number=1, max_tries=1, job_id=51, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:39:00.891054+00:00, queued_by_job_id=1, pid=850 2024-04-04T22:39:06.151168649Z [2024-04-04T22:39:06.150+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:39:06.151478505Z [2024-04-04T22:39:06.151+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:38:00+00:00, run_id=scheduled__2024-04-04T22:38:00+00:00, run_start_date=2024-04-04 22:39:00.793528+00:00, run_end_date=2024-04-04 22:39:06.151089+00:00, run_duration=5.357561, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:38:00+00:00, data_interval_end=2024-04-04 22:39:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:39:06.160539652Z [2024-04-04T22:39:06.160+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:39:00+00:00, run_after=2024-04-04T22:40:00+00:00 2024-04-04T22:39:06.174640527Z [2024-04-04T22:39:06.174+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:39:06.174950839Z [2024-04-04T22:39:06.174+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:38:00+00:00, run_id=scheduled__2024-04-04T22:38:00+00:00, run_start_date=2024-04-04 22:39:00.795875+00:00, run_end_date=2024-04-04 22:39:06.174554+00:00, run_duration=5.378679, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:38:00+00:00, data_interval_end=2024-04-04 22:39:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:39:06.185552428Z [2024-04-04T22:39:06.185+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:39:00+00:00, run_after=2024-04-04T22:40:00+00:00 2024-04-04T22:39:06.214516028Z [2024-04-04T22:39:06.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:38:00+00:00 exited with status success for try_number 1 2024-04-04T22:39:06.214558554Z [2024-04-04T22:39:06.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:38:00+00:00 exited with status success for try_number 1 2024-04-04T22:39:06.219489195Z [2024-04-04T22:39:06.219+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:38:00+00:00, map_index=-1, run_start_date=2024-04-04 22:39:03.089070+00:00, run_end_date=2024-04-04 22:39:05.047227+00:00, run_duration=1.958157, state=success, executor_state=success, try_number=1, max_tries=1, job_id=53, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:39:00.891054+00:00, queued_by_job_id=1, pid=869 2024-04-04T22:39:06.219734841Z [2024-04-04T22:39:06.219+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:38:00+00:00, map_index=-1, run_start_date=2024-04-04 22:39:03.044113+00:00, run_end_date=2024-04-04 22:39:05.141163+00:00, run_duration=2.09705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=52, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:39:00.891054+00:00, queued_by_job_id=1, pid=868 2024-04-04T22:40:00.550562829Z [2024-04-04T22:40:00.550+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:40:00.562897314Z [2024-04-04T22:40:00.562+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:40:00+00:00, run_after=2024-04-04T22:45:00+00:00 2024-04-04T22:40:00.576701535Z [2024-04-04T22:40:00.576+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:40:00+00:00, run_after=2024-04-04T22:41:00+00:00 2024-04-04T22:40:00.584060326Z [2024-04-04T22:40:00.583+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:40:00.599862411Z [2024-04-04T22:40:00.599+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:40:00+00:00, run_after=2024-04-04T22:41:00+00:00 2024-04-04T22:40:00.756423022Z [2024-04-04T22:40:00.755+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-04T22:40:00.756454816Z 2024-04-04T22:40:00.756460543Z 2024-04-04T22:40:00.756473017Z 2024-04-04T22:40:00.756478686Z 2024-04-04T22:40:00.756484309Z 2024-04-04T22:40:00.757116147Z [2024-04-04T22:40:00.756+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:40:00.757494592Z [2024-04-04T22:40:00.757+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T22:40:00.757872069Z [2024-04-04T22:40:00.757+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:40:00.758298007Z [2024-04-04T22:40:00.758+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:40:00.758634700Z [2024-04-04T22:40:00.758+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:40:00.759628971Z [2024-04-04T22:40:00.759+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:40:00.759646606Z 2024-04-04T22:40:00.759653263Z 2024-04-04T22:40:00.759659409Z 2024-04-04T22:40:00.759664665Z 2024-04-04T22:40:00.759670138Z 2024-04-04T22:40:00.765429796Z [2024-04-04T22:40:00.765+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T22:40:00.765844562Z [2024-04-04T22:40:00.765+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:40:00.766343840Z [2024-04-04T22:40:00.766+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T22:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:40:00.767250521Z [2024-04-04T22:40:00.766+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T22:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T22:40:00.767752174Z [2024-04-04T22:40:00.767+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:40:00.768098678Z [2024-04-04T22:40:00.767+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:40:00.768705505Z [2024-04-04T22:40:00.768+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:40:00.768991222Z [2024-04-04T22:40:00.768+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:40:00.769534217Z [2024-04-04T22:40:00.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:40:00.769907903Z [2024-04-04T22:40:00.769+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:40:01.484837310Z [2024-04-04T22:40:01.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:35:00+00:00 exited with status queued for try_number 1 2024-04-04T22:40:01.485297549Z [2024-04-04T22:40:01.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:38:00+00:00 exited with status queued for try_number 1 2024-04-04T22:40:01.485734693Z [2024-04-04T22:40:01.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:39:00+00:00 exited with status queued for try_number 1 2024-04-04T22:40:01.486081339Z [2024-04-04T22:40:01.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:39:00+00:00 exited with status queued for try_number 1 2024-04-04T22:40:01.486412544Z [2024-04-04T22:40:01.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:39:00+00:00 exited with status queued for try_number 1 2024-04-04T22:40:01.532119478Z [2024-04-04T22:40:01.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc00f124-30fd-4db0-849a-cba0c58de863 2024-04-04T22:40:01.532929988Z [2024-04-04T22:40:01.532+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6936512-37ce-4e1d-8e53-56a7f7bf8c56 2024-04-04T22:40:01.534648149Z [2024-04-04T22:40:01.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to a552ff47-c10a-406d-8260-00a9539e4d28 2024-04-04T22:40:01.535136337Z [2024-04-04T22:40:01.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a85a095-ad2a-44bc-b1a6-252fb7cf1cf1 2024-04-04T22:40:01.536330632Z [2024-04-04T22:40:01.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7560d65e-4de0-46aa-9aa7-2d07844cb0e3 2024-04-04T22:40:04.117955272Z [2024-04-04T22:40:04.117+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:40:04.121096426Z [2024-04-04T22:40:04.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 22:38:00+00:00, run_id=scheduled__2024-04-04T22:38:00+00:00, run_start_date=2024-04-04 22:40:00.640066+00:00, run_end_date=2024-04-04 22:40:04.117869+00:00, run_duration=3.477803, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:38:00+00:00, data_interval_end=2024-04-04 22:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T22:40:04.131536493Z [2024-04-04T22:40:04.131+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T22:40:00+00:00, run_after=2024-04-04T22:42:00+00:00 2024-04-04T22:40:04.182633408Z [2024-04-04T22:40:04.182+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:40:04.182792907Z [2024-04-04T22:40:04.182+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:39:00+00:00, run_id=scheduled__2024-04-04T22:39:00+00:00, run_start_date=2024-04-04 22:40:00.646353+00:00, run_end_date=2024-04-04 22:40:04.182503+00:00, run_duration=3.53615, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:39:00+00:00, data_interval_end=2024-04-04 22:40:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:40:04.196609098Z [2024-04-04T22:40:04.196+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:40:00+00:00, run_after=2024-04-04T22:41:00+00:00 2024-04-04T22:40:04.263066312Z [2024-04-04T22:40:04.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:38:00+00:00 exited with status success for try_number 1 2024-04-04T22:40:04.263101644Z [2024-04-04T22:40:04.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:39:00+00:00 exited with status success for try_number 1 2024-04-04T22:40:04.270093380Z [2024-04-04T22:40:04.269+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T22:38:00+00:00, map_index=-1, run_start_date=2024-04-04 22:40:02.813188+00:00, run_end_date=2024-04-04 22:40:03.484823+00:00, run_duration=0.671635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=55, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:40:00.761467+00:00, queued_by_job_id=1, pid=907 2024-04-04T22:40:04.270250143Z [2024-04-04T22:40:04.270+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:39:00+00:00, map_index=-1, run_start_date=2024-04-04 22:40:02.469530+00:00, run_end_date=2024-04-04 22:40:03.007710+00:00, run_duration=0.53818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=54, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:40:00.761467+00:00, queued_by_job_id=1, pid=904 2024-04-04T22:40:05.424398861Z [2024-04-04T22:40:05.424+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:40:05.424440108Z 2024-04-04T22:40:05.424991610Z [2024-04-04T22:40:05.424+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:40:05.425822978Z [2024-04-04T22:40:05.425+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:40:05.425834617Z 2024-04-04T22:40:05.428982077Z [2024-04-04T22:40:05.428+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-04T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T22:40:05.429191424Z [2024-04-04T22:40:05.428+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-04T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:40:05.473986033Z [2024-04-04T22:40:05.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T22:35:00+00:00 exited with status queued for try_number 1 2024-04-04T22:40:05.474034289Z [2024-04-04T22:40:05.473+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:35:00+00:00 exited with status success for try_number 1 2024-04-04T22:40:05.479391237Z [2024-04-04T22:40:05.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T22:35:00+00:00, map_index=-1, run_start_date=2024-04-04 22:40:04.221978+00:00, run_end_date=2024-04-04 22:40:04.685176+00:00, run_duration=0.463198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=58, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:40:00.761467+00:00, queued_by_job_id=1, pid=936 2024-04-04T22:40:05.479684229Z [2024-04-04T22:40:05.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to 01f3cb65-df81-4014-9566-6526e91c445f 2024-04-04T22:40:06.614598536Z [2024-04-04T22:40:06.614+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:40:06.614852724Z [2024-04-04T22:40:06.614+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:39:00+00:00, run_id=scheduled__2024-04-04T22:39:00+00:00, run_start_date=2024-04-04 22:40:00.644517+00:00, run_end_date=2024-04-04 22:40:06.614490+00:00, run_duration=5.969973, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:39:00+00:00, data_interval_end=2024-04-04 22:40:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:40:06.624241096Z [2024-04-04T22:40:06.623+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:40:00+00:00, run_after=2024-04-04T22:41:00+00:00 2024-04-04T22:40:06.632697882Z [2024-04-04T22:40:06.632+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:40:06.632929499Z [2024-04-04T22:40:06.632+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:39:00+00:00, run_id=scheduled__2024-04-04T22:39:00+00:00, run_start_date=2024-04-04 22:40:00.642187+00:00, run_end_date=2024-04-04 22:40:06.632634+00:00, run_duration=5.990447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:39:00+00:00, data_interval_end=2024-04-04 22:40:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:40:06.643797151Z [2024-04-04T22:40:06.643+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:40:00+00:00, run_after=2024-04-04T22:41:00+00:00 2024-04-04T22:40:06.691429018Z [2024-04-04T22:40:06.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:39:00+00:00 exited with status success for try_number 1 2024-04-04T22:40:06.691905557Z [2024-04-04T22:40:06.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:39:00+00:00 exited with status success for try_number 1 2024-04-04T22:40:06.700906289Z [2024-04-04T22:40:06.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:39:00+00:00, map_index=-1, run_start_date=2024-04-04 22:40:04.068287+00:00, run_end_date=2024-04-04 22:40:05.934442+00:00, run_duration=1.866155, state=success, executor_state=success, try_number=1, max_tries=1, job_id=57, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:40:00.761467+00:00, queued_by_job_id=1, pid=935 2024-04-04T22:40:06.701447630Z [2024-04-04T22:40:06.701+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:39:00+00:00, map_index=-1, run_start_date=2024-04-04 22:40:04.035512+00:00, run_end_date=2024-04-04 22:40:05.901955+00:00, run_duration=1.866443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=56, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:40:00.761467+00:00, queued_by_job_id=1, pid=934 2024-04-04T22:40:07.775965573Z [2024-04-04T22:40:07.775+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:40:07.776002985Z 2024-04-04T22:40:07.776198910Z [2024-04-04T22:40:07.775+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:40:07.777318889Z [2024-04-04T22:40:07.777+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:40:07.777356395Z 2024-04-04T22:40:07.780900536Z [2024-04-04T22:40:07.780+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-04T22:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T22:40:07.781200271Z [2024-04-04T22:40:07.780+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-04T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T22:40:07.850172149Z [2024-04-04T22:40:07.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T22:35:00+00:00 exited with status queued for try_number 1 2024-04-04T22:40:07.850863354Z [2024-04-04T22:40:07.849+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T22:35:00+00:00 exited with status success for try_number 1 2024-04-04T22:40:07.858844405Z [2024-04-04T22:40:07.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-04T22:35:00+00:00, map_index=-1, run_start_date=2024-04-04 22:40:07.155363+00:00, run_end_date=2024-04-04 22:40:07.478915+00:00, run_duration=0.323552, state=success, executor_state=success, try_number=1, max_tries=1, job_id=59, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:40:05.426358+00:00, queued_by_job_id=1, pid=959 2024-04-04T22:40:07.859192934Z [2024-04-04T22:40:07.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to ec09471d-b4c8-47d8-8ae7-41cdcfc06742 2024-04-04T22:40:09.788877300Z [2024-04-04T22:40:09.788+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:40:09.788926352Z 2024-04-04T22:40:09.789098564Z [2024-04-04T22:40:09.788+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:40:09.789859380Z [2024-04-04T22:40:09.789+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:40:09.789883258Z 2024-04-04T22:40:09.792486554Z [2024-04-04T22:40:09.792+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-04T22:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:40:09.792758240Z [2024-04-04T22:40:09.792+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-04T22:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:40:09.855928172Z [2024-04-04T22:40:09.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T22:35:00+00:00 exited with status queued for try_number 1 2024-04-04T22:40:09.862301324Z [2024-04-04T22:40:09.861+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c811c61-4fef-44f7-a3b6-71abbd14ed70 2024-04-04T22:40:09.966202698Z [2024-04-04T22:40:09.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T22:35:00+00:00 exited with status success for try_number 1 2024-04-04T22:40:09.974562474Z [2024-04-04T22:40:09.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-04T22:35:00+00:00, map_index=0, run_start_date=2024-04-04 22:40:09.403672+00:00, run_end_date=2024-04-04 22:40:09.725291+00:00, run_duration=0.321619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=60, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:40:07.778003+00:00, queued_by_job_id=1, pid=977 2024-04-04T22:40:12.117956425Z [2024-04-04T22:40:12.117+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:40:12.118638419Z [2024-04-04T22:40:12.118+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:35:00+00:00, run_id=scheduled__2024-04-04T22:35:00+00:00, run_start_date=2024-04-04 22:40:00.636552+00:00, run_end_date=2024-04-04 22:40:12.118177+00:00, run_duration=11.481625, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:35:00+00:00, data_interval_end=2024-04-04 22:40:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-04T22:40:12.137487721Z [2024-04-04T22:40:12.135+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:40:00+00:00, run_after=2024-04-04T22:45:00+00:00 2024-04-04T22:40:12.186065294Z [2024-04-04T22:40:12.185+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T22:35:00+00:00 exited with status success for try_number 1 2024-04-04T22:40:12.196159724Z [2024-04-04T22:40:12.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-04T22:35:00+00:00, map_index=-1, run_start_date=2024-04-04 22:40:11.536918+00:00, run_end_date=2024-04-04 22:40:11.932717+00:00, run_duration=0.395799, state=success, executor_state=success, try_number=1, max_tries=1, job_id=61, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:40:09.790329+00:00, queued_by_job_id=1, pid=988 2024-04-04T22:40:39.103752092Z [2024-04-04T22:40:39.101+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-04T22:41:00.486628126Z [2024-04-04T22:41:00.486+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:41:00.500920494Z [2024-04-04T22:41:00.500+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:41:00+00:00, run_after=2024-04-04T22:42:00+00:00 2024-04-04T22:41:00.514289829Z [2024-04-04T22:41:00.513+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:41:00+00:00, run_after=2024-04-04T22:42:00+00:00 2024-04-04T22:41:00.571632140Z [2024-04-04T22:41:00.571+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T22:41:00.571656365Z 2024-04-04T22:41:00.571659962Z 2024-04-04T22:41:00.571663113Z 2024-04-04T22:41:00.571860904Z [2024-04-04T22:41:00.571+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:41:00.572446408Z [2024-04-04T22:41:00.572+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:41:00.572559296Z [2024-04-04T22:41:00.572+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:41:00.573163715Z [2024-04-04T22:41:00.572+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:41:00.573174799Z 2024-04-04T22:41:00.573178250Z 2024-04-04T22:41:00.573181865Z 2024-04-04T22:41:00.576733863Z [2024-04-04T22:41:00.576+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:41:00.577090371Z [2024-04-04T22:41:00.576+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:41:00.577604719Z [2024-04-04T22:41:00.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:41:00.577759762Z [2024-04-04T22:41:00.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:41:00.578038524Z [2024-04-04T22:41:00.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:41:00.578266258Z [2024-04-04T22:41:00.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:41:01.032018953Z [2024-04-04T22:41:01.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status queued for try_number 1 2024-04-04T22:41:01.032113701Z [2024-04-04T22:41:01.031+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status queued for try_number 1 2024-04-04T22:41:01.032240002Z [2024-04-04T22:41:01.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status queued for try_number 1 2024-04-04T22:41:01.049007774Z [2024-04-04T22:41:01.048+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0eaf4b40-0955-4256-9f3b-cb7322ce3c74 2024-04-04T22:41:01.050405360Z [2024-04-04T22:41:01.050+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ee82e7f-6873-40fb-a093-6c9ece282135 2024-04-04T22:41:01.050665009Z [2024-04-04T22:41:01.050+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60c5b601-d308-4977-b7cd-0f9cdaf4e6a6 2024-04-04T22:41:03.591190838Z [2024-04-04T22:41:03.590+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:41:03.593988742Z [2024-04-04T22:41:03.593+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:40:00+00:00, run_id=scheduled__2024-04-04T22:40:00+00:00, run_start_date=2024-04-04 22:41:00.525801+00:00, run_end_date=2024-04-04 22:41:03.591106+00:00, run_duration=3.065305, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:40:00+00:00, data_interval_end=2024-04-04 22:41:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:41:03.623177311Z [2024-04-04T22:41:03.622+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:41:00+00:00, run_after=2024-04-04T22:42:00+00:00 2024-04-04T22:41:03.746008954Z [2024-04-04T22:41:03.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status success for try_number 1 2024-04-04T22:41:03.754583649Z [2024-04-04T22:41:03.754+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:40:00+00:00, map_index=-1, run_start_date=2024-04-04 22:41:02.324123+00:00, run_end_date=2024-04-04 22:41:02.862213+00:00, run_duration=0.53809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=62, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:41:00.574289+00:00, queued_by_job_id=1, pid=997 2024-04-04T22:41:05.787867693Z [2024-04-04T22:41:05.787+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:41:05.788293638Z [2024-04-04T22:41:05.788+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:40:00+00:00, run_id=scheduled__2024-04-04T22:40:00+00:00, run_start_date=2024-04-04 22:41:00.526933+00:00, run_end_date=2024-04-04 22:41:05.787817+00:00, run_duration=5.260884, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:40:00+00:00, data_interval_end=2024-04-04 22:41:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:41:05.811744428Z [2024-04-04T22:41:05.811+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:41:00+00:00, run_after=2024-04-04T22:42:00+00:00 2024-04-04T22:41:05.819488290Z [2024-04-04T22:41:05.819+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:41:05.820055711Z [2024-04-04T22:41:05.819+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:40:00+00:00, run_id=scheduled__2024-04-04T22:40:00+00:00, run_start_date=2024-04-04 22:41:00.524356+00:00, run_end_date=2024-04-04 22:41:05.819711+00:00, run_duration=5.295355, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:40:00+00:00, data_interval_end=2024-04-04 22:41:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:41:05.829872564Z [2024-04-04T22:41:05.829+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:41:00+00:00, run_after=2024-04-04T22:42:00+00:00 2024-04-04T22:41:05.857390851Z [2024-04-04T22:41:05.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status success for try_number 1 2024-04-04T22:41:05.857766308Z [2024-04-04T22:41:05.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status success for try_number 1 2024-04-04T22:41:05.864653660Z [2024-04-04T22:41:05.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:40:00+00:00, map_index=-1, run_start_date=2024-04-04 22:41:03.624953+00:00, run_end_date=2024-04-04 22:41:05.258935+00:00, run_duration=1.633982, state=success, executor_state=success, try_number=1, max_tries=1, job_id=64, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:41:00.574289+00:00, queued_by_job_id=1, pid=1016 2024-04-04T22:41:05.864973271Z [2024-04-04T22:41:05.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:40:00+00:00, map_index=-1, run_start_date=2024-04-04 22:41:03.607124+00:00, run_end_date=2024-04-04 22:41:05.640702+00:00, run_duration=2.033578, state=success, executor_state=success, try_number=1, max_tries=1, job_id=63, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:41:00.574289+00:00, queued_by_job_id=1, pid=1015 2024-04-04T22:42:00.125786380Z [2024-04-04T22:42:00.121+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:42:00+00:00, run_after=2024-04-04T22:43:00+00:00 2024-04-04T22:42:00.148255448Z [2024-04-04T22:42:00.147+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:42:00.168534842Z [2024-04-04T22:42:00.168+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:42:00.208158445Z [2024-04-04T22:42:00.207+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:42:00+00:00, run_after=2024-04-04T22:43:00+00:00 2024-04-04T22:42:00.440471581Z [2024-04-04T22:42:00.440+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T22:42:00.440503416Z 2024-04-04T22:42:00.440509140Z 2024-04-04T22:42:00.440512641Z 2024-04-04T22:42:00.440516060Z 2024-04-04T22:42:00.440792754Z [2024-04-04T22:42:00.440+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T22:42:00.442199353Z [2024-04-04T22:42:00.442+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:42:00.442387131Z [2024-04-04T22:42:00.442+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:42:00.443819519Z [2024-04-04T22:42:00.443+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:42:00.446451424Z [2024-04-04T22:42:00.446+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:42:00.446461238Z 2024-04-04T22:42:00.446465520Z 2024-04-04T22:42:00.446469103Z 2024-04-04T22:42:00.446472805Z 2024-04-04T22:42:00.460879376Z [2024-04-04T22:42:00.460+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:42:00.461042328Z [2024-04-04T22:42:00.460+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T22:42:00.461352550Z [2024-04-04T22:42:00.461+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:42:00.461520358Z [2024-04-04T22:42:00.461+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:42:00.462137614Z [2024-04-04T22:42:00.461+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:42:00.462424408Z [2024-04-04T22:42:00.461+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:42:00.462738656Z [2024-04-04T22:42:00.462+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:42:00.462929390Z [2024-04-04T22:42:00.462+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:42:01.380721838Z [2024-04-04T22:42:01.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status queued for try_number 1 2024-04-04T22:42:01.383019692Z [2024-04-04T22:42:01.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:41:00+00:00 exited with status queued for try_number 1 2024-04-04T22:42:01.384060784Z [2024-04-04T22:42:01.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:41:00+00:00 exited with status queued for try_number 1 2024-04-04T22:42:01.391782211Z [2024-04-04T22:42:01.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:41:00+00:00 exited with status queued for try_number 1 2024-04-04T22:42:01.448114923Z [2024-04-04T22:42:01.427+0000] {scheduler_job.py:635} INFO - Setting external_id for to c08ef618-0ebd-4482-bfb1-a6e38cbe3dc6 2024-04-04T22:42:01.455759589Z [2024-04-04T22:42:01.448+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb396a45-fe7d-412e-b3c7-ca201f7046e0 2024-04-04T22:42:01.455792162Z [2024-04-04T22:42:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2590b401-93cd-44ec-b878-fe283bca8547 2024-04-04T22:42:01.455798555Z [2024-04-04T22:42:01.451+0000] {scheduler_job.py:635} INFO - Setting external_id for to a27659ff-82c6-4450-ab2c-4891cf1fa7cb 2024-04-04T22:42:06.151340618Z [2024-04-04T22:42:06.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:42:06.151677452Z [2024-04-04T22:42:06.151+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 22:40:00+00:00, run_id=scheduled__2024-04-04T22:40:00+00:00, run_start_date=2024-04-04 22:42:00.239924+00:00, run_end_date=2024-04-04 22:42:06.151290+00:00, run_duration=5.911366, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:40:00+00:00, data_interval_end=2024-04-04 22:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T22:42:06.171524119Z [2024-04-04T22:42:06.171+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T22:42:00+00:00, run_after=2024-04-04T22:44:00+00:00 2024-04-04T22:42:06.313699384Z [2024-04-04T22:42:06.313+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status success for try_number 1 2024-04-04T22:42:06.321725833Z [2024-04-04T22:42:06.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T22:40:00+00:00, map_index=-1, run_start_date=2024-04-04 22:42:04.959827+00:00, run_end_date=2024-04-04 22:42:05.733700+00:00, run_duration=0.773873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=65, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:42:00.447395+00:00, queued_by_job_id=1, pid=1049 2024-04-04T22:42:07.403425934Z [2024-04-04T22:42:07.403+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:42:07.404064771Z [2024-04-04T22:42:07.403+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:41:00+00:00, run_id=scheduled__2024-04-04T22:41:00+00:00, run_start_date=2024-04-04 22:42:00.242856+00:00, run_end_date=2024-04-04 22:42:07.403348+00:00, run_duration=7.160492, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:41:00+00:00, data_interval_end=2024-04-04 22:42:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:42:07.413926567Z [2024-04-04T22:42:07.413+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:42:00+00:00, run_after=2024-04-04T22:43:00+00:00 2024-04-04T22:42:07.499741586Z [2024-04-04T22:42:07.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:41:00+00:00 exited with status success for try_number 1 2024-04-04T22:42:07.506151660Z [2024-04-04T22:42:07.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:41:00+00:00, map_index=-1, run_start_date=2024-04-04 22:42:05.552331+00:00, run_end_date=2024-04-04 22:42:06.310114+00:00, run_duration=0.757783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=66, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:42:00.447395+00:00, queued_by_job_id=1, pid=1056 2024-04-04T22:42:09.676699095Z [2024-04-04T22:42:09.676+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:42:09.677622737Z [2024-04-04T22:42:09.677+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:41:00+00:00, run_id=scheduled__2024-04-04T22:41:00+00:00, run_start_date=2024-04-04 22:42:00.246319+00:00, run_end_date=2024-04-04 22:42:09.677260+00:00, run_duration=9.430941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:41:00+00:00, data_interval_end=2024-04-04 22:42:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:42:09.697023241Z [2024-04-04T22:42:09.696+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:42:00+00:00, run_after=2024-04-04T22:43:00+00:00 2024-04-04T22:42:09.714649170Z [2024-04-04T22:42:09.714+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:42:09.714859349Z [2024-04-04T22:42:09.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:41:00+00:00, run_id=scheduled__2024-04-04T22:41:00+00:00, run_start_date=2024-04-04 22:42:00.247957+00:00, run_end_date=2024-04-04 22:42:09.714556+00:00, run_duration=9.466599, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:41:00+00:00, data_interval_end=2024-04-04 22:42:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:42:09.743714460Z [2024-04-04T22:42:09.743+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:42:00+00:00, run_after=2024-04-04T22:43:00+00:00 2024-04-04T22:42:09.836471423Z [2024-04-04T22:42:09.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:41:00+00:00 exited with status success for try_number 1 2024-04-04T22:42:09.837311155Z [2024-04-04T22:42:09.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:41:00+00:00 exited with status success for try_number 1 2024-04-04T22:42:09.845479607Z [2024-04-04T22:42:09.845+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:41:00+00:00, map_index=-1, run_start_date=2024-04-04 22:42:07.717644+00:00, run_end_date=2024-04-04 22:42:09.100447+00:00, run_duration=1.382803, state=success, executor_state=success, try_number=1, max_tries=1, job_id=68, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:42:00.447395+00:00, queued_by_job_id=1, pid=1079 2024-04-04T22:42:09.846955011Z [2024-04-04T22:42:09.845+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:41:00+00:00, map_index=-1, run_start_date=2024-04-04 22:42:07.019151+00:00, run_end_date=2024-04-04 22:42:08.866714+00:00, run_duration=1.847563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=67, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:42:00.447395+00:00, queued_by_job_id=1, pid=1068 2024-04-04T22:43:00.269768488Z [2024-04-04T22:43:00.269+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:43:00.289255037Z [2024-04-04T22:43:00.288+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:43:00+00:00, run_after=2024-04-04T22:44:00+00:00 2024-04-04T22:43:00.304136645Z [2024-04-04T22:43:00.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:43:00+00:00, run_after=2024-04-04T22:44:00+00:00 2024-04-04T22:43:00.384822280Z [2024-04-04T22:43:00.384+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T22:43:00.384846640Z 2024-04-04T22:43:00.384851106Z 2024-04-04T22:43:00.384854923Z 2024-04-04T22:43:00.385108521Z [2024-04-04T22:43:00.384+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:43:00.385206968Z [2024-04-04T22:43:00.385+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:43:00.385269777Z [2024-04-04T22:43:00.385+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:43:00.385934005Z [2024-04-04T22:43:00.385+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:43:00.385948947Z 2024-04-04T22:43:00.385954222Z 2024-04-04T22:43:00.385959179Z 2024-04-04T22:43:00.389256878Z [2024-04-04T22:43:00.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:43:00.389310741Z [2024-04-04T22:43:00.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:43:00.389508880Z [2024-04-04T22:43:00.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:43:00.389673463Z [2024-04-04T22:43:00.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:43:00.389932793Z [2024-04-04T22:43:00.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:43:00.390111739Z [2024-04-04T22:43:00.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:43:00.778970479Z [2024-04-04T22:43:00.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:42:00+00:00 exited with status queued for try_number 1 2024-04-04T22:43:00.780529547Z [2024-04-04T22:43:00.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:42:00+00:00 exited with status queued for try_number 1 2024-04-04T22:43:00.780686202Z [2024-04-04T22:43:00.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:42:00+00:00 exited with status queued for try_number 1 2024-04-04T22:43:00.795306096Z [2024-04-04T22:43:00.794+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62f36e17-d4e0-45f5-8516-1a22a2e9cd94 2024-04-04T22:43:00.795341461Z [2024-04-04T22:43:00.795+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad5ff535-9721-4376-852d-d70d3c24fb83 2024-04-04T22:43:00.795466509Z [2024-04-04T22:43:00.795+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ba82ab0-7aad-4286-b3d2-2010f49ae5be 2024-04-04T22:43:03.098151838Z [2024-04-04T22:43:03.097+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:43:03.098538024Z [2024-04-04T22:43:03.098+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:42:00+00:00, run_id=scheduled__2024-04-04T22:42:00+00:00, run_start_date=2024-04-04 22:43:00.315991+00:00, run_end_date=2024-04-04 22:43:03.098140+00:00, run_duration=2.782149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:42:00+00:00, data_interval_end=2024-04-04 22:43:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:43:03.119988172Z [2024-04-04T22:43:03.119+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:43:00+00:00, run_after=2024-04-04T22:44:00+00:00 2024-04-04T22:43:03.189073978Z [2024-04-04T22:43:03.188+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:42:00+00:00 exited with status success for try_number 1 2024-04-04T22:43:03.196464390Z [2024-04-04T22:43:03.196+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:42:00+00:00, map_index=-1, run_start_date=2024-04-04 22:43:02.186591+00:00, run_end_date=2024-04-04 22:43:02.719693+00:00, run_duration=0.533102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=69, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:43:00.386902+00:00, queued_by_job_id=1, pid=1105 2024-04-04T22:43:06.474909861Z [2024-04-04T22:43:06.474+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:43:06.474977363Z [2024-04-04T22:43:06.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:42:00+00:00, run_id=scheduled__2024-04-04T22:42:00+00:00, run_start_date=2024-04-04 22:43:00.314643+00:00, run_end_date=2024-04-04 22:43:06.474709+00:00, run_duration=6.160066, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:42:00+00:00, data_interval_end=2024-04-04 22:43:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:43:06.484234637Z [2024-04-04T22:43:06.483+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:43:00+00:00, run_after=2024-04-04T22:44:00+00:00 2024-04-04T22:43:06.493587688Z [2024-04-04T22:43:06.491+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:43:06.493619657Z [2024-04-04T22:43:06.491+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:42:00+00:00, run_id=scheduled__2024-04-04T22:42:00+00:00, run_start_date=2024-04-04 22:43:00.319873+00:00, run_end_date=2024-04-04 22:43:06.491257+00:00, run_duration=6.171384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:42:00+00:00, data_interval_end=2024-04-04 22:43:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:43:06.503456032Z [2024-04-04T22:43:06.503+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:43:00+00:00, run_after=2024-04-04T22:44:00+00:00 2024-04-04T22:43:06.544640248Z [2024-04-04T22:43:06.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:42:00+00:00 exited with status success for try_number 1 2024-04-04T22:43:06.544828346Z [2024-04-04T22:43:06.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:42:00+00:00 exited with status success for try_number 1 2024-04-04T22:43:06.551795813Z [2024-04-04T22:43:06.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:42:00+00:00, map_index=-1, run_start_date=2024-04-04 22:43:03.746976+00:00, run_end_date=2024-04-04 22:43:05.645184+00:00, run_duration=1.898208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=70, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:43:00.386902+00:00, queued_by_job_id=1, pid=1123 2024-04-04T22:43:06.551910176Z [2024-04-04T22:43:06.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:42:00+00:00, map_index=-1, run_start_date=2024-04-04 22:43:03.980713+00:00, run_end_date=2024-04-04 22:43:06.359193+00:00, run_duration=2.37848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=71, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:43:00.386902+00:00, queued_by_job_id=1, pid=1124 2024-04-04T22:44:00.032168266Z [2024-04-04T22:44:00.031+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:44:00+00:00, run_after=2024-04-04T22:45:00+00:00 2024-04-04T22:44:00.038736181Z [2024-04-04T22:44:00.038+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:44:00.053324532Z [2024-04-04T22:44:00.052+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:44:00+00:00, run_after=2024-04-04T22:45:00+00:00 2024-04-04T22:44:00.062417416Z [2024-04-04T22:44:00.062+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:44:00.135958278Z [2024-04-04T22:44:00.135+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T22:44:00.135997886Z 2024-04-04T22:44:00.136033338Z 2024-04-04T22:44:00.136042918Z 2024-04-04T22:44:00.136051559Z 2024-04-04T22:44:00.136834687Z [2024-04-04T22:44:00.136+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T22:44:00.137519578Z [2024-04-04T22:44:00.137+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:44:00.138201271Z [2024-04-04T22:44:00.137+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:44:00.138733596Z [2024-04-04T22:44:00.138+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:44:00.140230008Z [2024-04-04T22:44:00.139+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:44:00.140262236Z 2024-04-04T22:44:00.140287530Z 2024-04-04T22:44:00.140293293Z 2024-04-04T22:44:00.140298672Z 2024-04-04T22:44:00.145107568Z [2024-04-04T22:44:00.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T22:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:44:00.145507841Z [2024-04-04T22:44:00.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T22:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T22:44:00.146062683Z [2024-04-04T22:44:00.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:44:00.146417062Z [2024-04-04T22:44:00.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:44:00.146912116Z [2024-04-04T22:44:00.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:44:00.147247136Z [2024-04-04T22:44:00.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:44:00.147784317Z [2024-04-04T22:44:00.147+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:44:00.148190949Z [2024-04-04T22:44:00.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:44:00.506201211Z [2024-04-04T22:44:00.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:42:00+00:00 exited with status queued for try_number 1 2024-04-04T22:44:00.508468192Z [2024-04-04T22:44:00.506+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:43:00+00:00 exited with status queued for try_number 1 2024-04-04T22:44:00.508701596Z [2024-04-04T22:44:00.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:43:00+00:00 exited with status queued for try_number 1 2024-04-04T22:44:00.508902403Z [2024-04-04T22:44:00.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:43:00+00:00 exited with status queued for try_number 1 2024-04-04T22:44:00.521222301Z [2024-04-04T22:44:00.520+0000] {scheduler_job.py:635} INFO - Setting external_id for to 197e6efc-ed0b-4532-a10b-4f4180dd5be2 2024-04-04T22:44:00.521562546Z [2024-04-04T22:44:00.521+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1cbc76d6-3fe0-4720-a354-05769f813e77 2024-04-04T22:44:00.521836392Z [2024-04-04T22:44:00.521+0000] {scheduler_job.py:635} INFO - Setting external_id for to 36084e5f-9937-4294-b546-e162d8c68b4a 2024-04-04T22:44:00.522065074Z [2024-04-04T22:44:00.521+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a82f160-a050-4a71-bf27-069e678ed2a9 2024-04-04T22:44:03.221268519Z [2024-04-04T22:44:03.220+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:44:03.221452412Z [2024-04-04T22:44:03.221+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:43:00+00:00, run_id=scheduled__2024-04-04T22:43:00+00:00, run_start_date=2024-04-04 22:44:00.076329+00:00, run_end_date=2024-04-04 22:44:03.221137+00:00, run_duration=3.144808, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:43:00+00:00, data_interval_end=2024-04-04 22:44:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:44:03.233362307Z [2024-04-04T22:44:03.233+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:44:00+00:00, run_after=2024-04-04T22:45:00+00:00 2024-04-04T22:44:04.054929788Z [2024-04-04T22:44:04.054+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:44:04.055048821Z [2024-04-04T22:44:04.054+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 22:42:00+00:00, run_id=scheduled__2024-04-04T22:42:00+00:00, run_start_date=2024-04-04 22:44:00.072753+00:00, run_end_date=2024-04-04 22:44:04.054762+00:00, run_duration=3.982009, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:42:00+00:00, data_interval_end=2024-04-04 22:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T22:44:04.065315749Z [2024-04-04T22:44:04.064+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T22:44:00+00:00, run_after=2024-04-04T22:46:00+00:00 2024-04-04T22:44:04.167876968Z [2024-04-04T22:44:04.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:42:00+00:00 exited with status success for try_number 1 2024-04-04T22:44:04.168141995Z [2024-04-04T22:44:04.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:43:00+00:00 exited with status success for try_number 1 2024-04-04T22:44:04.179704282Z [2024-04-04T22:44:04.179+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T22:42:00+00:00, map_index=-1, run_start_date=2024-04-04 22:44:02.135971+00:00, run_end_date=2024-04-04 22:44:03.164849+00:00, run_duration=1.028878, state=success, executor_state=success, try_number=1, max_tries=1, job_id=72, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:44:00.141694+00:00, queued_by_job_id=1, pid=1158 2024-04-04T22:44:04.180104595Z [2024-04-04T22:44:04.179+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:43:00+00:00, map_index=-1, run_start_date=2024-04-04 22:44:02.644701+00:00, run_end_date=2024-04-04 22:44:03.109815+00:00, run_duration=0.465114, state=success, executor_state=success, try_number=1, max_tries=1, job_id=73, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:44:00.141694+00:00, queued_by_job_id=1, pid=1160 2024-04-04T22:44:06.350805684Z [2024-04-04T22:44:06.350+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:44:06.350910771Z [2024-04-04T22:44:06.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:43:00+00:00, run_id=scheduled__2024-04-04T22:43:00+00:00, run_start_date=2024-04-04 22:44:00.074031+00:00, run_end_date=2024-04-04 22:44:06.350537+00:00, run_duration=6.276506, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:43:00+00:00, data_interval_end=2024-04-04 22:44:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:44:06.359807122Z [2024-04-04T22:44:06.358+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:44:00+00:00, run_after=2024-04-04T22:45:00+00:00 2024-04-04T22:44:06.365078075Z [2024-04-04T22:44:06.364+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:44:06.365471263Z [2024-04-04T22:44:06.365+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:43:00+00:00, run_id=scheduled__2024-04-04T22:43:00+00:00, run_start_date=2024-04-04 22:44:00.075235+00:00, run_end_date=2024-04-04 22:44:06.364926+00:00, run_duration=6.289691, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:43:00+00:00, data_interval_end=2024-04-04 22:44:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:44:06.376648569Z [2024-04-04T22:44:06.376+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:44:00+00:00, run_after=2024-04-04T22:45:00+00:00 2024-04-04T22:44:06.409726769Z [2024-04-04T22:44:06.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:43:00+00:00 exited with status success for try_number 1 2024-04-04T22:44:06.409753647Z [2024-04-04T22:44:06.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:43:00+00:00 exited with status success for try_number 1 2024-04-04T22:44:06.416159574Z [2024-04-04T22:44:06.415+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:43:00+00:00, map_index=-1, run_start_date=2024-04-04 22:44:03.771084+00:00, run_end_date=2024-04-04 22:44:05.279528+00:00, run_duration=1.508444, state=success, executor_state=success, try_number=1, max_tries=1, job_id=74, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:44:00.141694+00:00, queued_by_job_id=1, pid=1182 2024-04-04T22:44:06.416396567Z [2024-04-04T22:44:06.416+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:43:00+00:00, map_index=-1, run_start_date=2024-04-04 22:44:03.787766+00:00, run_end_date=2024-04-04 22:44:05.930936+00:00, run_duration=2.14317, state=success, executor_state=success, try_number=1, max_tries=1, job_id=75, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:44:00.141694+00:00, queued_by_job_id=1, pid=1183 2024-04-04T22:45:01.092484860Z [2024-04-04T22:45:01.091+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:45:00+00:00, run_after=2024-04-04T22:50:00+00:00 2024-04-04T22:45:01.114919846Z [2024-04-04T22:45:01.114+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:45:00+00:00, run_after=2024-04-04T22:46:00+00:00 2024-04-04T22:45:01.132761417Z [2024-04-04T22:45:01.132+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:45:01.150640196Z [2024-04-04T22:45:01.150+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:45:00+00:00, run_after=2024-04-04T22:46:00+00:00 2024-04-04T22:45:01.281821334Z [2024-04-04T22:45:01.281+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T22:45:01.281855399Z 2024-04-04T22:45:01.281865501Z 2024-04-04T22:45:01.281870641Z 2024-04-04T22:45:01.281875431Z 2024-04-04T22:45:01.281895959Z [2024-04-04T22:45:01.281+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:45:01.282025662Z [2024-04-04T22:45:01.281+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:45:01.282120024Z [2024-04-04T22:45:01.282+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:45:01.282192820Z [2024-04-04T22:45:01.282+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:45:01.283738254Z [2024-04-04T22:45:01.283+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:45:01.283762861Z 2024-04-04T22:45:01.283769004Z 2024-04-04T22:45:01.283774019Z 2024-04-04T22:45:01.283778982Z 2024-04-04T22:45:01.289628945Z [2024-04-04T22:45:01.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T22:45:01.289747834Z [2024-04-04T22:45:01.289+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:45:01.290051649Z [2024-04-04T22:45:01.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:45:01.290162010Z [2024-04-04T22:45:01.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:45:01.290435674Z [2024-04-04T22:45:01.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:45:01.290560408Z [2024-04-04T22:45:01.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:45:01.290746422Z [2024-04-04T22:45:01.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:45:01.290812959Z [2024-04-04T22:45:01.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:45:01.783648892Z [2024-04-04T22:45:01.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status queued for try_number 1 2024-04-04T22:45:01.783677636Z [2024-04-04T22:45:01.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:44:00+00:00 exited with status queued for try_number 1 2024-04-04T22:45:01.783696005Z [2024-04-04T22:45:01.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:44:00+00:00 exited with status queued for try_number 1 2024-04-04T22:45:01.783699453Z [2024-04-04T22:45:01.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:44:00+00:00 exited with status queued for try_number 1 2024-04-04T22:45:01.815663803Z [2024-04-04T22:45:01.807+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f13cdbc-46b2-4fb6-a834-ff8a6c5c03e3 2024-04-04T22:45:01.815688590Z [2024-04-04T22:45:01.808+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c597c7b-7c7e-4c45-be97-9a4603a5bb70 2024-04-04T22:45:01.815692594Z [2024-04-04T22:45:01.808+0000] {scheduler_job.py:635} INFO - Setting external_id for to c35954ce-18b5-4e5a-975e-65e69c9a30d1 2024-04-04T22:45:01.815696335Z [2024-04-04T22:45:01.808+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd41f92c-09c6-40be-8355-51800363342e 2024-04-04T22:45:04.437999032Z [2024-04-04T22:45:04.437+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:45:04.438437980Z [2024-04-04T22:45:04.438+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:44:00+00:00, run_id=scheduled__2024-04-04T22:44:00+00:00, run_start_date=2024-04-04 22:45:01.187826+00:00, run_end_date=2024-04-04 22:45:04.437882+00:00, run_duration=3.250056, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:44:00+00:00, data_interval_end=2024-04-04 22:45:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:45:04.459499678Z [2024-04-04T22:45:04.459+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:45:00+00:00, run_after=2024-04-04T22:46:00+00:00 2024-04-04T22:45:04.567797124Z [2024-04-04T22:45:04.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:44:00+00:00 exited with status success for try_number 1 2024-04-04T22:45:04.573609047Z [2024-04-04T22:45:04.573+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:44:00+00:00, map_index=-1, run_start_date=2024-04-04 22:45:02.759187+00:00, run_end_date=2024-04-04 22:45:03.308316+00:00, run_duration=0.549129, state=success, executor_state=success, try_number=1, max_tries=1, job_id=76, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:45:01.284943+00:00, queued_by_job_id=1, pid=1216 2024-04-04T22:45:05.142109485Z [2024-04-04T22:45:05.141+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:45:05.142137614Z 2024-04-04T22:45:05.142280092Z [2024-04-04T22:45:05.142+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:45:05.142904211Z [2024-04-04T22:45:05.142+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:45:05.142910099Z 2024-04-04T22:45:05.145452581Z [2024-04-04T22:45:05.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-04T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T22:45:05.145808988Z [2024-04-04T22:45:05.145+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-04T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:45:05.198011089Z [2024-04-04T22:45:05.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status queued for try_number 1 2024-04-04T22:45:05.198292605Z [2024-04-04T22:45:05.197+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status success for try_number 1 2024-04-04T22:45:05.206514381Z [2024-04-04T22:45:05.205+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T22:40:00+00:00, map_index=-1, run_start_date=2024-04-04 22:45:04.351792+00:00, run_end_date=2024-04-04 22:45:04.916304+00:00, run_duration=0.564512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=78, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:45:01.284943+00:00, queued_by_job_id=1, pid=1241 2024-04-04T22:45:05.207096985Z [2024-04-04T22:45:05.206+0000] {scheduler_job.py:635} INFO - Setting external_id for to db056c49-2ea9-4e6a-8b79-1f6dd4b44e40 2024-04-04T22:45:06.373172994Z [2024-04-04T22:45:06.372+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:45:06.373338309Z [2024-04-04T22:45:06.373+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:44:00+00:00, run_id=scheduled__2024-04-04T22:44:00+00:00, run_start_date=2024-04-04 22:45:01.190231+00:00, run_end_date=2024-04-04 22:45:06.373076+00:00, run_duration=5.182845, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:44:00+00:00, data_interval_end=2024-04-04 22:45:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:45:06.384296080Z [2024-04-04T22:45:06.383+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:45:00+00:00, run_after=2024-04-04T22:46:00+00:00 2024-04-04T22:45:06.451823424Z [2024-04-04T22:45:06.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:44:00+00:00 exited with status success for try_number 1 2024-04-04T22:45:06.460344207Z [2024-04-04T22:45:06.459+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:44:00+00:00, map_index=-1, run_start_date=2024-04-04 22:45:03.998856+00:00, run_end_date=2024-04-04 22:45:06.143905+00:00, run_duration=2.145049, state=success, executor_state=success, try_number=1, max_tries=1, job_id=77, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:45:01.284943+00:00, queued_by_job_id=1, pid=1233 2024-04-04T22:45:07.470733547Z [2024-04-04T22:45:07.470+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:45:07.472149407Z [2024-04-04T22:45:07.471+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:44:00+00:00, run_id=scheduled__2024-04-04T22:44:00+00:00, run_start_date=2024-04-04 22:45:01.189091+00:00, run_end_date=2024-04-04 22:45:07.471641+00:00, run_duration=6.28255, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:44:00+00:00, data_interval_end=2024-04-04 22:45:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:45:07.484289001Z [2024-04-04T22:45:07.483+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:45:00+00:00, run_after=2024-04-04T22:46:00+00:00 2024-04-04T22:45:07.577161197Z [2024-04-04T22:45:07.576+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:45:07.577191051Z 2024-04-04T22:45:07.577783814Z [2024-04-04T22:45:07.577+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:45:07.578589838Z [2024-04-04T22:45:07.578+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:45:07.578608099Z 2024-04-04T22:45:07.583893123Z [2024-04-04T22:45:07.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-04T22:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T22:45:07.584040567Z [2024-04-04T22:45:07.583+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-04T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T22:45:07.641823769Z [2024-04-04T22:45:07.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status queued for try_number 1 2024-04-04T22:45:07.641853114Z [2024-04-04T22:45:07.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:44:00+00:00 exited with status success for try_number 1 2024-04-04T22:45:07.653164288Z [2024-04-04T22:45:07.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:44:00+00:00, map_index=-1, run_start_date=2024-04-04 22:45:04.376389+00:00, run_end_date=2024-04-04 22:45:07.134743+00:00, run_duration=2.758354, state=success, executor_state=success, try_number=1, max_tries=1, job_id=79, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:45:01.284943+00:00, queued_by_job_id=1, pid=1242 2024-04-04T22:45:07.653189799Z [2024-04-04T22:45:07.651+0000] {scheduler_job.py:635} INFO - Setting external_id for to 886ad9a7-4ba1-44e2-b1b3-8696b2feb547 2024-04-04T22:45:07.761742003Z [2024-04-04T22:45:07.761+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status success for try_number 1 2024-04-04T22:45:07.769759596Z [2024-04-04T22:45:07.769+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-04T22:40:00+00:00, map_index=-1, run_start_date=2024-04-04 22:45:07.037223+00:00, run_end_date=2024-04-04 22:45:07.436583+00:00, run_duration=0.39936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=80, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:45:05.143308+00:00, queued_by_job_id=1, pid=1265 2024-04-04T22:45:09.978997562Z [2024-04-04T22:45:09.978+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:45:09.979041816Z 2024-04-04T22:45:09.979404865Z [2024-04-04T22:45:09.979+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:45:09.980898024Z [2024-04-04T22:45:09.980+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:45:09.980945704Z 2024-04-04T22:45:09.986410978Z [2024-04-04T22:45:09.986+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-04T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:45:09.986790169Z [2024-04-04T22:45:09.986+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-04T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:45:10.042131229Z [2024-04-04T22:45:10.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status queued for try_number 1 2024-04-04T22:45:10.044797721Z [2024-04-04T22:45:10.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status success for try_number 1 2024-04-04T22:45:10.051320050Z [2024-04-04T22:45:10.050+0000] {scheduler_job.py:635} INFO - Setting external_id for to e552bca1-9ba4-419d-928e-69d0f7b1b50e 2024-04-04T22:45:10.051786032Z [2024-04-04T22:45:10.051+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-04T22:40:00+00:00, map_index=0, run_start_date=2024-04-04 22:45:09.414051+00:00, run_end_date=2024-04-04 22:45:09.784699+00:00, run_duration=0.370648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=81, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:45:07.579031+00:00, queued_by_job_id=1, pid=1283 2024-04-04T22:45:12.473544243Z [2024-04-04T22:45:12.473+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:45:12.474033321Z [2024-04-04T22:45:12.473+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:40:00+00:00, run_id=scheduled__2024-04-04T22:40:00+00:00, run_start_date=2024-04-04 22:45:01.186133+00:00, run_end_date=2024-04-04 22:45:12.473695+00:00, run_duration=11.287562, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:40:00+00:00, data_interval_end=2024-04-04 22:45:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-04T22:45:12.481050057Z [2024-04-04T22:45:12.479+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:45:00+00:00, run_after=2024-04-04T22:50:00+00:00 2024-04-04T22:45:12.515146705Z [2024-04-04T22:45:12.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status success for try_number 1 2024-04-04T22:45:12.521017519Z [2024-04-04T22:45:12.520+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-04T22:40:00+00:00, map_index=-1, run_start_date=2024-04-04 22:45:11.996657+00:00, run_end_date=2024-04-04 22:45:12.392347+00:00, run_duration=0.39569, state=success, executor_state=success, try_number=1, max_tries=1, job_id=82, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:45:09.983180+00:00, queued_by_job_id=1, pid=1294 2024-04-04T22:45:17.694142032Z [2024-04-04T22:45:17.693+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:45:17.732051395Z [2024-04-04T22:45:17.731+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:45:17.732081096Z 2024-04-04T22:45:17.732441173Z [2024-04-04T22:45:17.732+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186 has 0/16 running and queued tasks 2024-04-04T22:45:17.733556547Z [2024-04-04T22:45:17.733+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:45:17.733613832Z 2024-04-04T22:45:17.737063182Z [2024-04-04T22:45:17.736+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:45:17.737432539Z [2024-04-04T22:45:17.737+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:45:17.788419266Z [2024-04-04T22:45:17.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:44:00+00:00 exited with status queued for try_number 1 2024-04-04T22:45:17.803327336Z [2024-04-04T22:45:17.799+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7f5febf-9bce-4b76-b525-764cb968c91f 2024-04-04T22:45:18.918721123Z [2024-04-04T22:45:18.918+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186 to 2024-04-04T22:45:00+00:00, run_after=2024-04-04T22:46:00+00:00 2024-04-04T22:45:18.973803659Z [2024-04-04T22:45:18.973+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:45:18.973826299Z 2024-04-04T22:45:18.974114407Z [2024-04-04T22:45:18.973+0000] {scheduler_job.py:425} INFO - DAG vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186 has 0/16 running and queued tasks 2024-04-04T22:45:18.975379948Z [2024-04-04T22:45:18.975+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:45:18.975395042Z 2024-04-04T22:45:18.982700258Z [2024-04-04T22:45:18.982+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:45:18.983181829Z [2024-04-04T22:45:18.982+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:45:19.033910636Z [2024-04-04T22:45:19.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:44:00+00:00 exited with status queued for try_number 1 2024-04-04T22:45:19.039114954Z [2024-04-04T22:45:19.038+0000] {scheduler_job.py:635} INFO - Setting external_id for to cce53f80-70a7-4a6b-8134-080a299ad0a3 2024-04-04T22:45:20.455200518Z [2024-04-04T22:45:20.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186 to 2024-04-04T22:45:00+00:00, run_after=2024-04-04T22:50:00+00:00 2024-04-04T22:45:20.539982664Z [2024-04-04T22:45:20.539+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:45:20.540001267Z 2024-04-04T22:45:20.540214896Z [2024-04-04T22:45:20.539+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186 has 0/16 running and queued tasks 2024-04-04T22:45:20.540923273Z [2024-04-04T22:45:20.540+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:45:20.540932824Z 2024-04-04T22:45:20.543972359Z [2024-04-04T22:45:20.543+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T22:45:20.544167274Z [2024-04-04T22:45:20.543+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:45:20.591039838Z [2024-04-04T22:45:20.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status queued for try_number 1 2024-04-04T22:45:20.602717665Z [2024-04-04T22:45:20.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9d78a9a-e60f-4d13-9955-e6b86040cd86 2024-04-04T22:45:21.795898941Z [2024-04-04T22:45:21.784+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:45:21.795936486Z [2024-04-04T22:45:21.787+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186, execution_date=2024-04-04 22:44:00+00:00, run_id=scheduled__2024-04-04T22:44:00+00:00, run_start_date=2024-04-04 22:45:17.703376+00:00, run_end_date=2024-04-04 22:45:21.785347+00:00, run_duration=4.081971, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:44:00+00:00, data_interval_end=2024-04-04 22:45:00+00:00, dag_hash=7c9c6b5a762cedb183b0c84bf52068d4 2024-04-04T22:45:21.805233167Z [2024-04-04T22:45:21.804+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186 to 2024-04-04T22:45:00+00:00, run_after=2024-04-04T22:46:00+00:00 2024-04-04T22:45:21.875884305Z [2024-04-04T22:45:21.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:44:00+00:00 exited with status success for try_number 1 2024-04-04T22:45:21.884515684Z [2024-04-04T22:45:21.884+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:44:00+00:00, map_index=-1, run_start_date=2024-04-04 22:45:19.295822+00:00, run_end_date=2024-04-04 22:45:20.962385+00:00, run_duration=1.666563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=83, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:45:17.734349+00:00, queued_by_job_id=1, pid=1303 2024-04-04T22:45:22.927608487Z [2024-04-04T22:45:22.926+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:45:22.928052485Z [2024-04-04T22:45:22.927+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186, execution_date=2024-04-04 22:44:00+00:00, run_id=scheduled__2024-04-04T22:44:00+00:00, run_start_date=2024-04-04 22:45:18.937450+00:00, run_end_date=2024-04-04 22:45:22.927504+00:00, run_duration=3.990054, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:44:00+00:00, data_interval_end=2024-04-04 22:45:00+00:00, dag_hash=9988dde76b245afbfab2ef2eda0f46fb 2024-04-04T22:45:22.948296505Z [2024-04-04T22:45:22.947+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186 to 2024-04-04T22:45:00+00:00, run_after=2024-04-04T22:46:00+00:00 2024-04-04T22:45:22.991169173Z [2024-04-04T22:45:22.990+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:45:22.991197206Z 2024-04-04T22:45:22.991479644Z [2024-04-04T22:45:22.991+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186 has 0/16 running and queued tasks 2024-04-04T22:45:22.992524930Z [2024-04-04T22:45:22.992+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:45:22.992542754Z 2024-04-04T22:45:22.995766945Z [2024-04-04T22:45:22.995+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186', task_id='split_metrics', run_id='scheduled__2024-04-04T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T22:45:22.995929661Z [2024-04-04T22:45:22.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186', 'split_metrics', 'scheduled__2024-04-04T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:45:23.055339089Z [2024-04-04T22:45:23.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186.split_metrics run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status queued for try_number 1 2024-04-04T22:45:23.055601835Z [2024-04-04T22:45:23.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:44:00+00:00 exited with status success for try_number 1 2024-04-04T22:45:23.055901862Z [2024-04-04T22:45:23.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status success for try_number 1 2024-04-04T22:45:23.062281805Z [2024-04-04T22:45:23.061+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:44:00+00:00, map_index=-1, run_start_date=2024-04-04 22:45:20.725957+00:00, run_end_date=2024-04-04 22:45:22.001028+00:00, run_duration=1.275071, state=success, executor_state=success, try_number=1, max_tries=1, job_id=84, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:45:18.975844+00:00, queued_by_job_id=1, pid=1316 2024-04-04T22:45:23.062574961Z [2024-04-04T22:45:23.062+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03a1c6c5-1794-43c6-899b-7843409d576d 2024-04-04T22:45:23.062851831Z [2024-04-04T22:45:23.062+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T22:40:00+00:00, map_index=-1, run_start_date=2024-04-04 22:45:22.383695+00:00, run_end_date=2024-04-04 22:45:22.736331+00:00, run_duration=0.352636, state=success, executor_state=success, try_number=1, max_tries=1, job_id=85, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:45:20.541801+00:00, queued_by_job_id=1, pid=1328 2024-04-04T22:45:25.254180254Z [2024-04-04T22:45:25.253+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:45:25.254205011Z 2024-04-04T22:45:25.254535918Z [2024-04-04T22:45:25.254+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186 has 0/16 running and queued tasks 2024-04-04T22:45:25.255421705Z [2024-04-04T22:45:25.255+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:45:25.255436697Z 2024-04-04T22:45:25.258659937Z [2024-04-04T22:45:25.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186', task_id='collect_metrics', run_id='scheduled__2024-04-04T22:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T22:45:25.259027849Z [2024-04-04T22:45:25.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186', 'collect_metrics', 'scheduled__2024-04-04T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T22:45:25.310192944Z [2024-04-04T22:45:25.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186.collect_metrics run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status queued for try_number 1 2024-04-04T22:45:25.310565844Z [2024-04-04T22:45:25.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186.split_metrics run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status success for try_number 1 2024-04-04T22:45:25.317262102Z [2024-04-04T22:45:25.316+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186, task_id=split_metrics, run_id=scheduled__2024-04-04T22:40:00+00:00, map_index=-1, run_start_date=2024-04-04 22:45:24.653044+00:00, run_end_date=2024-04-04 22:45:24.961900+00:00, run_duration=0.308856, state=success, executor_state=success, try_number=1, max_tries=1, job_id=86, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:45:22.993104+00:00, queued_by_job_id=1, pid=1341 2024-04-04T22:45:25.317737521Z [2024-04-04T22:45:25.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6d43d816-335a-4d04-a172-62d375251a8d 2024-04-04T22:45:27.855632132Z [2024-04-04T22:45:27.855+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:45:27.855653710Z 2024-04-04T22:45:27.855874002Z [2024-04-04T22:45:27.855+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186 has 0/16 running and queued tasks 2024-04-04T22:45:27.856499863Z [2024-04-04T22:45:27.856+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:45:27.856504147Z 2024-04-04T22:45:27.858771125Z [2024-04-04T22:45:27.858+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186', task_id='send_prometheus', run_id='scheduled__2024-04-04T22:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:45:27.858914220Z [2024-04-04T22:45:27.858+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186', 'send_prometheus', 'scheduled__2024-04-04T22:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:45:27.900707473Z [2024-04-04T22:45:27.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186.send_prometheus run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status queued for try_number 1 2024-04-04T22:45:27.900906024Z [2024-04-04T22:45:27.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186.collect_metrics run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status success for try_number 1 2024-04-04T22:45:27.908156459Z [2024-04-04T22:45:27.907+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186, task_id=collect_metrics, run_id=scheduled__2024-04-04T22:40:00+00:00, map_index=0, run_start_date=2024-04-04 22:45:26.809308+00:00, run_end_date=2024-04-04 22:45:27.147736+00:00, run_duration=0.338428, state=success, executor_state=success, try_number=1, max_tries=1, job_id=87, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:45:25.255975+00:00, queued_by_job_id=1, pid=1349 2024-04-04T22:45:27.908693809Z [2024-04-04T22:45:27.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to 154577e5-27c0-4193-8cb6-8c06c3ebc962 2024-04-04T22:45:29.890637736Z [2024-04-04T22:45:29.890+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:45:29.890874770Z [2024-04-04T22:45:29.890+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186, execution_date=2024-04-04 22:40:00+00:00, run_id=scheduled__2024-04-04T22:40:00+00:00, run_start_date=2024-04-04 22:45:20.468173+00:00, run_end_date=2024-04-04 22:45:29.890459+00:00, run_duration=9.422286, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:40:00+00:00, data_interval_end=2024-04-04 22:45:00+00:00, dag_hash=dd9bbd7637000716daf12e1ee07e704a 2024-04-04T22:45:29.897233610Z [2024-04-04T22:45:29.896+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186 to 2024-04-04T22:45:00+00:00, run_after=2024-04-04T22:50:00+00:00 2024-04-04T22:45:29.929533285Z [2024-04-04T22:45:29.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186.send_prometheus run_id=scheduled__2024-04-04T22:40:00+00:00 exited with status success for try_number 1 2024-04-04T22:45:29.937026260Z [2024-04-04T22:45:29.936+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186, task_id=send_prometheus, run_id=scheduled__2024-04-04T22:40:00+00:00, map_index=-1, run_start_date=2024-04-04 22:45:29.469933+00:00, run_end_date=2024-04-04 22:45:29.757919+00:00, run_duration=0.287986, state=success, executor_state=success, try_number=1, max_tries=1, job_id=88, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:45:27.856820+00:00, queued_by_job_id=1, pid=1357 2024-04-04T22:45:39.175320882Z [2024-04-04T22:45:39.174+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-04T22:46:01.034236346Z [2024-04-04T22:46:01.033+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:46:00+00:00, run_after=2024-04-04T22:47:00+00:00 2024-04-04T22:46:01.042904518Z [2024-04-04T22:46:01.042+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:46:01.058704169Z [2024-04-04T22:46:01.058+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:46:00+00:00, run_after=2024-04-04T22:47:00+00:00 2024-04-04T22:46:01.069471681Z [2024-04-04T22:46:01.069+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:46:01.077915723Z [2024-04-04T22:46:01.077+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:46:01.091634402Z [2024-04-04T22:46:01.091+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186 to 2024-04-04T22:46:00+00:00, run_after=2024-04-04T22:47:00+00:00 2024-04-04T22:46:01.298148829Z [2024-04-04T22:46:01.297+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-04-04T22:46:01.298179638Z 2024-04-04T22:46:01.298185684Z 2024-04-04T22:46:01.298190293Z 2024-04-04T22:46:01.298195008Z 2024-04-04T22:46:01.298200295Z 2024-04-04T22:46:01.298204889Z 2024-04-04T22:46:01.298445422Z [2024-04-04T22:46:01.298+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T22:46:01.298622597Z [2024-04-04T22:46:01.298+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:46:01.299318011Z [2024-04-04T22:46:01.298+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:46:01.307707630Z [2024-04-04T22:46:01.298+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:46:01.307760922Z [2024-04-04T22:46:01.298+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186 has 0/16 running and queued tasks 2024-04-04T22:46:01.307766923Z [2024-04-04T22:46:01.299+0000] {scheduler_job.py:425} INFO - DAG vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186 has 0/16 running and queued tasks 2024-04-04T22:46:01.307772414Z [2024-04-04T22:46:01.300+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:46:01.307777969Z 2024-04-04T22:46:01.307782829Z 2024-04-04T22:46:01.307787911Z 2024-04-04T22:46:01.307792763Z 2024-04-04T22:46:01.307797468Z 2024-04-04T22:46:01.307802872Z 2024-04-04T22:46:01.307808040Z [2024-04-04T22:46:01.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T22:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:46:01.307813711Z [2024-04-04T22:46:01.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T22:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T22:46:01.307818885Z [2024-04-04T22:46:01.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:46:01.307823703Z [2024-04-04T22:46:01.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:46:01.307828462Z [2024-04-04T22:46:01.307+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:46:01.307833193Z [2024-04-04T22:46:01.307+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:46:01.307837995Z [2024-04-04T22:46:01.307+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:46:01.307851484Z [2024-04-04T22:46:01.307+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:46:01.308135386Z [2024-04-04T22:46:01.307+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:46:01.308154165Z [2024-04-04T22:46:01.307+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:46:01.308293519Z [2024-04-04T22:46:01.308+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:46:01.308534923Z [2024-04-04T22:46:01.308+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:46:02.066250665Z [2024-04-04T22:46:02.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:44:00+00:00 exited with status queued for try_number 1 2024-04-04T22:46:02.066436925Z [2024-04-04T22:46:02.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:45:00+00:00 exited with status queued for try_number 1 2024-04-04T22:46:02.066550063Z [2024-04-04T22:46:02.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:45:00+00:00 exited with status queued for try_number 1 2024-04-04T22:46:02.066720059Z [2024-04-04T22:46:02.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:45:00+00:00 exited with status queued for try_number 1 2024-04-04T22:46:02.066850487Z [2024-04-04T22:46:02.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:45:00+00:00 exited with status queued for try_number 1 2024-04-04T22:46:02.066949535Z [2024-04-04T22:46:02.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:45:00+00:00 exited with status queued for try_number 1 2024-04-04T22:46:02.085762776Z [2024-04-04T22:46:02.085+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1a2bc51-9e16-406e-9d02-a648055b4495 2024-04-04T22:46:02.086276367Z [2024-04-04T22:46:02.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0faf297-1ead-475e-af3a-96927e6e37d3 2024-04-04T22:46:02.086488582Z [2024-04-04T22:46:02.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa66ff38-62ed-466a-a4aa-e4f735109ffb 2024-04-04T22:46:02.086828875Z [2024-04-04T22:46:02.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to e55496c7-2f18-45d0-8645-4cecfda8beea 2024-04-04T22:46:02.087085865Z [2024-04-04T22:46:02.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa15d3dc-1438-49c2-b9f1-4b870a3e5024 2024-04-04T22:46:02.087117980Z [2024-04-04T22:46:02.086+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf59368c-6628-4b20-b769-df204410cfba 2024-04-04T22:46:04.634930534Z [2024-04-04T22:46:04.634+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:46:04.635475286Z [2024-04-04T22:46:04.635+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 22:44:00+00:00, run_id=scheduled__2024-04-04T22:44:00+00:00, run_start_date=2024-04-04 22:46:01.105056+00:00, run_end_date=2024-04-04 22:46:04.634860+00:00, run_duration=3.529804, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:44:00+00:00, data_interval_end=2024-04-04 22:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T22:46:04.649073995Z [2024-04-04T22:46:04.648+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T22:46:00+00:00, run_after=2024-04-04T22:48:00+00:00 2024-04-04T22:46:04.662441466Z [2024-04-04T22:46:04.662+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:46:04.663651530Z [2024-04-04T22:46:04.663+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:45:00+00:00, run_id=scheduled__2024-04-04T22:45:00+00:00, run_start_date=2024-04-04 22:46:01.109353+00:00, run_end_date=2024-04-04 22:46:04.662365+00:00, run_duration=3.553012, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:45:00+00:00, data_interval_end=2024-04-04 22:46:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:46:04.682048986Z [2024-04-04T22:46:04.681+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:46:00+00:00, run_after=2024-04-04T22:47:00+00:00 2024-04-04T22:46:04.810287709Z [2024-04-04T22:46:04.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:44:00+00:00 exited with status success for try_number 1 2024-04-04T22:46:04.810542204Z [2024-04-04T22:46:04.810+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:45:00+00:00 exited with status success for try_number 1 2024-04-04T22:46:04.817443690Z [2024-04-04T22:46:04.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T22:44:00+00:00, map_index=-1, run_start_date=2024-04-04 22:46:03.203831+00:00, run_end_date=2024-04-04 22:46:03.783139+00:00, run_duration=0.579308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=90, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:46:01.302112+00:00, queued_by_job_id=1, pid=1370 2024-04-04T22:46:04.818026873Z [2024-04-04T22:46:04.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:45:00+00:00, map_index=-1, run_start_date=2024-04-04 22:46:03.186424+00:00, run_end_date=2024-04-04 22:46:04.185829+00:00, run_duration=0.999405, state=success, executor_state=success, try_number=1, max_tries=1, job_id=89, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:46:01.302112+00:00, queued_by_job_id=1, pid=1369 2024-04-04T22:46:06.945257869Z [2024-04-04T22:46:06.944+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:46:06.945546473Z [2024-04-04T22:46:06.945+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:45:00+00:00, run_id=scheduled__2024-04-04T22:45:00+00:00, run_start_date=2024-04-04 22:46:01.106705+00:00, run_end_date=2024-04-04 22:46:06.945119+00:00, run_duration=5.838414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:45:00+00:00, data_interval_end=2024-04-04 22:46:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:46:06.953966577Z [2024-04-04T22:46:06.953+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:46:00+00:00, run_after=2024-04-04T22:47:00+00:00 2024-04-04T22:46:07.238774570Z [2024-04-04T22:46:07.238+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:45:00+00:00 exited with status success for try_number 1 2024-04-04T22:46:07.244931145Z [2024-04-04T22:46:07.244+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:45:00+00:00, map_index=-1, run_start_date=2024-04-04 22:46:04.755528+00:00, run_end_date=2024-04-04 22:46:06.864951+00:00, run_duration=2.109423, state=success, executor_state=success, try_number=1, max_tries=1, job_id=92, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:46:01.302112+00:00, queued_by_job_id=1, pid=1406 2024-04-04T22:46:08.157464447Z [2024-04-04T22:46:08.157+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:46:08.157872067Z [2024-04-04T22:46:08.157+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:45:00+00:00, run_id=scheduled__2024-04-04T22:45:00+00:00, run_start_date=2024-04-04 22:46:01.108101+00:00, run_end_date=2024-04-04 22:46:08.157378+00:00, run_duration=7.049277, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:45:00+00:00, data_interval_end=2024-04-04 22:46:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:46:08.166898984Z [2024-04-04T22:46:08.166+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:46:00+00:00, run_after=2024-04-04T22:47:00+00:00 2024-04-04T22:46:08.172651583Z [2024-04-04T22:46:08.172+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:46:08.173569359Z [2024-04-04T22:46:08.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186, execution_date=2024-04-04 22:45:00+00:00, run_id=scheduled__2024-04-04T22:45:00+00:00, run_start_date=2024-04-04 22:46:01.111312+00:00, run_end_date=2024-04-04 22:46:08.172563+00:00, run_duration=7.061251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:45:00+00:00, data_interval_end=2024-04-04 22:46:00+00:00, dag_hash=7c9c6b5a762cedb183b0c84bf52068d4 2024-04-04T22:46:08.182778226Z [2024-04-04T22:46:08.182+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186 to 2024-04-04T22:46:00+00:00, run_after=2024-04-04T22:47:00+00:00 2024-04-04T22:46:08.190201537Z [2024-04-04T22:46:08.189+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:46:08.190873291Z [2024-04-04T22:46:08.190+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186, execution_date=2024-04-04 22:45:00+00:00, run_id=scheduled__2024-04-04T22:45:00+00:00, run_start_date=2024-04-04 22:46:01.120268+00:00, run_end_date=2024-04-04 22:46:08.190105+00:00, run_duration=7.069837, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:45:00+00:00, data_interval_end=2024-04-04 22:46:00+00:00, dag_hash=9988dde76b245afbfab2ef2eda0f46fb 2024-04-04T22:46:08.201896730Z [2024-04-04T22:46:08.201+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186 to 2024-04-04T22:46:00+00:00, run_after=2024-04-04T22:47:00+00:00 2024-04-04T22:46:08.233372530Z [2024-04-04T22:46:08.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:45:00+00:00 exited with status success for try_number 1 2024-04-04T22:46:08.233633666Z [2024-04-04T22:46:08.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:45:00+00:00 exited with status success for try_number 1 2024-04-04T22:46:08.233774795Z [2024-04-04T22:46:08.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:45:00+00:00 exited with status success for try_number 1 2024-04-04T22:46:08.241835025Z [2024-04-04T22:46:08.241+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:45:00+00:00, map_index=-1, run_start_date=2024-04-04 22:46:04.507040+00:00, run_end_date=2024-04-04 22:46:07.419832+00:00, run_duration=2.912792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=91, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:46:01.302112+00:00, queued_by_job_id=1, pid=1395 2024-04-04T22:46:08.242295376Z [2024-04-04T22:46:08.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:45:00+00:00, map_index=-1, run_start_date=2024-04-04 22:46:04.889215+00:00, run_end_date=2024-04-04 22:46:07.551367+00:00, run_duration=2.662152, state=success, executor_state=success, try_number=1, max_tries=1, job_id=94, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:46:01.302112+00:00, queued_by_job_id=1, pid=1407 2024-04-04T22:46:08.242718157Z [2024-04-04T22:46:08.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:45:00+00:00, map_index=-1, run_start_date=2024-04-04 22:46:04.878207+00:00, run_end_date=2024-04-04 22:46:07.252010+00:00, run_duration=2.373803, state=success, executor_state=success, try_number=1, max_tries=1, job_id=93, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:46:01.302112+00:00, queued_by_job_id=1, pid=1408 2024-04-04T22:47:00.163729291Z [2024-04-04T22:47:00.163+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:47:00.174866064Z [2024-04-04T22:47:00.174+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:47:00.198189488Z [2024-04-04T22:47:00.197+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186 to 2024-04-04T22:47:00+00:00, run_after=2024-04-04T22:48:00+00:00 2024-04-04T22:47:00.215186748Z [2024-04-04T22:47:00.214+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:47:00+00:00, run_after=2024-04-04T22:48:00+00:00 2024-04-04T22:47:00.232200104Z [2024-04-04T22:47:00.231+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:47:00+00:00, run_after=2024-04-04T22:48:00+00:00 2024-04-04T22:47:00.347280996Z [2024-04-04T22:47:00.346+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-04T22:47:00.347308973Z 2024-04-04T22:47:00.347312739Z 2024-04-04T22:47:00.347315918Z 2024-04-04T22:47:00.347319090Z 2024-04-04T22:47:00.347322497Z 2024-04-04T22:47:00.348039528Z [2024-04-04T22:47:00.347+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186 has 0/16 running and queued tasks 2024-04-04T22:47:00.348607241Z [2024-04-04T22:47:00.348+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:47:00.349172868Z [2024-04-04T22:47:00.348+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:47:00.349870760Z [2024-04-04T22:47:00.349+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:47:00.350708069Z [2024-04-04T22:47:00.350+0000] {scheduler_job.py:425} INFO - DAG vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186 has 0/16 running and queued tasks 2024-04-04T22:47:00.352442374Z [2024-04-04T22:47:00.352+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:47:00.352455104Z 2024-04-04T22:47:00.352458710Z 2024-04-04T22:47:00.352462238Z 2024-04-04T22:47:00.352465337Z 2024-04-04T22:47:00.352468827Z 2024-04-04T22:47:00.361268926Z [2024-04-04T22:47:00.360+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:47:00.361620479Z [2024-04-04T22:47:00.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:47:00.362080488Z [2024-04-04T22:47:00.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:47:00.362472265Z [2024-04-04T22:47:00.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:47:00.363310036Z [2024-04-04T22:47:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:47:00.363714995Z [2024-04-04T22:47:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:47:00.364062388Z [2024-04-04T22:47:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:47:00.364335649Z [2024-04-04T22:47:00.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:47:00.364777086Z [2024-04-04T22:47:00.364+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:47:00.365030885Z [2024-04-04T22:47:00.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:47:00.912849681Z [2024-04-04T22:47:00.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:46:00+00:00 exited with status queued for try_number 1 2024-04-04T22:47:00.912952379Z [2024-04-04T22:47:00.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:46:00+00:00 exited with status queued for try_number 1 2024-04-04T22:47:00.912969926Z [2024-04-04T22:47:00.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:46:00+00:00 exited with status queued for try_number 1 2024-04-04T22:47:00.912990767Z [2024-04-04T22:47:00.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:46:00+00:00 exited with status queued for try_number 1 2024-04-04T22:47:00.913066924Z [2024-04-04T22:47:00.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:46:00+00:00 exited with status queued for try_number 1 2024-04-04T22:47:00.936911188Z [2024-04-04T22:47:00.936+0000] {scheduler_job.py:635} INFO - Setting external_id for to d400b001-597f-479c-a0a3-b6ba2c41a1b4 2024-04-04T22:47:00.936976908Z [2024-04-04T22:47:00.936+0000] {scheduler_job.py:635} INFO - Setting external_id for to eccbaefa-4996-47da-9981-8eb934047a53 2024-04-04T22:47:00.937137258Z [2024-04-04T22:47:00.936+0000] {scheduler_job.py:635} INFO - Setting external_id for to 03463c8a-439b-4e78-a135-f5eb006a2ef5 2024-04-04T22:47:00.937293192Z [2024-04-04T22:47:00.937+0000] {scheduler_job.py:635} INFO - Setting external_id for to d956bdfa-0024-4dcb-8835-750e3f7a5f77 2024-04-04T22:47:00.939178175Z [2024-04-04T22:47:00.938+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0c55debc-1c4d-4000-9a4f-3e5dbaa89d22 2024-04-04T22:47:02.913326310Z [2024-04-04T22:47:02.912+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:47:02.914066592Z [2024-04-04T22:47:02.913+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:46:00+00:00, run_id=scheduled__2024-04-04T22:46:00+00:00, run_start_date=2024-04-04 22:47:00.257752+00:00, run_end_date=2024-04-04 22:47:02.913417+00:00, run_duration=2.655665, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:46:00+00:00, data_interval_end=2024-04-04 22:47:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:47:02.930966731Z [2024-04-04T22:47:02.930+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:47:00+00:00, run_after=2024-04-04T22:48:00+00:00 2024-04-04T22:47:03.008415865Z [2024-04-04T22:47:03.008+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:46:00+00:00 exited with status success for try_number 1 2024-04-04T22:47:03.015089927Z [2024-04-04T22:47:03.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:46:00+00:00, map_index=-1, run_start_date=2024-04-04 22:47:02.022009+00:00, run_end_date=2024-04-04 22:47:02.528959+00:00, run_duration=0.50695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=95, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:47:00.356558+00:00, queued_by_job_id=1, pid=1452 2024-04-04T22:47:06.278561595Z [2024-04-04T22:47:06.278+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:47:06.278969291Z [2024-04-04T22:47:06.278+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186, execution_date=2024-04-04 22:46:00+00:00, run_id=scheduled__2024-04-04T22:46:00+00:00, run_start_date=2024-04-04 22:47:00.256416+00:00, run_end_date=2024-04-04 22:47:06.278374+00:00, run_duration=6.021958, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:46:00+00:00, data_interval_end=2024-04-04 22:47:00+00:00, dag_hash=9988dde76b245afbfab2ef2eda0f46fb 2024-04-04T22:47:06.289985869Z [2024-04-04T22:47:06.289+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186 to 2024-04-04T22:47:00+00:00, run_after=2024-04-04T22:48:00+00:00 2024-04-04T22:47:06.355073185Z [2024-04-04T22:47:06.352+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:46:00+00:00 exited with status success for try_number 1 2024-04-04T22:47:06.366455044Z [2024-04-04T22:47:06.365+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:46:00+00:00, map_index=-1, run_start_date=2024-04-04 22:47:03.381232+00:00, run_end_date=2024-04-04 22:47:05.849689+00:00, run_duration=2.468457, state=success, executor_state=success, try_number=1, max_tries=1, job_id=96, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:47:00.356558+00:00, queued_by_job_id=1, pid=1467 2024-04-04T22:47:07.422455611Z [2024-04-04T22:47:07.421+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:47:07.422680252Z [2024-04-04T22:47:07.422+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186, execution_date=2024-04-04 22:46:00+00:00, run_id=scheduled__2024-04-04T22:46:00+00:00, run_start_date=2024-04-04 22:47:00.252972+00:00, run_end_date=2024-04-04 22:47:07.422177+00:00, run_duration=7.169205, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:46:00+00:00, data_interval_end=2024-04-04 22:47:00+00:00, dag_hash=7c9c6b5a762cedb183b0c84bf52068d4 2024-04-04T22:47:07.431950686Z [2024-04-04T22:47:07.431+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186 to 2024-04-04T22:47:00+00:00, run_after=2024-04-04T22:48:00+00:00 2024-04-04T22:47:07.439275460Z [2024-04-04T22:47:07.438+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:47:07.439453168Z [2024-04-04T22:47:07.439+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:46:00+00:00, run_id=scheduled__2024-04-04T22:46:00+00:00, run_start_date=2024-04-04 22:47:00.254881+00:00, run_end_date=2024-04-04 22:47:07.439100+00:00, run_duration=7.184219, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:46:00+00:00, data_interval_end=2024-04-04 22:47:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:47:07.451648440Z [2024-04-04T22:47:07.451+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:47:00+00:00, run_after=2024-04-04T22:48:00+00:00 2024-04-04T22:47:07.461084460Z [2024-04-04T22:47:07.460+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:47:07.461317248Z [2024-04-04T22:47:07.460+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:46:00+00:00, run_id=scheduled__2024-04-04T22:46:00+00:00, run_start_date=2024-04-04 22:47:00.258914+00:00, run_end_date=2024-04-04 22:47:07.460897+00:00, run_duration=7.201983, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:46:00+00:00, data_interval_end=2024-04-04 22:47:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:47:07.470861542Z [2024-04-04T22:47:07.470+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:47:00+00:00, run_after=2024-04-04T22:48:00+00:00 2024-04-04T22:47:07.514903563Z [2024-04-04T22:47:07.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:46:00+00:00 exited with status success for try_number 1 2024-04-04T22:47:07.514938623Z [2024-04-04T22:47:07.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:46:00+00:00 exited with status success for try_number 1 2024-04-04T22:47:07.514950088Z [2024-04-04T22:47:07.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:46:00+00:00 exited with status success for try_number 1 2024-04-04T22:47:07.521379068Z [2024-04-04T22:47:07.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:46:00+00:00, map_index=-1, run_start_date=2024-04-04 22:47:03.864088+00:00, run_end_date=2024-04-04 22:47:06.960920+00:00, run_duration=3.096832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=98, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:47:00.356558+00:00, queued_by_job_id=1, pid=1484 2024-04-04T22:47:07.521502353Z [2024-04-04T22:47:07.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:46:00+00:00, map_index=-1, run_start_date=2024-04-04 22:47:03.707381+00:00, run_end_date=2024-04-04 22:47:06.603194+00:00, run_duration=2.895813, state=success, executor_state=success, try_number=1, max_tries=1, job_id=97, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:47:00.356558+00:00, queued_by_job_id=1, pid=1483 2024-04-04T22:47:07.521669838Z [2024-04-04T22:47:07.521+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:46:00+00:00, map_index=-1, run_start_date=2024-04-04 22:47:04.174954+00:00, run_end_date=2024-04-04 22:47:06.846530+00:00, run_duration=2.671576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=99, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:47:00.356558+00:00, queued_by_job_id=1, pid=1500 2024-04-04T22:48:00.384710945Z [2024-04-04T22:48:00.384+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:48:00.408005853Z [2024-04-04T22:48:00.407+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:48:00+00:00, run_after=2024-04-04T22:49:00+00:00 2024-04-04T22:48:00.426356440Z [2024-04-04T22:48:00.425+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:48:00.435691382Z [2024-04-04T22:48:00.435+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:48:00.458411507Z [2024-04-04T22:48:00.457+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:48:00+00:00, run_after=2024-04-04T22:49:00+00:00 2024-04-04T22:48:00.481265554Z [2024-04-04T22:48:00.480+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186 to 2024-04-04T22:48:00+00:00, run_after=2024-04-04T22:49:00+00:00 2024-04-04T22:48:00.610531181Z [2024-04-04T22:48:00.610+0000] {scheduler_job.py:360} INFO - 6 tasks up for execution: 2024-04-04T22:48:00.610562426Z 2024-04-04T22:48:00.610569528Z 2024-04-04T22:48:00.610572882Z 2024-04-04T22:48:00.610576158Z 2024-04-04T22:48:00.610599037Z 2024-04-04T22:48:00.610620592Z 2024-04-04T22:48:00.610857231Z [2024-04-04T22:48:00.610+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T22:48:00.611152041Z [2024-04-04T22:48:00.610+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:48:00.611350625Z [2024-04-04T22:48:00.611+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:48:00.611988112Z [2024-04-04T22:48:00.611+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186 has 0/16 running and queued tasks 2024-04-04T22:48:00.612256905Z [2024-04-04T22:48:00.612+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:48:00.612517421Z [2024-04-04T22:48:00.612+0000] {scheduler_job.py:425} INFO - DAG vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186 has 0/16 running and queued tasks 2024-04-04T22:48:00.613490394Z [2024-04-04T22:48:00.613+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:48:00.613505171Z 2024-04-04T22:48:00.613534443Z 2024-04-04T22:48:00.613538975Z 2024-04-04T22:48:00.613542366Z 2024-04-04T22:48:00.613546776Z 2024-04-04T22:48:00.613552759Z 2024-04-04T22:48:00.618371144Z [2024-04-04T22:48:00.618+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T22:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:48:00.618613710Z [2024-04-04T22:48:00.618+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T22:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T22:48:00.619038390Z [2024-04-04T22:48:00.618+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:48:00.619184597Z [2024-04-04T22:48:00.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:48:00.619591903Z [2024-04-04T22:48:00.619+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:48:00.619841567Z [2024-04-04T22:48:00.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:48:00.620244197Z [2024-04-04T22:48:00.620+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:48:00.620388406Z [2024-04-04T22:48:00.620+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:48:00.620701688Z [2024-04-04T22:48:00.620+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:48:00.620888897Z [2024-04-04T22:48:00.620+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:48:00.621249880Z [2024-04-04T22:48:00.621+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:48:00.621544706Z [2024-04-04T22:48:00.621+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:48:01.664396860Z [2024-04-04T22:48:01.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:46:00+00:00 exited with status queued for try_number 1 2024-04-04T22:48:01.664546279Z [2024-04-04T22:48:01.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:47:00+00:00 exited with status queued for try_number 1 2024-04-04T22:48:01.664725837Z [2024-04-04T22:48:01.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:47:00+00:00 exited with status queued for try_number 1 2024-04-04T22:48:01.664842455Z [2024-04-04T22:48:01.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:47:00+00:00 exited with status queued for try_number 1 2024-04-04T22:48:01.664965277Z [2024-04-04T22:48:01.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:47:00+00:00 exited with status queued for try_number 1 2024-04-04T22:48:01.665082399Z [2024-04-04T22:48:01.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:47:00+00:00 exited with status queued for try_number 1 2024-04-04T22:48:01.678734477Z [2024-04-04T22:48:01.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30f9fda2-cc68-4bff-a243-1bfa655eb7b8 2024-04-04T22:48:01.678974094Z [2024-04-04T22:48:01.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43501861-b4e6-4e4a-8c81-c29c4c99e056 2024-04-04T22:48:01.679166038Z [2024-04-04T22:48:01.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31254c9a-30d5-4b17-a5d4-48efc93ef320 2024-04-04T22:48:01.679333575Z [2024-04-04T22:48:01.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53114bf8-2ba1-494b-9ba0-120ddc3b9040 2024-04-04T22:48:01.679519279Z [2024-04-04T22:48:01.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b87ad36-0da3-4231-bf1a-c456ab133621 2024-04-04T22:48:01.679712628Z [2024-04-04T22:48:01.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to bec4a19b-ae18-4de5-81f9-2bafae284f82 2024-04-04T22:48:03.728775995Z [2024-04-04T22:48:03.728+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:48:03.729193747Z [2024-04-04T22:48:03.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 22:46:00+00:00, run_id=scheduled__2024-04-04T22:46:00+00:00, run_start_date=2024-04-04 22:48:00.508390+00:00, run_end_date=2024-04-04 22:48:03.728810+00:00, run_duration=3.22042, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:46:00+00:00, data_interval_end=2024-04-04 22:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T22:48:03.737586581Z [2024-04-04T22:48:03.737+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T22:48:00+00:00, run_after=2024-04-04T22:50:00+00:00 2024-04-04T22:48:03.859501566Z [2024-04-04T22:48:03.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:46:00+00:00 exited with status success for try_number 1 2024-04-04T22:48:03.869282500Z [2024-04-04T22:48:03.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T22:46:00+00:00, map_index=-1, run_start_date=2024-04-04 22:48:02.725499+00:00, run_end_date=2024-04-04 22:48:03.221698+00:00, run_duration=0.496199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:48:00.614833+00:00, queued_by_job_id=1, pid=1531 2024-04-04T22:48:04.967272936Z [2024-04-04T22:48:04.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:48:04.967333420Z [2024-04-04T22:48:04.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:47:00+00:00, run_id=scheduled__2024-04-04T22:47:00+00:00, run_start_date=2024-04-04 22:48:00.511442+00:00, run_end_date=2024-04-04 22:48:04.965261+00:00, run_duration=4.453819, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:47:00+00:00, data_interval_end=2024-04-04 22:48:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:48:04.980373996Z [2024-04-04T22:48:04.979+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:48:00+00:00, run_after=2024-04-04T22:49:00+00:00 2024-04-04T22:48:05.053551887Z [2024-04-04T22:48:05.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:47:00+00:00 exited with status success for try_number 1 2024-04-04T22:48:05.053760268Z [2024-04-04T22:48:05.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:47:00+00:00 exited with status failed for try_number 1 2024-04-04T22:48:05.054079974Z [2024-04-04T22:48:05.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:47:00+00:00 exited with status failed for try_number 1 2024-04-04T22:48:05.062812056Z [2024-04-04T22:48:05.062+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:47:00+00:00, map_index=-1, run_start_date=2024-04-04 22:48:03.114956+00:00, run_end_date=2024-04-04 22:48:03.775489+00:00, run_duration=0.660533, state=success, executor_state=success, try_number=1, max_tries=1, job_id=101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:48:00.614833+00:00, queued_by_job_id=1, pid=1537 2024-04-04T22:48:05.063335015Z [2024-04-04T22:48:05.063+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:47:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:48:00.614833+00:00, queued_by_job_id=1, pid=None 2024-04-04T22:48:05.064045564Z [2024-04-04T22:48:05.063+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:48:05.066645731Z [2024-04-04T22:48:05.066+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:48:05.083148144Z [2024-04-04T22:48:05.082+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240404T224700, start_date=, end_date=20240404T224805 2024-04-04T22:48:05.093006315Z [2024-04-04T22:48:05.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:47:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:48:00.614833+00:00, queued_by_job_id=1, pid=None 2024-04-04T22:48:05.093775652Z [2024-04-04T22:48:05.093+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:48:05.097025173Z [2024-04-04T22:48:05.096+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:48:05.117528665Z [2024-04-04T22:48:05.117+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240404T224700, start_date=, end_date=20240404T224805 2024-04-04T22:48:06.175832711Z [2024-04-04T22:48:06.175+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:48:06.176192622Z [2024-04-04T22:48:06.175+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:47:00+00:00, run_id=scheduled__2024-04-04T22:47:00+00:00, run_start_date=2024-04-04 22:48:00.514918+00:00, run_end_date=2024-04-04 22:48:06.175750+00:00, run_duration=5.660832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:47:00+00:00, data_interval_end=2024-04-04 22:48:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:48:06.190396836Z [2024-04-04T22:48:06.189+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:48:00+00:00, run_after=2024-04-04T22:49:00+00:00 2024-04-04T22:48:06.261911188Z [2024-04-04T22:48:06.260+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:47:00+00:00 exited with status success for try_number 1 2024-04-04T22:48:06.265293471Z [2024-04-04T22:48:06.264+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:47:00+00:00, map_index=-1, run_start_date=2024-04-04 22:48:03.716087+00:00, run_end_date=2024-04-04 22:48:05.467347+00:00, run_duration=1.75126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:48:00.614833+00:00, queued_by_job_id=1, pid=1550 2024-04-04T22:48:08.904483213Z [2024-04-04T22:48:08.904+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:48:08.904874632Z [2024-04-04T22:48:08.904+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:47:00+00:00, run_id=scheduled__2024-04-04T22:47:00+00:00, run_start_date=2024-04-04 22:48:00.510011+00:00, run_end_date=2024-04-04 22:48:08.904385+00:00, run_duration=8.394374, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:47:00+00:00, data_interval_end=2024-04-04 22:48:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:48:08.913266022Z [2024-04-04T22:48:08.913+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:48:00+00:00, run_after=2024-04-04T22:49:00+00:00 2024-04-04T22:48:08.958881093Z [2024-04-04T22:48:08.958+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:47:00+00:00 exited with status success for try_number 1 2024-04-04T22:48:08.965837994Z [2024-04-04T22:48:08.965+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:47:00+00:00, map_index=-1, run_start_date=2024-04-04 22:48:04.538483+00:00, run_end_date=2024-04-04 22:48:08.634851+00:00, run_duration=4.096368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:48:00.614833+00:00, queued_by_job_id=1, pid=1572 2024-04-04T22:48:15.503128278Z [2024-04-04T22:48:15.502+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-04T22:48:15.503168020Z 2024-04-04T22:48:15.503171885Z 2024-04-04T22:48:15.503175479Z [2024-04-04T22:48:15.502+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186 has 0/16 running and queued tasks 2024-04-04T22:48:15.503213008Z [2024-04-04T22:48:15.502+0000] {scheduler_job.py:425} INFO - DAG vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186 has 0/16 running and queued tasks 2024-04-04T22:48:15.503966043Z [2024-04-04T22:48:15.503+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:48:15.503984510Z 2024-04-04T22:48:15.503990484Z 2024-04-04T22:48:15.507979080Z [2024-04-04T22:48:15.507+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:47:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:48:15.508009224Z [2024-04-04T22:48:15.507+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:48:15.508160217Z [2024-04-04T22:48:15.507+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:47:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:48:15.508213096Z [2024-04-04T22:48:15.508+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:48:15.642280765Z [2024-04-04T22:48:15.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:47:00+00:00 exited with status queued for try_number 2 2024-04-04T22:48:15.642530256Z [2024-04-04T22:48:15.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:47:00+00:00 exited with status queued for try_number 2 2024-04-04T22:48:15.651476570Z [2024-04-04T22:48:15.651+0000] {scheduler_job.py:635} INFO - Setting external_id for to d45c33c2-e3ae-40e9-86e6-d115475ed624 2024-04-04T22:48:15.651695856Z [2024-04-04T22:48:15.651+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20d650fe-49dd-462a-992b-f44c9f5932e2 2024-04-04T22:48:17.874644577Z [2024-04-04T22:48:17.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:47:00+00:00 exited with status failed for try_number 2 2024-04-04T22:48:17.874689535Z [2024-04-04T22:48:17.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:47:00+00:00 exited with status failed for try_number 2 2024-04-04T22:48:17.880513269Z [2024-04-04T22:48:17.880+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:47:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-04 22:48:05.069426+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:48:15.504678+00:00, queued_by_job_id=1, pid=None 2024-04-04T22:48:17.880820011Z [2024-04-04T22:48:17.880+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:48:17.882856709Z [2024-04-04T22:48:17.882+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:48:17.895179196Z [2024-04-04T22:48:17.894+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240404T224700, start_date=, end_date=20240404T224817 2024-04-04T22:48:17.902342787Z [2024-04-04T22:48:17.902+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:47:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-04 22:48:05.100776+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:48:15.504678+00:00, queued_by_job_id=1, pid=None 2024-04-04T22:48:17.902798776Z [2024-04-04T22:48:17.902+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:48:17.904685957Z [2024-04-04T22:48:17.904+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-04T22:48:17.916999922Z [2024-04-04T22:48:17.916+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240404T224700, start_date=, end_date=20240404T224817 2024-04-04T22:48:18.965574231Z [2024-04-04T22:48:18.965+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-04T22:48:18.966098223Z [2024-04-04T22:48:18.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186, execution_date=2024-04-04 22:47:00+00:00, run_id=scheduled__2024-04-04T22:47:00+00:00, run_start_date=2024-04-04 22:48:00.513362+00:00, run_end_date=2024-04-04 22:48:18.965430+00:00, run_duration=18.452068, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:47:00+00:00, data_interval_end=2024-04-04 22:48:00+00:00, dag_hash=7c9c6b5a762cedb183b0c84bf52068d4 2024-04-04T22:48:18.975123103Z [2024-04-04T22:48:18.974+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_ec0de164-a5fc-4c51-a6ae-083ae26bf186 to 2024-04-04T22:48:00+00:00, run_after=2024-04-04T22:49:00+00:00 2024-04-04T22:48:18.982551210Z [2024-04-04T22:48:18.982+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-04T22:48:18.982900639Z [2024-04-04T22:48:18.982+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186, execution_date=2024-04-04 22:47:00+00:00, run_id=scheduled__2024-04-04T22:47:00+00:00, run_start_date=2024-04-04 22:48:00.516355+00:00, run_end_date=2024-04-04 22:48:18.982475+00:00, run_duration=18.46612, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:47:00+00:00, data_interval_end=2024-04-04 22:48:00+00:00, dag_hash=9988dde76b245afbfab2ef2eda0f46fb 2024-04-04T22:48:18.992505467Z [2024-04-04T22:48:18.992+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_ec0de164-a5fc-4c51-a6ae-083ae26bf186 to 2024-04-04T22:48:00+00:00, run_after=2024-04-04T22:49:00+00:00 2024-04-04T22:49:00.625845380Z [2024-04-04T22:49:00.625+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:49:00.641632569Z [2024-04-04T22:49:00.640+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:49:00+00:00, run_after=2024-04-04T22:50:00+00:00 2024-04-04T22:49:00.655146201Z [2024-04-04T22:49:00.654+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:49:00+00:00, run_after=2024-04-04T22:50:00+00:00 2024-04-04T22:49:00.718650970Z [2024-04-04T22:49:00.718+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T22:49:00.718679796Z 2024-04-04T22:49:00.718683800Z 2024-04-04T22:49:00.718687470Z 2024-04-04T22:49:00.718722644Z [2024-04-04T22:49:00.718+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:49:00.718765411Z [2024-04-04T22:49:00.718+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:49:00.718850958Z [2024-04-04T22:49:00.718+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:49:00.719601664Z [2024-04-04T22:49:00.719+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:49:00.719648864Z 2024-04-04T22:49:00.719652553Z 2024-04-04T22:49:00.719655753Z 2024-04-04T22:49:00.723024506Z [2024-04-04T22:49:00.722+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:49:00.723121861Z [2024-04-04T22:49:00.722+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:49:00.723285373Z [2024-04-04T22:49:00.723+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:49:00.723353480Z [2024-04-04T22:49:00.723+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:49:00.723518149Z [2024-04-04T22:49:00.723+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:49:00.723662419Z [2024-04-04T22:49:00.723+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:49:01.216506417Z [2024-04-04T22:49:01.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:48:00+00:00 exited with status queued for try_number 1 2024-04-04T22:49:01.216540271Z [2024-04-04T22:49:01.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:48:00+00:00 exited with status queued for try_number 1 2024-04-04T22:49:01.216546329Z [2024-04-04T22:49:01.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:48:00+00:00 exited with status queued for try_number 1 2024-04-04T22:49:01.277299691Z [2024-04-04T22:49:01.276+0000] {scheduler_job.py:635} INFO - Setting external_id for to 197dfa50-34cd-4c4b-8afc-2123abdbd9e8 2024-04-04T22:49:01.277335928Z [2024-04-04T22:49:01.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb61a570-b4f8-4367-a7e5-3d527099a2d7 2024-04-04T22:49:01.277494921Z [2024-04-04T22:49:01.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to e14a043a-0035-4dfd-8e62-15ae7926c142 2024-04-04T22:49:02.734093427Z [2024-04-04T22:49:02.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:49:02.734746727Z [2024-04-04T22:49:02.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:48:00+00:00, run_id=scheduled__2024-04-04T22:48:00+00:00, run_start_date=2024-04-04 22:49:00.667698+00:00, run_end_date=2024-04-04 22:49:02.734179+00:00, run_duration=2.066481, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:48:00+00:00, data_interval_end=2024-04-04 22:49:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:49:02.748013775Z [2024-04-04T22:49:02.747+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:49:00+00:00, run_after=2024-04-04T22:50:00+00:00 2024-04-04T22:49:02.790954803Z [2024-04-04T22:49:02.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:48:00+00:00 exited with status success for try_number 1 2024-04-04T22:49:02.801726422Z [2024-04-04T22:49:02.801+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:48:00+00:00, map_index=-1, run_start_date=2024-04-04 22:49:01.971818+00:00, run_end_date=2024-04-04 22:49:02.464282+00:00, run_duration=0.492464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:49:00.720232+00:00, queued_by_job_id=1, pid=1633 2024-04-04T22:49:05.745184444Z [2024-04-04T22:49:05.744+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:49:05.745797938Z [2024-04-04T22:49:05.745+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:48:00+00:00, run_id=scheduled__2024-04-04T22:48:00+00:00, run_start_date=2024-04-04 22:49:00.668778+00:00, run_end_date=2024-04-04 22:49:05.745022+00:00, run_duration=5.076244, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:48:00+00:00, data_interval_end=2024-04-04 22:49:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:49:05.767661607Z [2024-04-04T22:49:05.766+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:49:00+00:00, run_after=2024-04-04T22:50:00+00:00 2024-04-04T22:49:05.834473019Z [2024-04-04T22:49:05.833+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:48:00+00:00 exited with status success for try_number 1 2024-04-04T22:49:05.843367329Z [2024-04-04T22:49:05.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:48:00+00:00, map_index=-1, run_start_date=2024-04-04 22:49:03.423419+00:00, run_end_date=2024-04-04 22:49:05.038649+00:00, run_duration=1.61523, state=success, executor_state=success, try_number=1, max_tries=1, job_id=105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:49:00.720232+00:00, queued_by_job_id=1, pid=1651 2024-04-04T22:49:06.893721743Z [2024-04-04T22:49:06.892+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:49:06.894682107Z [2024-04-04T22:49:06.894+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:48:00+00:00, run_id=scheduled__2024-04-04T22:48:00+00:00, run_start_date=2024-04-04 22:49:00.666404+00:00, run_end_date=2024-04-04 22:49:06.893665+00:00, run_duration=6.227261, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:48:00+00:00, data_interval_end=2024-04-04 22:49:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:49:06.913348257Z [2024-04-04T22:49:06.912+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:49:00+00:00, run_after=2024-04-04T22:50:00+00:00 2024-04-04T22:49:06.955481379Z [2024-04-04T22:49:06.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:48:00+00:00 exited with status success for try_number 1 2024-04-04T22:49:06.961484253Z [2024-04-04T22:49:06.961+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:48:00+00:00, map_index=-1, run_start_date=2024-04-04 22:49:03.610837+00:00, run_end_date=2024-04-04 22:49:05.836646+00:00, run_duration=2.225809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:49:00.720232+00:00, queued_by_job_id=1, pid=1652 2024-04-04T22:50:00.321337463Z [2024-04-04T22:50:00.321+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:50:00+00:00, run_after=2024-04-04T22:55:00+00:00 2024-04-04T22:50:00.328345875Z [2024-04-04T22:50:00.328+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:50:00.339726871Z [2024-04-04T22:50:00.339+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:50:00+00:00, run_after=2024-04-04T22:51:00+00:00 2024-04-04T22:50:00.347126291Z [2024-04-04T22:50:00.346+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:50:00.361400107Z [2024-04-04T22:50:00.361+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:50:00+00:00, run_after=2024-04-04T22:51:00+00:00 2024-04-04T22:50:00.448168354Z [2024-04-04T22:50:00.447+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-04T22:50:00.448195480Z 2024-04-04T22:50:00.448199274Z 2024-04-04T22:50:00.448203189Z 2024-04-04T22:50:00.448206470Z 2024-04-04T22:50:00.448209916Z 2024-04-04T22:50:00.448772210Z [2024-04-04T22:50:00.448+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:50:00.449153482Z [2024-04-04T22:50:00.448+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T22:50:00.449657997Z [2024-04-04T22:50:00.449+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:50:00.449863226Z [2024-04-04T22:50:00.449+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:50:00.450059168Z [2024-04-04T22:50:00.449+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:50:00.452173762Z [2024-04-04T22:50:00.451+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:50:00.452189355Z 2024-04-04T22:50:00.452193339Z 2024-04-04T22:50:00.452213099Z 2024-04-04T22:50:00.452216508Z 2024-04-04T22:50:00.452219597Z 2024-04-04T22:50:00.457739894Z [2024-04-04T22:50:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T22:50:00.457978650Z [2024-04-04T22:50:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:50:00.458376378Z [2024-04-04T22:50:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T22:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:50:00.458558428Z [2024-04-04T22:50:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T22:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T22:50:00.458886476Z [2024-04-04T22:50:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:50:00.459097773Z [2024-04-04T22:50:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:50:00.459424416Z [2024-04-04T22:50:00.459+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:50:00.459591984Z [2024-04-04T22:50:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:50:00.459855623Z [2024-04-04T22:50:00.459+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:50:00.460008354Z [2024-04-04T22:50:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:50:01.485594758Z [2024-04-04T22:50:01.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:45:00+00:00 exited with status queued for try_number 1 2024-04-04T22:50:01.486313239Z [2024-04-04T22:50:01.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:48:00+00:00 exited with status queued for try_number 1 2024-04-04T22:50:01.486433461Z [2024-04-04T22:50:01.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:49:00+00:00 exited with status queued for try_number 1 2024-04-04T22:50:01.486571332Z [2024-04-04T22:50:01.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:49:00+00:00 exited with status queued for try_number 1 2024-04-04T22:50:01.486672245Z [2024-04-04T22:50:01.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:49:00+00:00 exited with status queued for try_number 1 2024-04-04T22:50:01.506187160Z [2024-04-04T22:50:01.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to 356dc05a-db56-4073-9c29-49e1313f59ac 2024-04-04T22:50:01.506365618Z [2024-04-04T22:50:01.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48390448-bcb5-4df1-aaf7-30ae15973a24 2024-04-04T22:50:01.506491363Z [2024-04-04T22:50:01.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1de64bcb-971d-4187-bc4a-0364cfe7916e 2024-04-04T22:50:01.506620241Z [2024-04-04T22:50:01.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2025369e-5a76-4360-8028-2b04baefc853 2024-04-04T22:50:01.506745681Z [2024-04-04T22:50:01.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2da9e4bd-be31-4eaa-8cfc-c26d1a873658 2024-04-04T22:50:02.815285343Z [2024-04-04T22:50:02.814+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:50:02.815499765Z [2024-04-04T22:50:02.815+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 22:48:00+00:00, run_id=scheduled__2024-04-04T22:48:00+00:00, run_start_date=2024-04-04 22:50:00.376257+00:00, run_end_date=2024-04-04 22:50:02.815195+00:00, run_duration=2.438938, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:48:00+00:00, data_interval_end=2024-04-04 22:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T22:50:02.828437799Z [2024-04-04T22:50:02.828+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T22:50:00+00:00, run_after=2024-04-04T22:52:00+00:00 2024-04-04T22:50:02.862773855Z [2024-04-04T22:50:02.862+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:50:02.862948932Z [2024-04-04T22:50:02.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:49:00+00:00, run_id=scheduled__2024-04-04T22:49:00+00:00, run_start_date=2024-04-04 22:50:00.378724+00:00, run_end_date=2024-04-04 22:50:02.862665+00:00, run_duration=2.483941, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:49:00+00:00, data_interval_end=2024-04-04 22:50:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:50:02.903315579Z [2024-04-04T22:50:02.902+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:50:00+00:00, run_after=2024-04-04T22:51:00+00:00 2024-04-04T22:50:03.030833066Z [2024-04-04T22:50:03.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:48:00+00:00 exited with status success for try_number 1 2024-04-04T22:50:03.036501348Z [2024-04-04T22:50:03.036+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T22:48:00+00:00, map_index=-1, run_start_date=2024-04-04 22:50:01.973912+00:00, run_end_date=2024-04-04 22:50:02.536300+00:00, run_duration=0.562388, state=success, executor_state=success, try_number=1, max_tries=1, job_id=107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:50:00.453898+00:00, queued_by_job_id=1, pid=1686 2024-04-04T22:50:04.203399187Z [2024-04-04T22:50:04.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:49:00+00:00 exited with status success for try_number 1 2024-04-04T22:50:04.226765866Z [2024-04-04T22:50:04.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:49:00+00:00, map_index=-1, run_start_date=2024-04-04 22:50:02.078026+00:00, run_end_date=2024-04-04 22:50:02.725977+00:00, run_duration=0.647951, state=success, executor_state=success, try_number=1, max_tries=1, job_id=108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:50:00.453898+00:00, queued_by_job_id=1, pid=1687 2024-04-04T22:50:05.300823991Z [2024-04-04T22:50:05.300+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:50:05.300853486Z 2024-04-04T22:50:05.300891509Z [2024-04-04T22:50:05.300+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:50:05.301369303Z [2024-04-04T22:50:05.301+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:50:05.301376223Z 2024-04-04T22:50:05.305638726Z [2024-04-04T22:50:05.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-04T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T22:50:05.305873609Z [2024-04-04T22:50:05.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-04T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:50:05.380453785Z [2024-04-04T22:50:05.379+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T22:45:00+00:00 exited with status queued for try_number 1 2024-04-04T22:50:05.380885469Z [2024-04-04T22:50:05.380+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:45:00+00:00 exited with status success for try_number 1 2024-04-04T22:50:05.388676875Z [2024-04-04T22:50:05.388+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c995f58-4578-4825-847b-6f45e976932a 2024-04-04T22:50:05.389031676Z [2024-04-04T22:50:05.388+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T22:45:00+00:00, map_index=-1, run_start_date=2024-04-04 22:50:04.178150+00:00, run_end_date=2024-04-04 22:50:04.754566+00:00, run_duration=0.576416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=109, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:50:00.453898+00:00, queued_by_job_id=1, pid=1716 2024-04-04T22:50:06.528424587Z [2024-04-04T22:50:06.527+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:50:06.528966378Z [2024-04-04T22:50:06.528+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:49:00+00:00, run_id=scheduled__2024-04-04T22:49:00+00:00, run_start_date=2024-04-04 22:50:00.379705+00:00, run_end_date=2024-04-04 22:50:06.528288+00:00, run_duration=6.148583, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:49:00+00:00, data_interval_end=2024-04-04 22:50:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:50:06.539849104Z [2024-04-04T22:50:06.539+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:50:00+00:00, run_after=2024-04-04T22:51:00+00:00 2024-04-04T22:50:06.547432984Z [2024-04-04T22:50:06.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:50:06.547937626Z [2024-04-04T22:50:06.547+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:49:00+00:00, run_id=scheduled__2024-04-04T22:49:00+00:00, run_start_date=2024-04-04 22:50:00.377437+00:00, run_end_date=2024-04-04 22:50:06.547316+00:00, run_duration=6.169879, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:49:00+00:00, data_interval_end=2024-04-04 22:50:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:50:06.561481569Z [2024-04-04T22:50:06.561+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:50:00+00:00, run_after=2024-04-04T22:51:00+00:00 2024-04-04T22:50:06.604578829Z [2024-04-04T22:50:06.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:49:00+00:00 exited with status success for try_number 1 2024-04-04T22:50:06.604663002Z [2024-04-04T22:50:06.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:49:00+00:00 exited with status success for try_number 1 2024-04-04T22:50:06.611610639Z [2024-04-04T22:50:06.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:49:00+00:00, map_index=-1, run_start_date=2024-04-04 22:50:04.220991+00:00, run_end_date=2024-04-04 22:50:05.576485+00:00, run_duration=1.355494, state=success, executor_state=success, try_number=1, max_tries=1, job_id=110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:50:00.453898+00:00, queued_by_job_id=1, pid=1717 2024-04-04T22:50:06.612032792Z [2024-04-04T22:50:06.611+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:49:00+00:00, map_index=-1, run_start_date=2024-04-04 22:50:04.383474+00:00, run_end_date=2024-04-04 22:50:06.196284+00:00, run_duration=1.81281, state=success, executor_state=success, try_number=1, max_tries=1, job_id=111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:50:00.453898+00:00, queued_by_job_id=1, pid=1718 2024-04-04T22:50:07.705839440Z [2024-04-04T22:50:07.705+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:50:07.705864118Z 2024-04-04T22:50:07.706656056Z [2024-04-04T22:50:07.705+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:50:07.707371596Z [2024-04-04T22:50:07.707+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:50:07.707391753Z 2024-04-04T22:50:07.710911038Z [2024-04-04T22:50:07.710+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-04T22:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T22:50:07.711226802Z [2024-04-04T22:50:07.711+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-04T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T22:50:07.773900449Z [2024-04-04T22:50:07.773+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T22:45:00+00:00 exited with status queued for try_number 1 2024-04-04T22:50:07.774254673Z [2024-04-04T22:50:07.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T22:45:00+00:00 exited with status success for try_number 1 2024-04-04T22:50:07.782618134Z [2024-04-04T22:50:07.782+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8d1c1b3-9f8f-468c-9e83-9d7385dbd7c3 2024-04-04T22:50:07.782903058Z [2024-04-04T22:50:07.782+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-04T22:45:00+00:00, map_index=-1, run_start_date=2024-04-04 22:50:06.971443+00:00, run_end_date=2024-04-04 22:50:07.279616+00:00, run_duration=0.308173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=112, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:50:05.301722+00:00, queued_by_job_id=1, pid=1741 2024-04-04T22:50:10.768658714Z [2024-04-04T22:50:10.768+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:50:10.768688548Z 2024-04-04T22:50:10.768705938Z [2024-04-04T22:50:10.768+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:50:10.769247237Z [2024-04-04T22:50:10.769+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:50:10.769261928Z 2024-04-04T22:50:10.771804490Z [2024-04-04T22:50:10.771+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-04T22:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:50:10.771895033Z [2024-04-04T22:50:10.771+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-04T22:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:50:10.836407866Z [2024-04-04T22:50:10.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T22:45:00+00:00 exited with status queued for try_number 1 2024-04-04T22:50:10.836511440Z [2024-04-04T22:50:10.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T22:45:00+00:00 exited with status success for try_number 1 2024-04-04T22:50:10.844011902Z [2024-04-04T22:50:10.843+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23b8c4f3-3715-4231-97b9-b791534dd8c8 2024-04-04T22:50:10.844373893Z [2024-04-04T22:50:10.844+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-04T22:45:00+00:00, map_index=0, run_start_date=2024-04-04 22:50:09.375412+00:00, run_end_date=2024-04-04 22:50:09.723423+00:00, run_duration=0.348011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=113, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:50:07.708002+00:00, queued_by_job_id=1, pid=1759 2024-04-04T22:50:13.882438719Z [2024-04-04T22:50:13.881+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:50:13.882746900Z [2024-04-04T22:50:13.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:45:00+00:00, run_id=scheduled__2024-04-04T22:45:00+00:00, run_start_date=2024-04-04 22:50:00.374578+00:00, run_end_date=2024-04-04 22:50:13.882273+00:00, run_duration=13.507695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:45:00+00:00, data_interval_end=2024-04-04 22:50:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-04T22:50:13.889206884Z [2024-04-04T22:50:13.888+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:50:00+00:00, run_after=2024-04-04T22:55:00+00:00 2024-04-04T22:50:13.920236538Z [2024-04-04T22:50:13.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T22:45:00+00:00 exited with status success for try_number 1 2024-04-04T22:50:13.926444713Z [2024-04-04T22:50:13.926+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-04T22:45:00+00:00, map_index=-1, run_start_date=2024-04-04 22:50:12.781175+00:00, run_end_date=2024-04-04 22:50:13.134488+00:00, run_duration=0.353313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=114, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:50:10.769614+00:00, queued_by_job_id=1, pid=1770 2024-04-04T22:50:39.238519046Z [2024-04-04T22:50:39.237+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-04T22:51:01.059134282Z [2024-04-04T22:51:01.058+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:51:00+00:00, run_after=2024-04-04T22:52:00+00:00 2024-04-04T22:51:01.066911790Z [2024-04-04T22:51:01.066+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:51:01.080563882Z [2024-04-04T22:51:01.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:51:00+00:00, run_after=2024-04-04T22:52:00+00:00 2024-04-04T22:51:01.154915780Z [2024-04-04T22:51:01.154+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T22:51:01.154967343Z 2024-04-04T22:51:01.154975226Z 2024-04-04T22:51:01.154982376Z 2024-04-04T22:51:01.155070462Z [2024-04-04T22:51:01.154+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:51:01.155079574Z [2024-04-04T22:51:01.154+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:51:01.155148863Z [2024-04-04T22:51:01.155+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:51:01.155888918Z [2024-04-04T22:51:01.155+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:51:01.155908551Z 2024-04-04T22:51:01.155915387Z 2024-04-04T22:51:01.155941468Z 2024-04-04T22:51:01.158949537Z [2024-04-04T22:51:01.158+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:51:01.159075699Z [2024-04-04T22:51:01.158+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:51:01.159282684Z [2024-04-04T22:51:01.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:51:01.159374679Z [2024-04-04T22:51:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:51:01.159535822Z [2024-04-04T22:51:01.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:51:01.159652364Z [2024-04-04T22:51:01.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:51:01.672915312Z [2024-04-04T22:51:01.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:50:00+00:00 exited with status queued for try_number 1 2024-04-04T22:51:01.672949558Z [2024-04-04T22:51:01.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:50:00+00:00 exited with status queued for try_number 1 2024-04-04T22:51:01.672998617Z [2024-04-04T22:51:01.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:50:00+00:00 exited with status queued for try_number 1 2024-04-04T22:51:01.689392682Z [2024-04-04T22:51:01.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to be80b24e-7a9f-41e2-91cb-e26ed3b39374 2024-04-04T22:51:01.689453564Z [2024-04-04T22:51:01.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to c599508d-35cc-475e-9205-b703a70fce29 2024-04-04T22:51:01.689620575Z [2024-04-04T22:51:01.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to a933d450-116b-48f2-ba94-1cf1bf33f538 2024-04-04T22:51:03.540107525Z [2024-04-04T22:51:03.539+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:51:03.540448915Z [2024-04-04T22:51:03.540+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:50:00+00:00, run_id=scheduled__2024-04-04T22:50:00+00:00, run_start_date=2024-04-04 22:51:01.091817+00:00, run_end_date=2024-04-04 22:51:03.540121+00:00, run_duration=2.448304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:50:00+00:00, data_interval_end=2024-04-04 22:51:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:51:03.550096132Z [2024-04-04T22:51:03.549+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:51:00+00:00, run_after=2024-04-04T22:52:00+00:00 2024-04-04T22:51:03.639915653Z [2024-04-04T22:51:03.639+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:50:00+00:00 exited with status success for try_number 1 2024-04-04T22:51:03.655010817Z [2024-04-04T22:51:03.654+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:50:00+00:00, map_index=-1, run_start_date=2024-04-04 22:51:02.224150+00:00, run_end_date=2024-04-04 22:51:02.798853+00:00, run_duration=0.574703, state=success, executor_state=success, try_number=1, max_tries=1, job_id=115, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:51:01.156402+00:00, queued_by_job_id=1, pid=1779 2024-04-04T22:51:05.794961493Z [2024-04-04T22:51:05.793+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:51:05.800575147Z [2024-04-04T22:51:05.795+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:50:00+00:00, run_id=scheduled__2024-04-04T22:50:00+00:00, run_start_date=2024-04-04 22:51:01.094656+00:00, run_end_date=2024-04-04 22:51:05.794951+00:00, run_duration=4.700295, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:50:00+00:00, data_interval_end=2024-04-04 22:51:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:51:05.816511685Z [2024-04-04T22:51:05.815+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:51:00+00:00, run_after=2024-04-04T22:52:00+00:00 2024-04-04T22:51:05.857918303Z [2024-04-04T22:51:05.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:50:00+00:00 exited with status success for try_number 1 2024-04-04T22:51:05.865515614Z [2024-04-04T22:51:05.865+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:50:00+00:00, map_index=-1, run_start_date=2024-04-04 22:51:03.502759+00:00, run_end_date=2024-04-04 22:51:05.650375+00:00, run_duration=2.147616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=116, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:51:01.156402+00:00, queued_by_job_id=1, pid=1797 2024-04-04T22:51:06.923569365Z [2024-04-04T22:51:06.922+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:51:06.923902767Z [2024-04-04T22:51:06.923+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:50:00+00:00, run_id=scheduled__2024-04-04T22:50:00+00:00, run_start_date=2024-04-04 22:51:01.093302+00:00, run_end_date=2024-04-04 22:51:06.923374+00:00, run_duration=5.830072, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:50:00+00:00, data_interval_end=2024-04-04 22:51:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:51:06.934703791Z [2024-04-04T22:51:06.934+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:51:00+00:00, run_after=2024-04-04T22:52:00+00:00 2024-04-04T22:51:06.974209787Z [2024-04-04T22:51:06.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:50:00+00:00 exited with status success for try_number 1 2024-04-04T22:51:06.980900938Z [2024-04-04T22:51:06.980+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:50:00+00:00, map_index=-1, run_start_date=2024-04-04 22:51:03.577552+00:00, run_end_date=2024-04-04 22:51:06.146200+00:00, run_duration=2.568648, state=success, executor_state=success, try_number=1, max_tries=1, job_id=117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:51:01.156402+00:00, queued_by_job_id=1, pid=1798 2024-04-04T22:52:00.212099195Z [2024-04-04T22:52:00.211+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:52:00+00:00, run_after=2024-04-04T22:53:00+00:00 2024-04-04T22:52:00.233411823Z [2024-04-04T22:52:00.233+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:52:00+00:00, run_after=2024-04-04T22:53:00+00:00 2024-04-04T22:52:00.244374172Z [2024-04-04T22:52:00.242+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:52:00.253392716Z [2024-04-04T22:52:00.253+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:52:00.329427518Z [2024-04-04T22:52:00.329+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T22:52:00.329449465Z 2024-04-04T22:52:00.329456613Z 2024-04-04T22:52:00.329460399Z 2024-04-04T22:52:00.329463844Z 2024-04-04T22:52:00.329794281Z [2024-04-04T22:52:00.329+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T22:52:00.330122022Z [2024-04-04T22:52:00.329+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:52:00.330273681Z [2024-04-04T22:52:00.330+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:52:00.330444632Z [2024-04-04T22:52:00.330+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:52:00.331071026Z [2024-04-04T22:52:00.330+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:52:00.331077015Z 2024-04-04T22:52:00.331080345Z 2024-04-04T22:52:00.331083529Z 2024-04-04T22:52:00.331086659Z 2024-04-04T22:52:00.334633673Z [2024-04-04T22:52:00.334+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:52:00.334793496Z [2024-04-04T22:52:00.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T22:52:00.335138684Z [2024-04-04T22:52:00.334+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:52:00.335357238Z [2024-04-04T22:52:00.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:52:00.335650000Z [2024-04-04T22:52:00.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:52:00.335831287Z [2024-04-04T22:52:00.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:52:00.336149650Z [2024-04-04T22:52:00.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:52:00.336360849Z [2024-04-04T22:52:00.336+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:52:00.690077335Z [2024-04-04T22:52:00.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:50:00+00:00 exited with status queued for try_number 1 2024-04-04T22:52:00.690337720Z [2024-04-04T22:52:00.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:51:00+00:00 exited with status queued for try_number 1 2024-04-04T22:52:00.690669263Z [2024-04-04T22:52:00.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:51:00+00:00 exited with status queued for try_number 1 2024-04-04T22:52:00.690865971Z [2024-04-04T22:52:00.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:51:00+00:00 exited with status queued for try_number 1 2024-04-04T22:52:00.707969276Z [2024-04-04T22:52:00.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5cb702a-6388-43e3-8724-380a7dcc1fd8 2024-04-04T22:52:00.708265360Z [2024-04-04T22:52:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26d4a1cb-f136-47ce-b2dc-cf614493447e 2024-04-04T22:52:00.708453535Z [2024-04-04T22:52:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to 901c2a90-1f75-463e-8dbc-fede91e3e268 2024-04-04T22:52:00.708643083Z [2024-04-04T22:52:00.708+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64ae89b4-6691-43c0-8bf2-9db6f3cf5edd 2024-04-04T22:52:03.082966322Z [2024-04-04T22:52:03.082+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:52:03.083173462Z [2024-04-04T22:52:03.082+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 22:50:00+00:00, run_id=scheduled__2024-04-04T22:50:00+00:00, run_start_date=2024-04-04 22:52:00.262788+00:00, run_end_date=2024-04-04 22:52:03.082807+00:00, run_duration=2.820019, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:50:00+00:00, data_interval_end=2024-04-04 22:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T22:52:03.096068988Z [2024-04-04T22:52:03.095+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T22:52:00+00:00, run_after=2024-04-04T22:54:00+00:00 2024-04-04T22:52:03.107478173Z [2024-04-04T22:52:03.107+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:52:03.107688926Z [2024-04-04T22:52:03.107+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:51:00+00:00, run_id=scheduled__2024-04-04T22:51:00+00:00, run_start_date=2024-04-04 22:52:00.265201+00:00, run_end_date=2024-04-04 22:52:03.107365+00:00, run_duration=2.842164, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:51:00+00:00, data_interval_end=2024-04-04 22:52:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:52:03.118750513Z [2024-04-04T22:52:03.118+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:52:00+00:00, run_after=2024-04-04T22:53:00+00:00 2024-04-04T22:52:03.177396593Z [2024-04-04T22:52:03.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:50:00+00:00 exited with status success for try_number 1 2024-04-04T22:52:03.177658124Z [2024-04-04T22:52:03.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:51:00+00:00 exited with status success for try_number 1 2024-04-04T22:52:03.187259848Z [2024-04-04T22:52:03.186+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:51:00+00:00, map_index=-1, run_start_date=2024-04-04 22:52:02.310687+00:00, run_end_date=2024-04-04 22:52:02.805289+00:00, run_duration=0.494602, state=success, executor_state=success, try_number=1, max_tries=1, job_id=119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:52:00.332106+00:00, queued_by_job_id=1, pid=1839 2024-04-04T22:52:03.188045843Z [2024-04-04T22:52:03.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T22:50:00+00:00, map_index=-1, run_start_date=2024-04-04 22:52:01.638253+00:00, run_end_date=2024-04-04 22:52:02.223997+00:00, run_duration=0.585744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:52:00.332106+00:00, queued_by_job_id=1, pid=1831 2024-04-04T22:52:05.526264348Z [2024-04-04T22:52:05.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:52:05.526492585Z [2024-04-04T22:52:05.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:51:00+00:00, run_id=scheduled__2024-04-04T22:51:00+00:00, run_start_date=2024-04-04 22:52:00.266362+00:00, run_end_date=2024-04-04 22:52:05.526096+00:00, run_duration=5.259734, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:51:00+00:00, data_interval_end=2024-04-04 22:52:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:52:05.535628285Z [2024-04-04T22:52:05.535+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:52:00+00:00, run_after=2024-04-04T22:53:00+00:00 2024-04-04T22:52:05.542912836Z [2024-04-04T22:52:05.542+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:52:05.543146837Z [2024-04-04T22:52:05.542+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:51:00+00:00, run_id=scheduled__2024-04-04T22:51:00+00:00, run_start_date=2024-04-04 22:52:00.267358+00:00, run_end_date=2024-04-04 22:52:05.542814+00:00, run_duration=5.275456, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:51:00+00:00, data_interval_end=2024-04-04 22:52:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:52:05.552470564Z [2024-04-04T22:52:05.552+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:52:00+00:00, run_after=2024-04-04T22:53:00+00:00 2024-04-04T22:52:05.578451279Z [2024-04-04T22:52:05.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:51:00+00:00 exited with status success for try_number 1 2024-04-04T22:52:05.578606296Z [2024-04-04T22:52:05.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:51:00+00:00 exited with status success for try_number 1 2024-04-04T22:52:05.585019727Z [2024-04-04T22:52:05.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:51:00+00:00, map_index=-1, run_start_date=2024-04-04 22:52:03.078949+00:00, run_end_date=2024-04-04 22:52:04.543662+00:00, run_duration=1.464713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:52:00.332106+00:00, queued_by_job_id=1, pid=1856 2024-04-04T22:52:05.585234442Z [2024-04-04T22:52:05.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:51:00+00:00, map_index=-1, run_start_date=2024-04-04 22:52:03.063480+00:00, run_end_date=2024-04-04 22:52:04.937054+00:00, run_duration=1.873574, state=success, executor_state=success, try_number=1, max_tries=1, job_id=120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:52:00.332106+00:00, queued_by_job_id=1, pid=1855 2024-04-04T22:53:00.172661427Z [2024-04-04T22:53:00.172+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:53:00+00:00, run_after=2024-04-04T22:54:00+00:00 2024-04-04T22:53:00.179668221Z [2024-04-04T22:53:00.179+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:53:00.191836861Z [2024-04-04T22:53:00.191+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:53:00+00:00, run_after=2024-04-04T22:54:00+00:00 2024-04-04T22:53:00.248020579Z [2024-04-04T22:53:00.247+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T22:53:00.248051758Z 2024-04-04T22:53:00.248057437Z 2024-04-04T22:53:00.248062366Z 2024-04-04T22:53:00.248083406Z [2024-04-04T22:53:00.247+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:53:00.248248871Z [2024-04-04T22:53:00.248+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:53:00.248356702Z [2024-04-04T22:53:00.248+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:53:00.248975495Z [2024-04-04T22:53:00.248+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:53:00.248990728Z 2024-04-04T22:53:00.248995861Z 2024-04-04T22:53:00.249012369Z 2024-04-04T22:53:00.251952191Z [2024-04-04T22:53:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:53:00.252106550Z [2024-04-04T22:53:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:53:00.252385194Z [2024-04-04T22:53:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:53:00.252509257Z [2024-04-04T22:53:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:53:00.252733079Z [2024-04-04T22:53:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:53:00.252845488Z [2024-04-04T22:53:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:53:00.660996473Z [2024-04-04T22:53:00.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:52:00+00:00 exited with status queued for try_number 1 2024-04-04T22:53:00.663102805Z [2024-04-04T22:53:00.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:52:00+00:00 exited with status queued for try_number 1 2024-04-04T22:53:00.663680612Z [2024-04-04T22:53:00.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:52:00+00:00 exited with status queued for try_number 1 2024-04-04T22:53:00.679332006Z [2024-04-04T22:53:00.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a5d8b74-9296-4acb-a57d-452e4f6440a8 2024-04-04T22:53:00.679475314Z [2024-04-04T22:53:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to e58cc536-bb1c-422c-b9fb-be83e5d6c719 2024-04-04T22:53:00.679675168Z [2024-04-04T22:53:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 55eaeddf-e38b-423d-b130-18bd1a72e2cf 2024-04-04T22:53:03.236504696Z [2024-04-04T22:53:03.235+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:53:03.236816707Z [2024-04-04T22:53:03.236+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:52:00+00:00, run_id=scheduled__2024-04-04T22:52:00+00:00, run_start_date=2024-04-04 22:53:00.204013+00:00, run_end_date=2024-04-04 22:53:03.236391+00:00, run_duration=3.032378, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:52:00+00:00, data_interval_end=2024-04-04 22:53:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:53:03.250623923Z [2024-04-04T22:53:03.250+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:53:00+00:00, run_after=2024-04-04T22:54:00+00:00 2024-04-04T22:53:03.303631607Z [2024-04-04T22:53:03.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:52:00+00:00 exited with status success for try_number 1 2024-04-04T22:53:03.308878764Z [2024-04-04T22:53:03.308+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:52:00+00:00, map_index=-1, run_start_date=2024-04-04 22:53:01.390064+00:00, run_end_date=2024-04-04 22:53:02.164026+00:00, run_duration=0.773962, state=success, executor_state=success, try_number=1, max_tries=1, job_id=122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:53:00.249683+00:00, queued_by_job_id=1, pid=1888 2024-04-04T22:53:05.283773753Z [2024-04-04T22:53:05.283+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:53:05.284232735Z [2024-04-04T22:53:05.283+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:52:00+00:00, run_id=scheduled__2024-04-04T22:52:00+00:00, run_start_date=2024-04-04 22:53:00.201843+00:00, run_end_date=2024-04-04 22:53:05.283671+00:00, run_duration=5.081828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:52:00+00:00, data_interval_end=2024-04-04 22:53:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:53:05.300848752Z [2024-04-04T22:53:05.300+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:53:00+00:00, run_after=2024-04-04T22:54:00+00:00 2024-04-04T22:53:05.314332623Z [2024-04-04T22:53:05.313+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:53:05.314832198Z [2024-04-04T22:53:05.314+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:52:00+00:00, run_id=scheduled__2024-04-04T22:52:00+00:00, run_start_date=2024-04-04 22:53:00.202989+00:00, run_end_date=2024-04-04 22:53:05.314303+00:00, run_duration=5.111314, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:52:00+00:00, data_interval_end=2024-04-04 22:53:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:53:05.327863463Z [2024-04-04T22:53:05.327+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:53:00+00:00, run_after=2024-04-04T22:54:00+00:00 2024-04-04T22:53:05.365794351Z [2024-04-04T22:53:05.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:52:00+00:00 exited with status success for try_number 1 2024-04-04T22:53:05.365839761Z [2024-04-04T22:53:05.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:52:00+00:00 exited with status success for try_number 1 2024-04-04T22:53:05.372991676Z [2024-04-04T22:53:05.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:52:00+00:00, map_index=-1, run_start_date=2024-04-04 22:53:02.905571+00:00, run_end_date=2024-04-04 22:53:05.035781+00:00, run_duration=2.13021, state=success, executor_state=success, try_number=1, max_tries=1, job_id=124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:53:00.249683+00:00, queued_by_job_id=1, pid=1907 2024-04-04T22:53:05.373137384Z [2024-04-04T22:53:05.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:52:00+00:00, map_index=-1, run_start_date=2024-04-04 22:53:02.836809+00:00, run_end_date=2024-04-04 22:53:04.970861+00:00, run_duration=2.134052, state=success, executor_state=success, try_number=1, max_tries=1, job_id=123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:53:00.249683+00:00, queued_by_job_id=1, pid=1906 2024-04-04T22:54:01.089106317Z [2024-04-04T22:54:01.088+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:54:00+00:00, run_after=2024-04-04T22:55:00+00:00 2024-04-04T22:54:01.097494346Z [2024-04-04T22:54:01.097+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:54:01.113603439Z [2024-04-04T22:54:01.113+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:54:00+00:00, run_after=2024-04-04T22:55:00+00:00 2024-04-04T22:54:01.122127585Z [2024-04-04T22:54:01.121+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:54:01.212837130Z [2024-04-04T22:54:01.212+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T22:54:01.212873452Z 2024-04-04T22:54:01.212891826Z 2024-04-04T22:54:01.212897506Z 2024-04-04T22:54:01.212902142Z 2024-04-04T22:54:01.213672091Z [2024-04-04T22:54:01.212+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T22:54:01.214348872Z [2024-04-04T22:54:01.213+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:54:01.214649530Z [2024-04-04T22:54:01.214+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:54:01.214851379Z [2024-04-04T22:54:01.214+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:54:01.215662655Z [2024-04-04T22:54:01.215+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:54:01.215695657Z 2024-04-04T22:54:01.215702705Z 2024-04-04T22:54:01.215707648Z 2024-04-04T22:54:01.215712139Z 2024-04-04T22:54:01.220468091Z [2024-04-04T22:54:01.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T22:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:54:01.220659116Z [2024-04-04T22:54:01.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T22:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T22:54:01.220975203Z [2024-04-04T22:54:01.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:54:01.221127267Z [2024-04-04T22:54:01.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:54:01.221388593Z [2024-04-04T22:54:01.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:54:01.221584745Z [2024-04-04T22:54:01.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:54:01.221909447Z [2024-04-04T22:54:01.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:54:01.222090918Z [2024-04-04T22:54:01.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:54:01.748710719Z [2024-04-04T22:54:01.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:52:00+00:00 exited with status queued for try_number 1 2024-04-04T22:54:01.748816334Z [2024-04-04T22:54:01.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:53:00+00:00 exited with status queued for try_number 1 2024-04-04T22:54:01.748960390Z [2024-04-04T22:54:01.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:53:00+00:00 exited with status queued for try_number 1 2024-04-04T22:54:01.749082660Z [2024-04-04T22:54:01.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:53:00+00:00 exited with status queued for try_number 1 2024-04-04T22:54:01.766128543Z [2024-04-04T22:54:01.765+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea759698-76ac-4a13-9dea-c36e3963a160 2024-04-04T22:54:01.766153546Z [2024-04-04T22:54:01.765+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66045268-0955-4411-8374-78591eb838de 2024-04-04T22:54:01.766157621Z [2024-04-04T22:54:01.765+0000] {scheduler_job.py:635} INFO - Setting external_id for to 548de1b6-78a4-4eb9-b32e-e2f3dffe07a9 2024-04-04T22:54:01.766161350Z [2024-04-04T22:54:01.765+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d97f53f-07e5-4a89-9847-a690588d1f4d 2024-04-04T22:54:03.038412964Z [2024-04-04T22:54:03.037+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:54:03.039491184Z [2024-04-04T22:54:03.039+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 22:52:00+00:00, run_id=scheduled__2024-04-04T22:52:00+00:00, run_start_date=2024-04-04 22:54:01.135641+00:00, run_end_date=2024-04-04 22:54:03.038318+00:00, run_duration=1.902677, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:52:00+00:00, data_interval_end=2024-04-04 22:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T22:54:03.053574175Z [2024-04-04T22:54:03.053+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T22:54:00+00:00, run_after=2024-04-04T22:56:00+00:00 2024-04-04T22:54:03.143971654Z [2024-04-04T22:54:03.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:52:00+00:00 exited with status success for try_number 1 2024-04-04T22:54:03.150456424Z [2024-04-04T22:54:03.149+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T22:52:00+00:00, map_index=-1, run_start_date=2024-04-04 22:54:02.215823+00:00, run_end_date=2024-04-04 22:54:02.727126+00:00, run_duration=0.511303, state=success, executor_state=success, try_number=1, max_tries=1, job_id=125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:54:01.217053+00:00, queued_by_job_id=1, pid=1938 2024-04-04T22:54:04.196071036Z [2024-04-04T22:54:04.195+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:54:04.196392197Z [2024-04-04T22:54:04.196+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:53:00+00:00, run_id=scheduled__2024-04-04T22:53:00+00:00, run_start_date=2024-04-04 22:54:01.138716+00:00, run_end_date=2024-04-04 22:54:04.195944+00:00, run_duration=3.057228, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:53:00+00:00, data_interval_end=2024-04-04 22:54:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:54:04.208278957Z [2024-04-04T22:54:04.207+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:54:00+00:00, run_after=2024-04-04T22:55:00+00:00 2024-04-04T22:54:04.251343270Z [2024-04-04T22:54:04.250+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:53:00+00:00 exited with status success for try_number 1 2024-04-04T22:54:04.257042020Z [2024-04-04T22:54:04.256+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:53:00+00:00, map_index=-1, run_start_date=2024-04-04 22:54:02.533532+00:00, run_end_date=2024-04-04 22:54:03.117392+00:00, run_duration=0.58386, state=success, executor_state=success, try_number=1, max_tries=1, job_id=126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:54:01.217053+00:00, queued_by_job_id=1, pid=1941 2024-04-04T22:54:06.174250076Z [2024-04-04T22:54:06.173+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:54:06.174550202Z [2024-04-04T22:54:06.174+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:53:00+00:00, run_id=scheduled__2024-04-04T22:53:00+00:00, run_start_date=2024-04-04 22:54:01.140150+00:00, run_end_date=2024-04-04 22:54:06.174221+00:00, run_duration=5.034071, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:53:00+00:00, data_interval_end=2024-04-04 22:54:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:54:06.183912384Z [2024-04-04T22:54:06.183+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:54:00+00:00, run_after=2024-04-04T22:55:00+00:00 2024-04-04T22:54:06.190735865Z [2024-04-04T22:54:06.190+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:54:06.191438148Z [2024-04-04T22:54:06.191+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:53:00+00:00, run_id=scheduled__2024-04-04T22:53:00+00:00, run_start_date=2024-04-04 22:54:01.141431+00:00, run_end_date=2024-04-04 22:54:06.190674+00:00, run_duration=5.049243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:53:00+00:00, data_interval_end=2024-04-04 22:54:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:54:06.201090806Z [2024-04-04T22:54:06.200+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:54:00+00:00, run_after=2024-04-04T22:55:00+00:00 2024-04-04T22:54:06.232647580Z [2024-04-04T22:54:06.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:53:00+00:00 exited with status success for try_number 1 2024-04-04T22:54:06.232669583Z [2024-04-04T22:54:06.230+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:53:00+00:00 exited with status success for try_number 1 2024-04-04T22:54:06.236472498Z [2024-04-04T22:54:06.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:53:00+00:00, map_index=-1, run_start_date=2024-04-04 22:54:03.804587+00:00, run_end_date=2024-04-04 22:54:05.548252+00:00, run_duration=1.743665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:54:01.217053+00:00, queued_by_job_id=1, pid=1965 2024-04-04T22:54:06.236633387Z [2024-04-04T22:54:06.236+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:53:00+00:00, map_index=-1, run_start_date=2024-04-04 22:54:03.749657+00:00, run_end_date=2024-04-04 22:54:05.683751+00:00, run_duration=1.934094, state=success, executor_state=success, try_number=1, max_tries=1, job_id=127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:54:01.217053+00:00, queued_by_job_id=1, pid=1964 2024-04-04T22:55:00.768321531Z [2024-04-04T22:55:00.767+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:55:00+00:00, run_after=2024-04-04T22:56:00+00:00 2024-04-04T22:55:00.782694479Z [2024-04-04T22:55:00.782+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:55:00+00:00, run_after=2024-04-04T22:56:00+00:00 2024-04-04T22:55:00.795272091Z [2024-04-04T22:55:00.794+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:55:00+00:00, run_after=2024-04-04T23:00:00+00:00 2024-04-04T22:55:00.803730829Z [2024-04-04T22:55:00.803+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:55:00.893721484Z [2024-04-04T22:55:00.893+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T22:55:00.893796648Z 2024-04-04T22:55:00.893825996Z 2024-04-04T22:55:00.893830216Z 2024-04-04T22:55:00.893833441Z 2024-04-04T22:55:00.893845498Z [2024-04-04T22:55:00.893+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:55:00.893900358Z [2024-04-04T22:55:00.893+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:55:00.894038793Z [2024-04-04T22:55:00.893+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:55:00.894130629Z [2024-04-04T22:55:00.894+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:55:00.894865939Z [2024-04-04T22:55:00.894+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:55:00.894875907Z 2024-04-04T22:55:00.894879243Z 2024-04-04T22:55:00.894882344Z 2024-04-04T22:55:00.894885536Z 2024-04-04T22:55:00.900554594Z [2024-04-04T22:55:00.900+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T22:55:00.900635239Z [2024-04-04T22:55:00.900+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:55:00.900985632Z [2024-04-04T22:55:00.900+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:55:00.901082170Z [2024-04-04T22:55:00.900+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:55:00.901286580Z [2024-04-04T22:55:00.901+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:55:00.901430180Z [2024-04-04T22:55:00.901+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:55:00.901709860Z [2024-04-04T22:55:00.901+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:55:00.901811059Z [2024-04-04T22:55:00.901+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:55:01.487417822Z [2024-04-04T22:55:01.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:50:00+00:00 exited with status queued for try_number 1 2024-04-04T22:55:01.487539641Z [2024-04-04T22:55:01.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:54:00+00:00 exited with status queued for try_number 1 2024-04-04T22:55:01.487725600Z [2024-04-04T22:55:01.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:54:00+00:00 exited with status queued for try_number 1 2024-04-04T22:55:01.487818258Z [2024-04-04T22:55:01.487+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:54:00+00:00 exited with status queued for try_number 1 2024-04-04T22:55:01.498014911Z [2024-04-04T22:55:01.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to 574e3044-a78b-4a60-a1b7-079ab44ed620 2024-04-04T22:55:01.498112959Z [2024-04-04T22:55:01.497+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62fea454-95ef-4ded-9196-0f8792f148ae 2024-04-04T22:55:01.498349564Z [2024-04-04T22:55:01.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4cbd3470-c923-491f-99e0-4651e0e120e8 2024-04-04T22:55:01.498441730Z [2024-04-04T22:55:01.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8c8d7d7-23b9-449e-9392-b1a32763d889 2024-04-04T22:55:03.265172249Z [2024-04-04T22:55:03.264+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:55:03.265864093Z [2024-04-04T22:55:03.265+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:54:00+00:00, run_id=scheduled__2024-04-04T22:54:00+00:00, run_start_date=2024-04-04 22:55:00.819188+00:00, run_end_date=2024-04-04 22:55:03.265396+00:00, run_duration=2.446208, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:54:00+00:00, data_interval_end=2024-04-04 22:55:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:55:03.278754176Z [2024-04-04T22:55:03.278+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:55:00+00:00, run_after=2024-04-04T22:56:00+00:00 2024-04-04T22:55:03.334104935Z [2024-04-04T22:55:03.333+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:54:00+00:00 exited with status success for try_number 1 2024-04-04T22:55:03.346984077Z [2024-04-04T22:55:03.346+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:54:00+00:00, map_index=-1, run_start_date=2024-04-04 22:55:02.362584+00:00, run_end_date=2024-04-04 22:55:02.792236+00:00, run_duration=0.429652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:55:00.896357+00:00, queued_by_job_id=1, pid=1998 2024-04-04T22:55:04.462032243Z [2024-04-04T22:55:04.461+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:55:04.462057559Z 2024-04-04T22:55:04.462328269Z [2024-04-04T22:55:04.462+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:55:04.463041100Z [2024-04-04T22:55:04.462+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:55:04.463053281Z 2024-04-04T22:55:04.465962092Z [2024-04-04T22:55:04.465+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-04T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T22:55:04.466257799Z [2024-04-04T22:55:04.466+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-04T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:55:04.605660987Z [2024-04-04T22:55:04.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T22:50:00+00:00 exited with status queued for try_number 1 2024-04-04T22:55:04.605846617Z [2024-04-04T22:55:04.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:50:00+00:00 exited with status success for try_number 1 2024-04-04T22:55:04.617707921Z [2024-04-04T22:55:04.617+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28ee7446-0a61-4819-a3e2-f9aab111718f 2024-04-04T22:55:04.618030037Z [2024-04-04T22:55:04.617+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T22:50:00+00:00, map_index=-1, run_start_date=2024-04-04 22:55:03.740967+00:00, run_end_date=2024-04-04 22:55:04.252325+00:00, run_duration=0.511358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=130, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:55:00.896357+00:00, queued_by_job_id=1, pid=2023 2024-04-04T22:55:05.802541606Z [2024-04-04T22:55:05.802+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:55:05.802846579Z [2024-04-04T22:55:05.802+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:54:00+00:00, run_id=scheduled__2024-04-04T22:54:00+00:00, run_start_date=2024-04-04 22:55:00.820226+00:00, run_end_date=2024-04-04 22:55:05.802518+00:00, run_duration=4.982292, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:54:00+00:00, data_interval_end=2024-04-04 22:55:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:55:05.812815788Z [2024-04-04T22:55:05.812+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:55:00+00:00, run_after=2024-04-04T22:56:00+00:00 2024-04-04T22:55:05.887799671Z [2024-04-04T22:55:05.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:54:00+00:00 exited with status success for try_number 1 2024-04-04T22:55:05.893333942Z [2024-04-04T22:55:05.892+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:54:00+00:00, map_index=-1, run_start_date=2024-04-04 22:55:03.753038+00:00, run_end_date=2024-04-04 22:55:05.328444+00:00, run_duration=1.575406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:55:00.896357+00:00, queued_by_job_id=1, pid=2022 2024-04-04T22:55:06.655316981Z [2024-04-04T22:55:06.654+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:55:06.655351347Z 2024-04-04T22:55:06.655639446Z [2024-04-04T22:55:06.655+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:55:06.656416515Z [2024-04-04T22:55:06.656+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:55:06.656430741Z 2024-04-04T22:55:06.661621985Z [2024-04-04T22:55:06.661+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-04T22:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T22:55:06.662246466Z [2024-04-04T22:55:06.661+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-04T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T22:55:06.732506878Z [2024-04-04T22:55:06.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T22:50:00+00:00 exited with status queued for try_number 1 2024-04-04T22:55:06.732842082Z [2024-04-04T22:55:06.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:54:00+00:00 exited with status success for try_number 1 2024-04-04T22:55:06.733112594Z [2024-04-04T22:55:06.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T22:50:00+00:00 exited with status success for try_number 1 2024-04-04T22:55:06.743729859Z [2024-04-04T22:55:06.743+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:54:00+00:00, map_index=-1, run_start_date=2024-04-04 22:55:03.927116+00:00, run_end_date=2024-04-04 22:55:06.529411+00:00, run_duration=2.602295, state=success, executor_state=success, try_number=1, max_tries=1, job_id=132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:55:00.896357+00:00, queued_by_job_id=1, pid=2024 2024-04-04T22:55:06.744090924Z [2024-04-04T22:55:06.743+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-04T22:50:00+00:00, map_index=-1, run_start_date=2024-04-04 22:55:06.203081+00:00, run_end_date=2024-04-04 22:55:06.536263+00:00, run_duration=0.333182, state=success, executor_state=success, try_number=1, max_tries=1, job_id=133, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:55:04.463617+00:00, queued_by_job_id=1, pid=2047 2024-04-04T22:55:06.744581920Z [2024-04-04T22:55:06.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76de8a75-306e-4d21-9179-c1bf44546a83 2024-04-04T22:55:06.815897737Z [2024-04-04T22:55:06.815+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:55:06.816311771Z [2024-04-04T22:55:06.815+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:54:00+00:00, run_id=scheduled__2024-04-04T22:54:00+00:00, run_start_date=2024-04-04 22:55:00.821234+00:00, run_end_date=2024-04-04 22:55:06.815788+00:00, run_duration=5.994554, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:54:00+00:00, data_interval_end=2024-04-04 22:55:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:55:06.832204456Z [2024-04-04T22:55:06.831+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:55:00+00:00, run_after=2024-04-04T22:56:00+00:00 2024-04-04T22:55:09.103802437Z [2024-04-04T22:55:09.103+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T22:55:09.103864759Z 2024-04-04T22:55:09.103877383Z [2024-04-04T22:55:09.103+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:55:09.104491519Z [2024-04-04T22:55:09.104+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:55:09.104538695Z 2024-04-04T22:55:09.107790151Z [2024-04-04T22:55:09.107+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-04T22:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:55:09.107887242Z [2024-04-04T22:55:09.107+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-04T22:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T22:55:09.177795250Z [2024-04-04T22:55:09.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T22:50:00+00:00 exited with status queued for try_number 1 2024-04-04T22:55:09.178111589Z [2024-04-04T22:55:09.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T22:50:00+00:00 exited with status success for try_number 1 2024-04-04T22:55:09.189211564Z [2024-04-04T22:55:09.188+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b1a8f8e-b3f4-4aec-91ad-0195b1b58769 2024-04-04T22:55:09.189464589Z [2024-04-04T22:55:09.189+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-04T22:50:00+00:00, map_index=0, run_start_date=2024-04-04 22:55:08.367198+00:00, run_end_date=2024-04-04 22:55:08.728365+00:00, run_duration=0.361167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=134, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:55:06.656890+00:00, queued_by_job_id=1, pid=2055 2024-04-04T22:55:11.462531082Z [2024-04-04T22:55:11.461+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:55:11.463238316Z [2024-04-04T22:55:11.462+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:50:00+00:00, run_id=scheduled__2024-04-04T22:50:00+00:00, run_start_date=2024-04-04 22:55:00.818009+00:00, run_end_date=2024-04-04 22:55:11.462462+00:00, run_duration=10.644453, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:50:00+00:00, data_interval_end=2024-04-04 22:55:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-04T22:55:11.477706605Z [2024-04-04T22:55:11.476+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:55:00+00:00, run_after=2024-04-04T23:00:00+00:00 2024-04-04T22:55:11.554738702Z [2024-04-04T22:55:11.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T22:50:00+00:00 exited with status success for try_number 1 2024-04-04T22:55:11.562439486Z [2024-04-04T22:55:11.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-04T22:50:00+00:00, map_index=-1, run_start_date=2024-04-04 22:55:10.856776+00:00, run_end_date=2024-04-04 22:55:11.338949+00:00, run_duration=0.482173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:55:09.104854+00:00, queued_by_job_id=1, pid=2072 2024-04-04T22:55:39.296609982Z [2024-04-04T22:55:39.296+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-04T22:56:00.565976266Z [2024-04-04T22:56:00.564+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:56:00+00:00, run_after=2024-04-04T22:57:00+00:00 2024-04-04T22:56:00.589223565Z [2024-04-04T22:56:00.588+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:56:00.604957568Z [2024-04-04T22:56:00.604+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:56:00+00:00, run_after=2024-04-04T22:57:00+00:00 2024-04-04T22:56:00.612218062Z [2024-04-04T22:56:00.611+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:56:00.688972955Z [2024-04-04T22:56:00.688+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T22:56:00.688991823Z 2024-04-04T22:56:00.688996180Z 2024-04-04T22:56:00.688999311Z 2024-04-04T22:56:00.689002646Z 2024-04-04T22:56:00.689238675Z [2024-04-04T22:56:00.688+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T22:56:00.689445833Z [2024-04-04T22:56:00.689+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:56:00.689615650Z [2024-04-04T22:56:00.689+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:56:00.689781581Z [2024-04-04T22:56:00.689+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:56:00.690393585Z [2024-04-04T22:56:00.690+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:56:00.690405231Z 2024-04-04T22:56:00.690409424Z 2024-04-04T22:56:00.690413129Z 2024-04-04T22:56:00.690416329Z 2024-04-04T22:56:00.694473474Z [2024-04-04T22:56:00.694+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T22:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:56:00.694790264Z [2024-04-04T22:56:00.694+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T22:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T22:56:00.695134587Z [2024-04-04T22:56:00.694+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:56:00.695323590Z [2024-04-04T22:56:00.695+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:56:00.695768041Z [2024-04-04T22:56:00.695+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:56:00.695778352Z [2024-04-04T22:56:00.695+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:56:00.696054360Z [2024-04-04T22:56:00.695+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:56:00.696246467Z [2024-04-04T22:56:00.696+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:56:01.556986738Z [2024-04-04T22:56:01.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:54:00+00:00 exited with status queued for try_number 1 2024-04-04T22:56:01.560054386Z [2024-04-04T22:56:01.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:55:00+00:00 exited with status queued for try_number 1 2024-04-04T22:56:01.560251927Z [2024-04-04T22:56:01.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:55:00+00:00 exited with status queued for try_number 1 2024-04-04T22:56:01.560429355Z [2024-04-04T22:56:01.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:55:00+00:00 exited with status queued for try_number 1 2024-04-04T22:56:01.589123251Z [2024-04-04T22:56:01.588+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30685357-40de-4c6e-bdc0-1bd58cc42d2c 2024-04-04T22:56:01.592121740Z [2024-04-04T22:56:01.591+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41c73653-74cd-49f9-8f6e-1a76f8ab5e54 2024-04-04T22:56:01.592421021Z [2024-04-04T22:56:01.592+0000] {scheduler_job.py:635} INFO - Setting external_id for to 475efa10-e2e0-41b6-bd2f-9083b8294e05 2024-04-04T22:56:01.592702767Z [2024-04-04T22:56:01.592+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8dbc849-6ce7-4f8d-b94e-5d9e1e5a9376 2024-04-04T22:56:03.794800161Z [2024-04-04T22:56:03.794+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:56:03.795276931Z [2024-04-04T22:56:03.795+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 22:54:00+00:00, run_id=scheduled__2024-04-04T22:54:00+00:00, run_start_date=2024-04-04 22:56:00.621802+00:00, run_end_date=2024-04-04 22:56:03.794859+00:00, run_duration=3.173057, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:54:00+00:00, data_interval_end=2024-04-04 22:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T22:56:03.803390789Z [2024-04-04T22:56:03.803+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T22:56:00+00:00, run_after=2024-04-04T22:58:00+00:00 2024-04-04T22:56:03.812708720Z [2024-04-04T22:56:03.812+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:56:03.812999482Z [2024-04-04T22:56:03.812+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:55:00+00:00, run_id=scheduled__2024-04-04T22:55:00+00:00, run_start_date=2024-04-04 22:56:00.623572+00:00, run_end_date=2024-04-04 22:56:03.812668+00:00, run_duration=3.189096, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:55:00+00:00, data_interval_end=2024-04-04 22:56:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:56:03.825463870Z [2024-04-04T22:56:03.825+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:56:00+00:00, run_after=2024-04-04T22:57:00+00:00 2024-04-04T22:56:03.891512263Z [2024-04-04T22:56:03.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:54:00+00:00 exited with status success for try_number 1 2024-04-04T22:56:03.892047217Z [2024-04-04T22:56:03.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:55:00+00:00 exited with status success for try_number 1 2024-04-04T22:56:03.904540500Z [2024-04-04T22:56:03.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T22:54:00+00:00, map_index=-1, run_start_date=2024-04-04 22:56:02.514490+00:00, run_end_date=2024-04-04 22:56:03.157704+00:00, run_duration=0.643214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=136, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:56:00.691388+00:00, queued_by_job_id=1, pid=2085 2024-04-04T22:56:03.904964220Z [2024-04-04T22:56:03.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:55:00+00:00, map_index=-1, run_start_date=2024-04-04 22:56:02.784715+00:00, run_end_date=2024-04-04 22:56:03.293622+00:00, run_duration=0.508907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=137, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:56:00.691388+00:00, queued_by_job_id=1, pid=2087 2024-04-04T22:56:06.074540967Z [2024-04-04T22:56:06.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:56:06.075236092Z [2024-04-04T22:56:06.074+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:55:00+00:00, run_id=scheduled__2024-04-04T22:55:00+00:00, run_start_date=2024-04-04 22:56:00.626144+00:00, run_end_date=2024-04-04 22:56:06.074566+00:00, run_duration=5.448422, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:55:00+00:00, data_interval_end=2024-04-04 22:56:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:56:06.088831511Z [2024-04-04T22:56:06.088+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:56:00+00:00, run_after=2024-04-04T22:57:00+00:00 2024-04-04T22:56:06.137542161Z [2024-04-04T22:56:06.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:55:00+00:00 exited with status success for try_number 1 2024-04-04T22:56:06.153997104Z [2024-04-04T22:56:06.153+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:55:00+00:00, map_index=-1, run_start_date=2024-04-04 22:56:03.978663+00:00, run_end_date=2024-04-04 22:56:05.972073+00:00, run_duration=1.99341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=139, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:56:00.691388+00:00, queued_by_job_id=1, pid=2110 2024-04-04T22:56:07.197834321Z [2024-04-04T22:56:07.196+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:56:07.197857647Z [2024-04-04T22:56:07.197+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:55:00+00:00, run_id=scheduled__2024-04-04T22:55:00+00:00, run_start_date=2024-04-04 22:56:00.624893+00:00, run_end_date=2024-04-04 22:56:07.197106+00:00, run_duration=6.572213, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:55:00+00:00, data_interval_end=2024-04-04 22:56:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:56:07.206607562Z [2024-04-04T22:56:07.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:56:00+00:00, run_after=2024-04-04T22:57:00+00:00 2024-04-04T22:56:07.246511207Z [2024-04-04T22:56:07.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:55:00+00:00 exited with status success for try_number 1 2024-04-04T22:56:07.251810700Z [2024-04-04T22:56:07.251+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:55:00+00:00, map_index=-1, run_start_date=2024-04-04 22:56:03.919885+00:00, run_end_date=2024-04-04 22:56:06.397062+00:00, run_duration=2.477177, state=success, executor_state=success, try_number=1, max_tries=1, job_id=138, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:56:00.691388+00:00, queued_by_job_id=1, pid=2109 2024-04-04T22:57:00.778370447Z [2024-04-04T22:57:00.777+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:57:00+00:00, run_after=2024-04-04T22:58:00+00:00 2024-04-04T22:57:00.801180496Z [2024-04-04T22:57:00.800+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:57:00+00:00, run_after=2024-04-04T22:58:00+00:00 2024-04-04T22:57:00.816962302Z [2024-04-04T22:57:00.816+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:57:00.930558237Z [2024-04-04T22:57:00.930+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T22:57:00.930650665Z 2024-04-04T22:57:00.930657781Z 2024-04-04T22:57:00.930662827Z 2024-04-04T22:57:00.930668271Z [2024-04-04T22:57:00.930+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:57:00.930722385Z [2024-04-04T22:57:00.930+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:57:00.930733674Z [2024-04-04T22:57:00.930+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:57:00.931873961Z [2024-04-04T22:57:00.931+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:57:00.931897441Z 2024-04-04T22:57:00.931903111Z 2024-04-04T22:57:00.931908678Z 2024-04-04T22:57:00.936141606Z [2024-04-04T22:57:00.935+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:57:00.936274886Z [2024-04-04T22:57:00.936+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:57:00.936568728Z [2024-04-04T22:57:00.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:57:00.936630224Z [2024-04-04T22:57:00.936+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:57:00.937141336Z [2024-04-04T22:57:00.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:57:00.937155686Z [2024-04-04T22:57:00.936+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:57:01.515090917Z [2024-04-04T22:57:01.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:56:00+00:00 exited with status queued for try_number 1 2024-04-04T22:57:01.515277228Z [2024-04-04T22:57:01.514+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:56:00+00:00 exited with status queued for try_number 1 2024-04-04T22:57:01.515424263Z [2024-04-04T22:57:01.515+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:56:00+00:00 exited with status queued for try_number 1 2024-04-04T22:57:01.546595870Z [2024-04-04T22:57:01.546+0000] {scheduler_job.py:635} INFO - Setting external_id for to e24c02b2-a37f-4f79-8dfd-7089eb16c838 2024-04-04T22:57:01.546789714Z [2024-04-04T22:57:01.546+0000] {scheduler_job.py:635} INFO - Setting external_id for to f094b5a1-3909-4711-a6b0-8e74088158ef 2024-04-04T22:57:01.546967092Z [2024-04-04T22:57:01.546+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a8a1c59-a376-4765-a35f-1482642d791c 2024-04-04T22:57:05.051350734Z [2024-04-04T22:57:05.050+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:57:05.051945891Z [2024-04-04T22:57:05.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:56:00+00:00, run_id=scheduled__2024-04-04T22:56:00+00:00, run_start_date=2024-04-04 22:57:00.842276+00:00, run_end_date=2024-04-04 22:57:05.051438+00:00, run_duration=4.209162, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:56:00+00:00, data_interval_end=2024-04-04 22:57:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:57:05.064766838Z [2024-04-04T22:57:05.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:57:00+00:00, run_after=2024-04-04T22:58:00+00:00 2024-04-04T22:57:05.121540735Z [2024-04-04T22:57:05.121+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:56:00+00:00 exited with status success for try_number 1 2024-04-04T22:57:05.130623713Z [2024-04-04T22:57:05.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:56:00+00:00, map_index=-1, run_start_date=2024-04-04 22:57:03.673273+00:00, run_end_date=2024-04-04 22:57:04.456817+00:00, run_duration=0.783544, state=success, executor_state=success, try_number=1, max_tries=1, job_id=140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:57:00.933019+00:00, queued_by_job_id=1, pid=2142 2024-04-04T22:57:08.321504620Z [2024-04-04T22:57:08.320+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:57:08.322179245Z [2024-04-04T22:57:08.321+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:56:00+00:00, run_id=scheduled__2024-04-04T22:56:00+00:00, run_start_date=2024-04-04 22:57:00.840545+00:00, run_end_date=2024-04-04 22:57:08.321307+00:00, run_duration=7.480762, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:56:00+00:00, data_interval_end=2024-04-04 22:57:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:57:08.335843045Z [2024-04-04T22:57:08.335+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:57:00+00:00, run_after=2024-04-04T22:58:00+00:00 2024-04-04T22:57:08.373260562Z [2024-04-04T22:57:08.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:56:00+00:00 exited with status success for try_number 1 2024-04-04T22:57:08.378453961Z [2024-04-04T22:57:08.378+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:56:00+00:00, map_index=-1, run_start_date=2024-04-04 22:57:05.295517+00:00, run_end_date=2024-04-04 22:57:07.842287+00:00, run_duration=2.54677, state=success, executor_state=success, try_number=1, max_tries=1, job_id=141, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:57:00.933019+00:00, queued_by_job_id=1, pid=2160 2024-04-04T22:57:09.050179293Z [2024-04-04T22:57:09.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:57:09.050405122Z [2024-04-04T22:57:09.050+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:56:00+00:00, run_id=scheduled__2024-04-04T22:56:00+00:00, run_start_date=2024-04-04 22:57:00.843773+00:00, run_end_date=2024-04-04 22:57:09.049969+00:00, run_duration=8.206196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:56:00+00:00, data_interval_end=2024-04-04 22:57:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:57:09.060667019Z [2024-04-04T22:57:09.060+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:57:00+00:00, run_after=2024-04-04T22:58:00+00:00 2024-04-04T22:57:09.103288594Z [2024-04-04T22:57:09.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:56:00+00:00 exited with status success for try_number 1 2024-04-04T22:57:09.108747454Z [2024-04-04T22:57:09.108+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:56:00+00:00, map_index=-1, run_start_date=2024-04-04 22:57:05.384672+00:00, run_end_date=2024-04-04 22:57:08.672394+00:00, run_duration=3.287722, state=success, executor_state=success, try_number=1, max_tries=1, job_id=142, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:57:00.933019+00:00, queued_by_job_id=1, pid=2161 2024-04-04T22:58:01.051430818Z [2024-04-04T22:58:01.051+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:58:00+00:00, run_after=2024-04-04T22:59:00+00:00 2024-04-04T22:58:01.090336624Z [2024-04-04T22:58:01.089+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:58:00+00:00, run_after=2024-04-04T22:59:00+00:00 2024-04-04T22:58:01.104593621Z [2024-04-04T22:58:01.104+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:58:01.132497427Z [2024-04-04T22:58:01.132+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:58:01.554692023Z [2024-04-04T22:58:01.554+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T22:58:01.554722730Z 2024-04-04T22:58:01.554732704Z 2024-04-04T22:58:01.554738673Z 2024-04-04T22:58:01.554743697Z 2024-04-04T22:58:01.554751344Z [2024-04-04T22:58:01.554+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T22:58:01.554839035Z [2024-04-04T22:58:01.554+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:58:01.554846620Z [2024-04-04T22:58:01.554+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:58:01.554851629Z [2024-04-04T22:58:01.554+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:58:01.565242574Z [2024-04-04T22:58:01.564+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:58:01.565274042Z 2024-04-04T22:58:01.565280681Z 2024-04-04T22:58:01.565286147Z 2024-04-04T22:58:01.565309600Z 2024-04-04T22:58:01.571443324Z [2024-04-04T22:58:01.570+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T22:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:58:01.571798150Z [2024-04-04T22:58:01.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T22:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T22:58:01.572213707Z [2024-04-04T22:58:01.571+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:58:01.572371108Z [2024-04-04T22:58:01.572+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:58:01.572698333Z [2024-04-04T22:58:01.572+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:58:01.572866453Z [2024-04-04T22:58:01.572+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:58:01.573254940Z [2024-04-04T22:58:01.573+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:58:01.573325538Z [2024-04-04T22:58:01.573+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:58:02.712957548Z [2024-04-04T22:58:02.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:56:00+00:00 exited with status queued for try_number 1 2024-04-04T22:58:02.715662739Z [2024-04-04T22:58:02.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:57:00+00:00 exited with status queued for try_number 1 2024-04-04T22:58:02.716734563Z [2024-04-04T22:58:02.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:57:00+00:00 exited with status queued for try_number 1 2024-04-04T22:58:02.720116507Z [2024-04-04T22:58:02.719+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:57:00+00:00 exited with status queued for try_number 1 2024-04-04T22:58:02.748403023Z [2024-04-04T22:58:02.747+0000] {scheduler_job.py:635} INFO - Setting external_id for to 687c0fec-37da-4b80-b71b-f4aee687977a 2024-04-04T22:58:02.748997829Z [2024-04-04T22:58:02.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2405ca3b-dca5-4c22-a5db-722925b350b1 2024-04-04T22:58:02.751847663Z [2024-04-04T22:58:02.751+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59296d9b-3db0-465f-bfe5-0160ded1b65e 2024-04-04T22:58:02.752376236Z [2024-04-04T22:58:02.752+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5be756d3-2f63-43d3-b2f0-9956753e7648 2024-04-04T22:58:05.006300446Z [2024-04-04T22:58:05.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:58:05.006511863Z [2024-04-04T22:58:05.006+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:57:00+00:00, run_id=scheduled__2024-04-04T22:57:00+00:00, run_start_date=2024-04-04 22:58:01.183010+00:00, run_end_date=2024-04-04 22:58:05.006203+00:00, run_duration=3.823193, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:57:00+00:00, data_interval_end=2024-04-04 22:58:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:58:05.027541554Z [2024-04-04T22:58:05.027+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:58:00+00:00, run_after=2024-04-04T22:59:00+00:00 2024-04-04T22:58:05.165548363Z [2024-04-04T22:58:05.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:57:00+00:00 exited with status success for try_number 1 2024-04-04T22:58:05.191706721Z [2024-04-04T22:58:05.184+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:57:00+00:00, map_index=-1, run_start_date=2024-04-04 22:58:04.131907+00:00, run_end_date=2024-04-04 22:58:04.851195+00:00, run_duration=0.719288, state=success, executor_state=success, try_number=1, max_tries=1, job_id=144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:58:01.566531+00:00, queued_by_job_id=1, pid=2194 2024-04-04T22:58:06.325398834Z [2024-04-04T22:58:06.324+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:58:06.325425173Z [2024-04-04T22:58:06.324+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 22:56:00+00:00, run_id=scheduled__2024-04-04T22:56:00+00:00, run_start_date=2024-04-04 22:58:01.176216+00:00, run_end_date=2024-04-04 22:58:06.324332+00:00, run_duration=5.148116, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:56:00+00:00, data_interval_end=2024-04-04 22:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T22:58:06.336332033Z [2024-04-04T22:58:06.336+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T22:58:00+00:00, run_after=2024-04-04T23:00:00+00:00 2024-04-04T22:58:06.433740289Z [2024-04-04T22:58:06.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:56:00+00:00 exited with status success for try_number 1 2024-04-04T22:58:06.440483646Z [2024-04-04T22:58:06.440+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T22:56:00+00:00, map_index=-1, run_start_date=2024-04-04 22:58:04.200514+00:00, run_end_date=2024-04-04 22:58:05.116336+00:00, run_duration=0.915822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:58:01.566531+00:00, queued_by_job_id=1, pid=2195 2024-04-04T22:58:08.573971725Z [2024-04-04T22:58:08.573+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:58:08.574128064Z [2024-04-04T22:58:08.573+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:57:00+00:00, run_id=scheduled__2024-04-04T22:57:00+00:00, run_start_date=2024-04-04 22:58:01.189495+00:00, run_end_date=2024-04-04 22:58:08.573829+00:00, run_duration=7.384334, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:57:00+00:00, data_interval_end=2024-04-04 22:58:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:58:08.585827913Z [2024-04-04T22:58:08.585+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:58:00+00:00, run_after=2024-04-04T22:59:00+00:00 2024-04-04T22:58:08.622857240Z [2024-04-04T22:58:08.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:57:00+00:00 exited with status success for try_number 1 2024-04-04T22:58:08.628507863Z [2024-04-04T22:58:08.628+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:57:00+00:00, map_index=-1, run_start_date=2024-04-04 22:58:05.980231+00:00, run_end_date=2024-04-04 22:58:07.461373+00:00, run_duration=1.481142, state=success, executor_state=success, try_number=1, max_tries=1, job_id=145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:58:01.566531+00:00, queued_by_job_id=1, pid=2213 2024-04-04T22:58:09.675513701Z [2024-04-04T22:58:09.675+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:58:09.675909257Z [2024-04-04T22:58:09.675+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:57:00+00:00, run_id=scheduled__2024-04-04T22:57:00+00:00, run_start_date=2024-04-04 22:58:01.196267+00:00, run_end_date=2024-04-04 22:58:09.675410+00:00, run_duration=8.479143, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:57:00+00:00, data_interval_end=2024-04-04 22:58:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:58:09.684813484Z [2024-04-04T22:58:09.684+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:58:00+00:00, run_after=2024-04-04T22:59:00+00:00 2024-04-04T22:58:09.720478491Z [2024-04-04T22:58:09.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:57:00+00:00 exited with status success for try_number 1 2024-04-04T22:58:09.731330282Z [2024-04-04T22:58:09.730+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:57:00+00:00, map_index=-1, run_start_date=2024-04-04 22:58:06.346459+00:00, run_end_date=2024-04-04 22:58:08.977304+00:00, run_duration=2.630845, state=success, executor_state=success, try_number=1, max_tries=1, job_id=146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:58:01.566531+00:00, queued_by_job_id=1, pid=2219 2024-04-04T22:59:00.148416307Z [2024-04-04T22:59:00.147+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:59:00+00:00, run_after=2024-04-04T23:00:00+00:00 2024-04-04T22:59:00.168164210Z [2024-04-04T22:59:00.167+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:59:00+00:00, run_after=2024-04-04T23:00:00+00:00 2024-04-04T22:59:00.176556488Z [2024-04-04T22:59:00.176+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T22:59:00.244331786Z [2024-04-04T22:59:00.243+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T22:59:00.244361904Z 2024-04-04T22:59:00.244372494Z 2024-04-04T22:59:00.244377392Z 2024-04-04T22:59:00.244390930Z [2024-04-04T22:59:00.244+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:59:00.244426354Z [2024-04-04T22:59:00.244+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T22:59:00.244557211Z [2024-04-04T22:59:00.244+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T22:59:00.245291333Z [2024-04-04T22:59:00.245+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T22:59:00.245308656Z 2024-04-04T22:59:00.245312918Z 2024-04-04T22:59:00.245316251Z 2024-04-04T22:59:00.248402503Z [2024-04-04T22:59:00.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:59:00.248522062Z [2024-04-04T22:59:00.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T22:59:00.248722909Z [2024-04-04T22:59:00.248+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:59:00.248811535Z [2024-04-04T22:59:00.248+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T22:59:00.249283904Z [2024-04-04T22:59:00.249+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T22:59:00.249355906Z [2024-04-04T22:59:00.249+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T22:59:00.641943575Z [2024-04-04T22:59:00.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:58:00+00:00 exited with status queued for try_number 1 2024-04-04T22:59:00.642010240Z [2024-04-04T22:59:00.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:58:00+00:00 exited with status queued for try_number 1 2024-04-04T22:59:00.642151036Z [2024-04-04T22:59:00.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:58:00+00:00 exited with status queued for try_number 1 2024-04-04T22:59:00.651928478Z [2024-04-04T22:59:00.651+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56af5497-8619-48ff-a79f-0ea992077200 2024-04-04T22:59:00.652127503Z [2024-04-04T22:59:00.651+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9eb1d6f-ff65-467e-93e8-a78287bc6aa7 2024-04-04T22:59:00.653871372Z [2024-04-04T22:59:00.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23c147c8-d288-4e10-96cf-9e7e8e564963 2024-04-04T22:59:03.737106610Z [2024-04-04T22:59:03.736+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:59:03.737566956Z [2024-04-04T22:59:03.737+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:58:00+00:00, run_id=scheduled__2024-04-04T22:58:00+00:00, run_start_date=2024-04-04 22:59:00.189925+00:00, run_end_date=2024-04-04 22:59:03.737032+00:00, run_duration=3.547107, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:58:00+00:00, data_interval_end=2024-04-04 22:59:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T22:59:03.747292993Z [2024-04-04T22:59:03.746+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T22:59:00+00:00, run_after=2024-04-04T23:00:00+00:00 2024-04-04T22:59:03.815059895Z [2024-04-04T22:59:03.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:58:00+00:00 exited with status success for try_number 1 2024-04-04T22:59:03.832259882Z [2024-04-04T22:59:03.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:58:00+00:00, map_index=-1, run_start_date=2024-04-04 22:59:01.637765+00:00, run_end_date=2024-04-04 22:59:02.822711+00:00, run_duration=1.184946, state=success, executor_state=success, try_number=1, max_tries=1, job_id=147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:59:00.245924+00:00, queued_by_job_id=1, pid=2251 2024-04-04T22:59:07.473764239Z [2024-04-04T22:59:07.473+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:59:07.474285605Z [2024-04-04T22:59:07.474+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:58:00+00:00, run_id=scheduled__2024-04-04T22:58:00+00:00, run_start_date=2024-04-04 22:59:00.188496+00:00, run_end_date=2024-04-04 22:59:07.473933+00:00, run_duration=7.285437, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:58:00+00:00, data_interval_end=2024-04-04 22:59:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T22:59:07.483793260Z [2024-04-04T22:59:07.483+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:59:00+00:00, run_after=2024-04-04T23:00:00+00:00 2024-04-04T22:59:07.530666968Z [2024-04-04T22:59:07.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:58:00+00:00 exited with status success for try_number 1 2024-04-04T22:59:07.537919126Z [2024-04-04T22:59:07.537+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:58:00+00:00, map_index=-1, run_start_date=2024-04-04 22:59:04.134783+00:00, run_end_date=2024-04-04 22:59:07.217528+00:00, run_duration=3.082745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:59:00.245924+00:00, queued_by_job_id=1, pid=2270 2024-04-04T22:59:08.584662978Z [2024-04-04T22:59:08.583+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T22:59:08.585485385Z [2024-04-04T22:59:08.584+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:58:00+00:00, run_id=scheduled__2024-04-04T22:58:00+00:00, run_start_date=2024-04-04 22:59:00.191144+00:00, run_end_date=2024-04-04 22:59:08.584525+00:00, run_duration=8.393381, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:58:00+00:00, data_interval_end=2024-04-04 22:59:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T22:59:08.603821827Z [2024-04-04T22:59:08.603+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T22:59:00+00:00, run_after=2024-04-04T23:00:00+00:00 2024-04-04T22:59:08.660458523Z [2024-04-04T22:59:08.660+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:58:00+00:00 exited with status success for try_number 1 2024-04-04T22:59:08.664909563Z [2024-04-04T22:59:08.664+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:58:00+00:00, map_index=-1, run_start_date=2024-04-04 22:59:03.930255+00:00, run_end_date=2024-04-04 22:59:07.943146+00:00, run_duration=4.012891, state=success, executor_state=success, try_number=1, max_tries=1, job_id=148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 22:59:00.245924+00:00, queued_by_job_id=1, pid=2269 2024-04-04T23:00:00.417031453Z [2024-04-04T23:00:00.416+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:00:00.435636040Z [2024-04-04T23:00:00.435+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:00:00+00:00, run_after=2024-04-04T23:01:00+00:00 2024-04-04T23:00:00.466314304Z [2024-04-04T23:00:00.465+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:00:00+00:00, run_after=2024-04-04T23:01:00+00:00 2024-04-04T23:00:00.499478872Z [2024-04-04T23:00:00.499+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:00:00+00:00, run_after=2024-04-04T23:05:00+00:00 2024-04-04T23:00:00.510068870Z [2024-04-04T23:00:00.509+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:00:00.620737463Z [2024-04-04T23:00:00.620+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-04T23:00:00.620762783Z 2024-04-04T23:00:00.620766349Z 2024-04-04T23:00:00.620774320Z 2024-04-04T23:00:00.620777968Z 2024-04-04T23:00:00.620781157Z 2024-04-04T23:00:00.620817328Z [2024-04-04T23:00:00.620+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:00:00.620836716Z [2024-04-04T23:00:00.620+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:00:00.620901528Z [2024-04-04T23:00:00.620+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:00:00.620978834Z [2024-04-04T23:00:00.620+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:00:00.621043195Z [2024-04-04T23:00:00.620+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:00:00.621779396Z [2024-04-04T23:00:00.621+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:00:00.621790041Z 2024-04-04T23:00:00.621793582Z 2024-04-04T23:00:00.621797153Z 2024-04-04T23:00:00.621800407Z 2024-04-04T23:00:00.621803423Z 2024-04-04T23:00:00.626299638Z [2024-04-04T23:00:00.626+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T23:00:00.626446672Z [2024-04-04T23:00:00.626+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:00:00.626632122Z [2024-04-04T23:00:00.626+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T22:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:00:00.626726074Z [2024-04-04T23:00:00.626+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T22:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:00:00.627076942Z [2024-04-04T23:00:00.626+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:00:00.627145130Z [2024-04-04T23:00:00.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:00:00.627415745Z [2024-04-04T23:00:00.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:00:00.627536309Z [2024-04-04T23:00:00.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:00:00.627777849Z [2024-04-04T23:00:00.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T22:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:00:00.628100692Z [2024-04-04T23:00:00.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T22:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:00:01.617822080Z [2024-04-04T23:00:01.612+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:55:00+00:00 exited with status queued for try_number 1 2024-04-04T23:00:01.618141016Z [2024-04-04T23:00:01.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:58:00+00:00 exited with status queued for try_number 1 2024-04-04T23:00:01.618662091Z [2024-04-04T23:00:01.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:59:00+00:00 exited with status queued for try_number 1 2024-04-04T23:00:01.618678066Z [2024-04-04T23:00:01.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:59:00+00:00 exited with status queued for try_number 1 2024-04-04T23:00:01.618683137Z [2024-04-04T23:00:01.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:59:00+00:00 exited with status queued for try_number 1 2024-04-04T23:00:01.666837294Z [2024-04-04T23:00:01.662+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e875065-d754-4ae4-b1a5-4aeaf0f5c7dd 2024-04-04T23:00:01.668117648Z [2024-04-04T23:00:01.667+0000] {scheduler_job.py:635} INFO - Setting external_id for to 518d1614-8d67-46da-8038-b052cacfdaa0 2024-04-04T23:00:01.669376570Z [2024-04-04T23:00:01.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e0c8e36-bf0f-4336-8f0c-c7470ddcf443 2024-04-04T23:00:01.671245062Z [2024-04-04T23:00:01.670+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7f3b550-6b60-4e4c-911e-1f6a26a24db4 2024-04-04T23:00:01.674164094Z [2024-04-04T23:00:01.673+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3df94ed-1848-41bd-bd05-6cc09ff1a788 2024-04-04T23:00:04.453901993Z [2024-04-04T23:00:04.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:00:04.454707718Z [2024-04-04T23:00:04.454+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 22:58:00+00:00, run_id=scheduled__2024-04-04T22:58:00+00:00, run_start_date=2024-04-04 23:00:00.528232+00:00, run_end_date=2024-04-04 23:00:04.453810+00:00, run_duration=3.925578, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:58:00+00:00, data_interval_end=2024-04-04 23:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:00:04.468819608Z [2024-04-04T23:00:04.468+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:00:00+00:00, run_after=2024-04-04T23:02:00+00:00 2024-04-04T23:00:04.494307318Z [2024-04-04T23:00:04.493+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:00:04.495048606Z [2024-04-04T23:00:04.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 22:59:00+00:00, run_id=scheduled__2024-04-04T22:59:00+00:00, run_start_date=2024-04-04 23:00:00.529925+00:00, run_end_date=2024-04-04 23:00:04.494215+00:00, run_duration=3.96429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:59:00+00:00, data_interval_end=2024-04-04 23:00:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:00:04.512086058Z [2024-04-04T23:00:04.511+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:00:00+00:00, run_after=2024-04-04T23:01:00+00:00 2024-04-04T23:00:04.598540852Z [2024-04-04T23:00:04.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T22:58:00+00:00 exited with status success for try_number 1 2024-04-04T23:00:04.598574069Z [2024-04-04T23:00:04.598+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:59:00+00:00 exited with status success for try_number 1 2024-04-04T23:00:04.607078056Z [2024-04-04T23:00:04.606+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T22:58:00+00:00, map_index=-1, run_start_date=2024-04-04 23:00:03.042569+00:00, run_end_date=2024-04-04 23:00:03.584779+00:00, run_duration=0.54221, state=success, executor_state=success, try_number=1, max_tries=1, job_id=150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:00:00.622898+00:00, queued_by_job_id=1, pid=2299 2024-04-04T23:00:04.607378628Z [2024-04-04T23:00:04.607+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:59:00+00:00, map_index=-1, run_start_date=2024-04-04 23:00:03.533899+00:00, run_end_date=2024-04-04 23:00:04.220107+00:00, run_duration=0.686208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:00:00.622898+00:00, queued_by_job_id=1, pid=2311 2024-04-04T23:00:06.825220696Z [2024-04-04T23:00:06.824+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:00:06.825267083Z 2024-04-04T23:00:06.825635615Z [2024-04-04T23:00:06.825+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:00:06.826407004Z [2024-04-04T23:00:06.826+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:00:06.826456983Z 2024-04-04T23:00:06.829723659Z [2024-04-04T23:00:06.829+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-04T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T23:00:06.830064901Z [2024-04-04T23:00:06.829+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-04T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:00:06.903809752Z [2024-04-04T23:00:06.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T22:55:00+00:00 exited with status queued for try_number 1 2024-04-04T23:00:06.904188828Z [2024-04-04T23:00:06.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T22:55:00+00:00 exited with status success for try_number 1 2024-04-04T23:00:06.915070970Z [2024-04-04T23:00:06.914+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4db19e3e-84b1-49cc-8d38-33190932f99c 2024-04-04T23:00:06.915315363Z [2024-04-04T23:00:06.915+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T22:55:00+00:00, map_index=-1, run_start_date=2024-04-04 23:00:05.416067+00:00, run_end_date=2024-04-04 23:00:05.812803+00:00, run_duration=0.396736, state=success, executor_state=success, try_number=1, max_tries=1, job_id=154, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:00:00.622898+00:00, queued_by_job_id=1, pid=2346 2024-04-04T23:00:07.400650213Z [2024-04-04T23:00:07.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:00:07.400865597Z [2024-04-04T23:00:07.400+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:59:00+00:00, run_id=scheduled__2024-04-04T22:59:00+00:00, run_start_date=2024-04-04 23:00:00.531675+00:00, run_end_date=2024-04-04 23:00:07.400544+00:00, run_duration=6.868869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:59:00+00:00, data_interval_end=2024-04-04 23:00:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:00:07.413030207Z [2024-04-04T23:00:07.412+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:00:00+00:00, run_after=2024-04-04T23:01:00+00:00 2024-04-04T23:00:07.485322286Z [2024-04-04T23:00:07.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:59:00+00:00 exited with status success for try_number 1 2024-04-04T23:00:07.493465128Z [2024-04-04T23:00:07.492+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:59:00+00:00, map_index=-1, run_start_date=2024-04-04 23:00:04.881491+00:00, run_end_date=2024-04-04 23:00:07.244121+00:00, run_duration=2.36263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=152, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:00:00.622898+00:00, queued_by_job_id=1, pid=2330 2024-04-04T23:00:08.549092854Z [2024-04-04T23:00:08.548+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:00:08.549622582Z [2024-04-04T23:00:08.549+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:59:00+00:00, run_id=scheduled__2024-04-04T22:59:00+00:00, run_start_date=2024-04-04 23:00:00.532952+00:00, run_end_date=2024-04-04 23:00:08.549194+00:00, run_duration=8.016242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:59:00+00:00, data_interval_end=2024-04-04 23:00:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:00:08.560669206Z [2024-04-04T23:00:08.560+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:00:00+00:00, run_after=2024-04-04T23:01:00+00:00 2024-04-04T23:00:08.608349214Z [2024-04-04T23:00:08.608+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T22:59:00+00:00 exited with status success for try_number 1 2024-04-04T23:00:08.615488442Z [2024-04-04T23:00:08.615+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T22:59:00+00:00, map_index=-1, run_start_date=2024-04-04 23:00:04.852854+00:00, run_end_date=2024-04-04 23:00:07.775905+00:00, run_duration=2.923051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=153, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:00:00.622898+00:00, queued_by_job_id=1, pid=2329 2024-04-04T23:00:09.684537017Z [2024-04-04T23:00:09.684+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:00:09.684563760Z 2024-04-04T23:00:09.684986501Z [2024-04-04T23:00:09.684+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:00:09.685917331Z [2024-04-04T23:00:09.685+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:00:09.685933046Z 2024-04-04T23:00:09.689681856Z [2024-04-04T23:00:09.689+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-04T22:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T23:00:09.690103604Z [2024-04-04T23:00:09.689+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-04T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T23:00:09.743976950Z [2024-04-04T23:00:09.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T22:55:00+00:00 exited with status queued for try_number 1 2024-04-04T23:00:09.744658578Z [2024-04-04T23:00:09.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T22:55:00+00:00 exited with status success for try_number 1 2024-04-04T23:00:09.752350725Z [2024-04-04T23:00:09.751+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e9f37c7-6dbe-440d-84d4-ae772dbb27b6 2024-04-04T23:00:09.752646348Z [2024-04-04T23:00:09.752+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-04T22:55:00+00:00, map_index=-1, run_start_date=2024-04-04 23:00:08.550388+00:00, run_end_date=2024-04-04 23:00:08.884945+00:00, run_duration=0.334557, state=success, executor_state=success, try_number=1, max_tries=1, job_id=155, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:00:06.826903+00:00, queued_by_job_id=1, pid=2359 2024-04-04T23:00:14.049202106Z [2024-04-04T23:00:14.048+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:00:14.049237286Z 2024-04-04T23:00:14.049243039Z [2024-04-04T23:00:14.048+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:00:14.049274400Z [2024-04-04T23:00:14.049+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:00:14.049298144Z 2024-04-04T23:00:14.058047415Z [2024-04-04T23:00:14.056+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-04T22:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:00:14.058072904Z [2024-04-04T23:00:14.056+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-04T22:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:00:14.172663207Z [2024-04-04T23:00:14.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T22:55:00+00:00 exited with status queued for try_number 1 2024-04-04T23:00:14.172864928Z [2024-04-04T23:00:14.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T22:55:00+00:00 exited with status success for try_number 1 2024-04-04T23:00:14.204006970Z [2024-04-04T23:00:14.203+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a420c28-6baf-4598-b2c5-4ae83c174e5c 2024-04-04T23:00:14.216737241Z [2024-04-04T23:00:14.216+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-04T22:55:00+00:00, map_index=0, run_start_date=2024-04-04 23:00:12.976876+00:00, run_end_date=2024-04-04 23:00:13.639142+00:00, run_duration=0.662266, state=success, executor_state=success, try_number=1, max_tries=1, job_id=156, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:00:09.686604+00:00, queued_by_job_id=1, pid=2377 2024-04-04T23:00:17.880393609Z [2024-04-04T23:00:17.879+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:00:17.880786896Z [2024-04-04T23:00:17.880+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 22:55:00+00:00, run_id=scheduled__2024-04-04T22:55:00+00:00, run_start_date=2024-04-04 23:00:00.526416+00:00, run_end_date=2024-04-04 23:00:17.880258+00:00, run_duration=17.353842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 22:55:00+00:00, data_interval_end=2024-04-04 23:00:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-04T23:00:17.886531845Z [2024-04-04T23:00:17.886+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:00:00+00:00, run_after=2024-04-04T23:05:00+00:00 2024-04-04T23:00:17.913854368Z [2024-04-04T23:00:17.913+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T22:55:00+00:00 exited with status success for try_number 1 2024-04-04T23:00:17.919678131Z [2024-04-04T23:00:17.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-04T22:55:00+00:00, map_index=-1, run_start_date=2024-04-04 23:00:17.108136+00:00, run_end_date=2024-04-04 23:00:17.460596+00:00, run_duration=0.35246, state=success, executor_state=success, try_number=1, max_tries=1, job_id=157, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:00:14.049736+00:00, queued_by_job_id=1, pid=2388 2024-04-04T23:00:39.367609222Z [2024-04-04T23:00:39.367+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-04T23:01:00.495924801Z [2024-04-04T23:01:00.495+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:01:00+00:00, run_after=2024-04-04T23:02:00+00:00 2024-04-04T23:01:00.512812214Z [2024-04-04T23:01:00.512+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:01:00+00:00, run_after=2024-04-04T23:02:00+00:00 2024-04-04T23:01:00.521114029Z [2024-04-04T23:01:00.520+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:01:00.592655339Z [2024-04-04T23:01:00.592+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:01:00.592689078Z 2024-04-04T23:01:00.592694557Z 2024-04-04T23:01:00.592699348Z 2024-04-04T23:01:00.592780153Z [2024-04-04T23:01:00.592+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:01:00.593014199Z [2024-04-04T23:01:00.592+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:01:00.593166799Z [2024-04-04T23:01:00.592+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:01:00.593809207Z [2024-04-04T23:01:00.593+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:01:00.593839090Z 2024-04-04T23:01:00.593844159Z 2024-04-04T23:01:00.593848913Z 2024-04-04T23:01:00.597064232Z [2024-04-04T23:01:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:01:00.597336172Z [2024-04-04T23:01:00.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:01:00.597678295Z [2024-04-04T23:01:00.597+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:01:00.597813613Z [2024-04-04T23:01:00.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:01:00.598077708Z [2024-04-04T23:01:00.597+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:01:00.598205092Z [2024-04-04T23:01:00.598+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:01:01.039850364Z [2024-04-04T23:01:01.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:00:00+00:00 exited with status queued for try_number 1 2024-04-04T23:01:01.043795675Z [2024-04-04T23:01:01.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:00:00+00:00 exited with status queued for try_number 1 2024-04-04T23:01:01.043869404Z [2024-04-04T23:01:01.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:00:00+00:00 exited with status queued for try_number 1 2024-04-04T23:01:01.065273547Z [2024-04-04T23:01:01.064+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8c0b21dc-5d7c-49dc-ac5c-1e2644ad36c5 2024-04-04T23:01:01.065600739Z [2024-04-04T23:01:01.065+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e6d44a6-9d39-479a-a63c-7c22b4ad8aa5 2024-04-04T23:01:01.065869170Z [2024-04-04T23:01:01.065+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3e09e58-7571-47a5-9fa3-20b84ba0b131 2024-04-04T23:01:03.440143041Z [2024-04-04T23:01:03.439+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:01:03.440945094Z [2024-04-04T23:01:03.440+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:00:00+00:00, run_id=scheduled__2024-04-04T23:00:00+00:00, run_start_date=2024-04-04 23:01:00.531376+00:00, run_end_date=2024-04-04 23:01:03.440380+00:00, run_duration=2.909004, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:00:00+00:00, data_interval_end=2024-04-04 23:01:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:01:03.457235481Z [2024-04-04T23:01:03.456+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:01:00+00:00, run_after=2024-04-04T23:02:00+00:00 2024-04-04T23:01:03.547070146Z [2024-04-04T23:01:03.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:00:00+00:00 exited with status success for try_number 1 2024-04-04T23:01:03.562206482Z [2024-04-04T23:01:03.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:00:00+00:00, map_index=-1, run_start_date=2024-04-04 23:01:02.407315+00:00, run_end_date=2024-04-04 23:01:03.009035+00:00, run_duration=0.60172, state=success, executor_state=success, try_number=1, max_tries=1, job_id=158, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:01:00.594517+00:00, queued_by_job_id=1, pid=2398 2024-04-04T23:01:04.635706335Z [2024-04-04T23:01:04.635+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:01:04.637162512Z [2024-04-04T23:01:04.636+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:00:00+00:00, run_id=scheduled__2024-04-04T23:00:00+00:00, run_start_date=2024-04-04 23:01:00.532855+00:00, run_end_date=2024-04-04 23:01:04.635662+00:00, run_duration=4.102807, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:00:00+00:00, data_interval_end=2024-04-04 23:01:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:01:04.647161640Z [2024-04-04T23:01:04.646+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:01:00+00:00, run_after=2024-04-04T23:02:00+00:00 2024-04-04T23:01:04.840940057Z [2024-04-04T23:01:04.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:00:00+00:00 exited with status success for try_number 1 2024-04-04T23:01:04.847181408Z [2024-04-04T23:01:04.846+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:00:00+00:00, map_index=-1, run_start_date=2024-04-04 23:01:03.192555+00:00, run_end_date=2024-04-04 23:01:04.604128+00:00, run_duration=1.411573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=159, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:01:00.594517+00:00, queued_by_job_id=1, pid=2410 2024-04-04T23:01:06.129152216Z [2024-04-04T23:01:06.128+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:01:06.129739600Z [2024-04-04T23:01:06.129+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:00:00+00:00, run_id=scheduled__2024-04-04T23:00:00+00:00, run_start_date=2024-04-04 23:01:00.535197+00:00, run_end_date=2024-04-04 23:01:06.128986+00:00, run_duration=5.593789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:00:00+00:00, data_interval_end=2024-04-04 23:01:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:01:06.146297204Z [2024-04-04T23:01:06.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:01:00+00:00, run_after=2024-04-04T23:02:00+00:00 2024-04-04T23:01:06.183229620Z [2024-04-04T23:01:06.181+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:00:00+00:00 exited with status success for try_number 1 2024-04-04T23:01:06.188436308Z [2024-04-04T23:01:06.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:00:00+00:00, map_index=-1, run_start_date=2024-04-04 23:01:03.597041+00:00, run_end_date=2024-04-04 23:01:05.601117+00:00, run_duration=2.004076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=160, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:01:00.594517+00:00, queued_by_job_id=1, pid=2421 2024-04-04T23:02:00.293952186Z [2024-04-04T23:02:00.293+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:02:00.301572895Z [2024-04-04T23:02:00.301+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:02:00.315946233Z [2024-04-04T23:02:00.315+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:02:00+00:00, run_after=2024-04-04T23:03:00+00:00 2024-04-04T23:02:00.333320947Z [2024-04-04T23:02:00.332+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:02:00+00:00, run_after=2024-04-04T23:03:00+00:00 2024-04-04T23:02:00.431578082Z [2024-04-04T23:02:00.431+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:02:00.431603530Z 2024-04-04T23:02:00.431610330Z 2024-04-04T23:02:00.431613689Z 2024-04-04T23:02:00.431616978Z 2024-04-04T23:02:00.431668258Z [2024-04-04T23:02:00.431+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:02:00.431820794Z [2024-04-04T23:02:00.431+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:02:00.431963277Z [2024-04-04T23:02:00.431+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:02:00.432169512Z [2024-04-04T23:02:00.431+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:02:00.432847252Z [2024-04-04T23:02:00.432+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:02:00.432868467Z 2024-04-04T23:02:00.432874010Z 2024-04-04T23:02:00.432879357Z 2024-04-04T23:02:00.432884271Z 2024-04-04T23:02:00.438296865Z [2024-04-04T23:02:00.437+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:02:00.438327079Z [2024-04-04T23:02:00.438+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:02:00.438792414Z [2024-04-04T23:02:00.438+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:02:00.438918724Z [2024-04-04T23:02:00.438+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:02:00.439204619Z [2024-04-04T23:02:00.439+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:02:00.439305397Z [2024-04-04T23:02:00.439+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:02:00.439461884Z [2024-04-04T23:02:00.439+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:02:00.439536830Z [2024-04-04T23:02:00.439+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:02:00.896235096Z [2024-04-04T23:02:00.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:00:00+00:00 exited with status queued for try_number 1 2024-04-04T23:02:00.896314194Z [2024-04-04T23:02:00.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:01:00+00:00 exited with status queued for try_number 1 2024-04-04T23:02:00.896348385Z [2024-04-04T23:02:00.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:01:00+00:00 exited with status queued for try_number 1 2024-04-04T23:02:00.896494346Z [2024-04-04T23:02:00.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:01:00+00:00 exited with status queued for try_number 1 2024-04-04T23:02:00.917582919Z [2024-04-04T23:02:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0decbe77-027c-43c5-9b38-9bb5a1c22520 2024-04-04T23:02:00.917779636Z [2024-04-04T23:02:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2eff9e02-b939-4dd6-91be-3792f1552501 2024-04-04T23:02:00.918011984Z [2024-04-04T23:02:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to b458aa7c-e0dc-4eef-8ff4-f7db6cf89353 2024-04-04T23:02:00.918255017Z [2024-04-04T23:02:00.918+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76cc814e-5fe1-49a7-964b-0d9983894253 2024-04-04T23:02:03.419871592Z [2024-04-04T23:02:03.419+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:02:03.420428472Z [2024-04-04T23:02:03.420+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:00:00+00:00, run_id=scheduled__2024-04-04T23:00:00+00:00, run_start_date=2024-04-04 23:02:00.345128+00:00, run_end_date=2024-04-04 23:02:03.419937+00:00, run_duration=3.074809, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:00:00+00:00, data_interval_end=2024-04-04 23:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:02:03.430795367Z [2024-04-04T23:02:03.430+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:02:00+00:00, run_after=2024-04-04T23:04:00+00:00 2024-04-04T23:02:03.454005383Z [2024-04-04T23:02:03.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:02:03.454629407Z [2024-04-04T23:02:03.454+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:01:00+00:00, run_id=scheduled__2024-04-04T23:01:00+00:00, run_start_date=2024-04-04 23:02:00.348855+00:00, run_end_date=2024-04-04 23:02:03.453918+00:00, run_duration=3.105063, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:01:00+00:00, data_interval_end=2024-04-04 23:02:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:02:03.471901530Z [2024-04-04T23:02:03.470+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:02:00+00:00, run_after=2024-04-04T23:03:00+00:00 2024-04-04T23:02:03.508483765Z [2024-04-04T23:02:03.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:00:00+00:00 exited with status success for try_number 1 2024-04-04T23:02:03.508777589Z [2024-04-04T23:02:03.508+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:01:00+00:00 exited with status success for try_number 1 2024-04-04T23:02:03.516918716Z [2024-04-04T23:02:03.516+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:00:00+00:00, map_index=-1, run_start_date=2024-04-04 23:02:01.662054+00:00, run_end_date=2024-04-04 23:02:02.436240+00:00, run_duration=0.774186, state=success, executor_state=success, try_number=1, max_tries=1, job_id=161, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:02:00.433874+00:00, queued_by_job_id=1, pid=2446 2024-04-04T23:02:03.517294990Z [2024-04-04T23:02:03.517+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:01:00+00:00, map_index=-1, run_start_date=2024-04-04 23:02:02.178058+00:00, run_end_date=2024-04-04 23:02:02.810414+00:00, run_duration=0.632356, state=success, executor_state=success, try_number=1, max_tries=1, job_id=162, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:02:00.433874+00:00, queued_by_job_id=1, pid=2452 2024-04-04T23:02:05.025964703Z [2024-04-04T23:02:05.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:02:05.026518500Z [2024-04-04T23:02:05.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:01:00+00:00, run_id=scheduled__2024-04-04T23:01:00+00:00, run_start_date=2024-04-04 23:02:00.347752+00:00, run_end_date=2024-04-04 23:02:05.025847+00:00, run_duration=4.678095, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:01:00+00:00, data_interval_end=2024-04-04 23:02:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:02:05.039358854Z [2024-04-04T23:02:05.038+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:02:00+00:00, run_after=2024-04-04T23:03:00+00:00 2024-04-04T23:02:05.080833161Z [2024-04-04T23:02:05.080+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:01:00+00:00 exited with status success for try_number 1 2024-04-04T23:02:05.087313530Z [2024-04-04T23:02:05.086+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:01:00+00:00, map_index=-1, run_start_date=2024-04-04 23:02:03.632273+00:00, run_end_date=2024-04-04 23:02:04.806632+00:00, run_duration=1.174359, state=success, executor_state=success, try_number=1, max_tries=1, job_id=164, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:02:00.433874+00:00, queued_by_job_id=1, pid=2476 2024-04-04T23:02:05.402841300Z [2024-04-04T23:02:05.402+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:02:05.403342485Z [2024-04-04T23:02:05.402+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:01:00+00:00, run_id=scheduled__2024-04-04T23:01:00+00:00, run_start_date=2024-04-04 23:02:00.346516+00:00, run_end_date=2024-04-04 23:02:05.402769+00:00, run_duration=5.056253, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:01:00+00:00, data_interval_end=2024-04-04 23:02:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:02:05.416245974Z [2024-04-04T23:02:05.415+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:02:00+00:00, run_after=2024-04-04T23:03:00+00:00 2024-04-04T23:02:05.457337181Z [2024-04-04T23:02:05.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:01:00+00:00 exited with status success for try_number 1 2024-04-04T23:02:05.463337002Z [2024-04-04T23:02:05.462+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:01:00+00:00, map_index=-1, run_start_date=2024-04-04 23:02:03.570384+00:00, run_end_date=2024-04-04 23:02:05.189849+00:00, run_duration=1.619465, state=success, executor_state=success, try_number=1, max_tries=1, job_id=163, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:02:00.433874+00:00, queued_by_job_id=1, pid=2475 2024-04-04T23:03:01.055184482Z [2024-04-04T23:03:01.054+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:03:01.075262140Z [2024-04-04T23:03:01.074+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:03:00+00:00, run_after=2024-04-04T23:04:00+00:00 2024-04-04T23:03:01.096876683Z [2024-04-04T23:03:01.096+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:03:00+00:00, run_after=2024-04-04T23:04:00+00:00 2024-04-04T23:03:01.255971479Z [2024-04-04T23:03:01.255+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:03:01.255998898Z 2024-04-04T23:03:01.256002846Z 2024-04-04T23:03:01.256006404Z 2024-04-04T23:03:01.256304440Z [2024-04-04T23:03:01.255+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:03:01.256631213Z [2024-04-04T23:03:01.256+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:03:01.264162709Z [2024-04-04T23:03:01.263+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:03:01.266353182Z [2024-04-04T23:03:01.265+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:03:01.266384618Z 2024-04-04T23:03:01.266392419Z 2024-04-04T23:03:01.266398689Z 2024-04-04T23:03:01.305617272Z [2024-04-04T23:03:01.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:03:01.312136874Z [2024-04-04T23:03:01.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:03:01.312497728Z [2024-04-04T23:03:01.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:03:01.312679495Z [2024-04-04T23:03:01.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:03:01.312965365Z [2024-04-04T23:03:01.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:03:01.313132904Z [2024-04-04T23:03:01.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:03:01.675985032Z [2024-04-04T23:03:01.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:02:00+00:00 exited with status queued for try_number 1 2024-04-04T23:03:01.676049568Z [2024-04-04T23:03:01.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:02:00+00:00 exited with status queued for try_number 1 2024-04-04T23:03:01.676306670Z [2024-04-04T23:03:01.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:02:00+00:00 exited with status queued for try_number 1 2024-04-04T23:03:01.689523978Z [2024-04-04T23:03:01.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to e440f147-5066-43b3-b397-c01e212d4a56 2024-04-04T23:03:01.689831903Z [2024-04-04T23:03:01.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to d13ae65c-eb8e-4c53-9491-f03c9b979cd3 2024-04-04T23:03:01.690055682Z [2024-04-04T23:03:01.689+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc24606b-5fcd-415b-a3df-61f6d97715f0 2024-04-04T23:03:02.946374840Z [2024-04-04T23:03:02.945+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:03:02.948769341Z [2024-04-04T23:03:02.948+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:02:00+00:00, run_id=scheduled__2024-04-04T23:02:00+00:00, run_start_date=2024-04-04 23:03:01.123086+00:00, run_end_date=2024-04-04 23:03:02.947723+00:00, run_duration=1.824637, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:02:00+00:00, data_interval_end=2024-04-04 23:03:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:03:02.963432776Z [2024-04-04T23:03:02.963+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:03:00+00:00, run_after=2024-04-04T23:04:00+00:00 2024-04-04T23:03:03.032602045Z [2024-04-04T23:03:03.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:02:00+00:00 exited with status success for try_number 1 2024-04-04T23:03:03.045190772Z [2024-04-04T23:03:03.044+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:02:00+00:00, map_index=-1, run_start_date=2024-04-04 23:03:02.400310+00:00, run_end_date=2024-04-04 23:03:02.836821+00:00, run_duration=0.436511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=165, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:03:01.270569+00:00, queued_by_job_id=1, pid=2508 2024-04-04T23:03:05.294657675Z [2024-04-04T23:03:05.293+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:03:05.295064109Z [2024-04-04T23:03:05.294+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:02:00+00:00, run_id=scheduled__2024-04-04T23:02:00+00:00, run_start_date=2024-04-04 23:03:01.125526+00:00, run_end_date=2024-04-04 23:03:05.294600+00:00, run_duration=4.169074, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:02:00+00:00, data_interval_end=2024-04-04 23:03:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:03:05.306999787Z [2024-04-04T23:03:05.306+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:03:00+00:00, run_after=2024-04-04T23:04:00+00:00 2024-04-04T23:03:05.806501476Z [2024-04-04T23:03:05.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:02:00+00:00 exited with status success for try_number 1 2024-04-04T23:03:05.814293761Z [2024-04-04T23:03:05.813+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:02:00+00:00, map_index=-1, run_start_date=2024-04-04 23:03:03.341549+00:00, run_end_date=2024-04-04 23:03:05.257270+00:00, run_duration=1.915721, state=success, executor_state=success, try_number=1, max_tries=1, job_id=166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:03:01.270569+00:00, queued_by_job_id=1, pid=2526 2024-04-04T23:03:06.862972420Z [2024-04-04T23:03:06.862+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:03:06.863107170Z [2024-04-04T23:03:06.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:02:00+00:00, run_id=scheduled__2024-04-04T23:02:00+00:00, run_start_date=2024-04-04 23:03:01.120480+00:00, run_end_date=2024-04-04 23:03:06.862820+00:00, run_duration=5.74234, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:02:00+00:00, data_interval_end=2024-04-04 23:03:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:03:06.873069406Z [2024-04-04T23:03:06.872+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:03:00+00:00, run_after=2024-04-04T23:04:00+00:00 2024-04-04T23:03:06.907106574Z [2024-04-04T23:03:06.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:02:00+00:00 exited with status success for try_number 1 2024-04-04T23:03:06.912955268Z [2024-04-04T23:03:06.912+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:02:00+00:00, map_index=-1, run_start_date=2024-04-04 23:03:03.477927+00:00, run_end_date=2024-04-04 23:03:06.130391+00:00, run_duration=2.652464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:03:01.270569+00:00, queued_by_job_id=1, pid=2527 2024-04-04T23:04:00.237949659Z [2024-04-04T23:04:00.237+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:04:00.251393543Z [2024-04-04T23:04:00.251+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:04:00+00:00, run_after=2024-04-04T23:05:00+00:00 2024-04-04T23:04:00.264839000Z [2024-04-04T23:04:00.264+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:04:00+00:00, run_after=2024-04-04T23:05:00+00:00 2024-04-04T23:04:00.271391912Z [2024-04-04T23:04:00.271+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:04:00.346285263Z [2024-04-04T23:04:00.345+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:04:00.346320988Z 2024-04-04T23:04:00.346325982Z 2024-04-04T23:04:00.346329482Z 2024-04-04T23:04:00.346332810Z 2024-04-04T23:04:00.346447385Z [2024-04-04T23:04:00.346+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:04:00.346717151Z [2024-04-04T23:04:00.346+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:04:00.346920251Z [2024-04-04T23:04:00.346+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:04:00.347117073Z [2024-04-04T23:04:00.346+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:04:00.347949242Z [2024-04-04T23:04:00.347+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:04:00.347969728Z 2024-04-04T23:04:00.347975429Z 2024-04-04T23:04:00.347979881Z 2024-04-04T23:04:00.347984147Z 2024-04-04T23:04:00.352138728Z [2024-04-04T23:04:00.351+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:04:00.352341472Z [2024-04-04T23:04:00.352+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:04:00.352699015Z [2024-04-04T23:04:00.352+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:04:00.353085036Z [2024-04-04T23:04:00.352+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:04:00.353399460Z [2024-04-04T23:04:00.353+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:04:00.353592684Z [2024-04-04T23:04:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:04:00.353896660Z [2024-04-04T23:04:00.353+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:04:00.354052232Z [2024-04-04T23:04:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:04:00.890723901Z [2024-04-04T23:04:00.888+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:02:00+00:00 exited with status queued for try_number 1 2024-04-04T23:04:00.890974247Z [2024-04-04T23:04:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:03:00+00:00 exited with status queued for try_number 1 2024-04-04T23:04:00.891134317Z [2024-04-04T23:04:00.890+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:03:00+00:00 exited with status queued for try_number 1 2024-04-04T23:04:00.891277367Z [2024-04-04T23:04:00.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:03:00+00:00 exited with status queued for try_number 1 2024-04-04T23:04:00.911081880Z [2024-04-04T23:04:00.910+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb91a570-87da-4587-acf9-6d9145ecf2f6 2024-04-04T23:04:00.916163169Z [2024-04-04T23:04:00.915+0000] {scheduler_job.py:635} INFO - Setting external_id for to 508c550e-216a-406b-b412-7d9a8b125157 2024-04-04T23:04:00.916258945Z [2024-04-04T23:04:00.916+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2b8e4b8-16f3-4c29-bf35-632c4752fee9 2024-04-04T23:04:00.916445479Z [2024-04-04T23:04:00.916+0000] {scheduler_job.py:635} INFO - Setting external_id for to abe29dcb-57a8-454f-81eb-daed7f14bd7e 2024-04-04T23:04:03.621032757Z [2024-04-04T23:04:03.620+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:04:03.621501689Z [2024-04-04T23:04:03.621+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:02:00+00:00, run_id=scheduled__2024-04-04T23:02:00+00:00, run_start_date=2024-04-04 23:04:00.283341+00:00, run_end_date=2024-04-04 23:04:03.620909+00:00, run_duration=3.337568, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:02:00+00:00, data_interval_end=2024-04-04 23:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:04:03.630643819Z [2024-04-04T23:04:03.630+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:04:00+00:00, run_after=2024-04-04T23:06:00+00:00 2024-04-04T23:04:03.640321028Z [2024-04-04T23:04:03.639+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:04:03.640648877Z [2024-04-04T23:04:03.640+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:03:00+00:00, run_id=scheduled__2024-04-04T23:03:00+00:00, run_start_date=2024-04-04 23:04:00.284682+00:00, run_end_date=2024-04-04 23:04:03.640200+00:00, run_duration=3.355518, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:03:00+00:00, data_interval_end=2024-04-04 23:04:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:04:03.652141036Z [2024-04-04T23:04:03.651+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:04:00+00:00, run_after=2024-04-04T23:05:00+00:00 2024-04-04T23:04:03.708491615Z [2024-04-04T23:04:03.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:02:00+00:00 exited with status success for try_number 1 2024-04-04T23:04:03.708693460Z [2024-04-04T23:04:03.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:03:00+00:00 exited with status success for try_number 1 2024-04-04T23:04:03.720253001Z [2024-04-04T23:04:03.719+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:02:00+00:00, map_index=-1, run_start_date=2024-04-04 23:04:01.953513+00:00, run_end_date=2024-04-04 23:04:02.968564+00:00, run_duration=1.015051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:04:00.349046+00:00, queued_by_job_id=1, pid=2555 2024-04-04T23:04:03.722366716Z [2024-04-04T23:04:03.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:03:00+00:00, map_index=-1, run_start_date=2024-04-04 23:04:02.862819+00:00, run_end_date=2024-04-04 23:04:03.397920+00:00, run_duration=0.535101, state=success, executor_state=success, try_number=1, max_tries=1, job_id=169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:04:00.349046+00:00, queued_by_job_id=1, pid=2567 2024-04-04T23:04:05.569859979Z [2024-04-04T23:04:05.569+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:04:05.570294227Z [2024-04-04T23:04:05.570+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:03:00+00:00, run_id=scheduled__2024-04-04T23:03:00+00:00, run_start_date=2024-04-04 23:04:00.285788+00:00, run_end_date=2024-04-04 23:04:05.569973+00:00, run_duration=5.284185, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:03:00+00:00, data_interval_end=2024-04-04 23:04:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:04:05.579107820Z [2024-04-04T23:04:05.578+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:04:00+00:00, run_after=2024-04-04T23:05:00+00:00 2024-04-04T23:04:05.618914461Z [2024-04-04T23:04:05.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:03:00+00:00 exited with status success for try_number 1 2024-04-04T23:04:05.624660042Z [2024-04-04T23:04:05.624+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:03:00+00:00, map_index=-1, run_start_date=2024-04-04 23:04:03.534352+00:00, run_end_date=2024-04-04 23:04:04.868892+00:00, run_duration=1.33454, state=success, executor_state=success, try_number=1, max_tries=1, job_id=170, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:04:00.349046+00:00, queued_by_job_id=1, pid=2579 2024-04-04T23:04:07.218536228Z [2024-04-04T23:04:07.218+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:04:07.218767256Z [2024-04-04T23:04:07.218+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:03:00+00:00, run_id=scheduled__2024-04-04T23:03:00+00:00, run_start_date=2024-04-04 23:04:00.286769+00:00, run_end_date=2024-04-04 23:04:07.218425+00:00, run_duration=6.931656, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:03:00+00:00, data_interval_end=2024-04-04 23:04:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:04:07.227388929Z [2024-04-04T23:04:07.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:04:00+00:00, run_after=2024-04-04T23:05:00+00:00 2024-04-04T23:04:07.253703114Z [2024-04-04T23:04:07.253+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:03:00+00:00 exited with status success for try_number 1 2024-04-04T23:04:07.258371240Z [2024-04-04T23:04:07.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:03:00+00:00, map_index=-1, run_start_date=2024-04-04 23:04:04.179513+00:00, run_end_date=2024-04-04 23:04:06.122192+00:00, run_duration=1.942679, state=success, executor_state=success, try_number=1, max_tries=1, job_id=171, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:04:00.349046+00:00, queued_by_job_id=1, pid=2590 2024-04-04T23:05:00.874758238Z [2024-04-04T23:05:00.874+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:05:00.900603458Z [2024-04-04T23:05:00.900+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:05:00+00:00, run_after=2024-04-04T23:10:00+00:00 2024-04-04T23:05:00.917762134Z [2024-04-04T23:05:00.917+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:05:00+00:00, run_after=2024-04-04T23:06:00+00:00 2024-04-04T23:05:00.933280166Z [2024-04-04T23:05:00.933+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:05:00+00:00, run_after=2024-04-04T23:06:00+00:00 2024-04-04T23:05:01.084849435Z [2024-04-04T23:05:01.084+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:05:01.084875484Z 2024-04-04T23:05:01.084879497Z 2024-04-04T23:05:01.084882770Z 2024-04-04T23:05:01.084885936Z 2024-04-04T23:05:01.084897180Z [2024-04-04T23:05:01.084+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:05:01.084939338Z [2024-04-04T23:05:01.084+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:05:01.085010715Z [2024-04-04T23:05:01.084+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:05:01.085093428Z [2024-04-04T23:05:01.085+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:05:01.085689981Z [2024-04-04T23:05:01.085+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:05:01.085701938Z 2024-04-04T23:05:01.085705741Z 2024-04-04T23:05:01.085708998Z 2024-04-04T23:05:01.085712264Z 2024-04-04T23:05:01.097011456Z [2024-04-04T23:05:01.096+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T23:05:01.097038479Z [2024-04-04T23:05:01.096+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:05:01.097245527Z [2024-04-04T23:05:01.097+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:05:01.097313552Z [2024-04-04T23:05:01.097+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:05:01.097511110Z [2024-04-04T23:05:01.097+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:05:01.097574110Z [2024-04-04T23:05:01.097+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:05:01.097745205Z [2024-04-04T23:05:01.097+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:05:01.097801733Z [2024-04-04T23:05:01.097+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:05:01.875671633Z [2024-04-04T23:05:01.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:00:00+00:00 exited with status queued for try_number 1 2024-04-04T23:05:01.875699940Z [2024-04-04T23:05:01.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:04:00+00:00 exited with status queued for try_number 1 2024-04-04T23:05:01.875703888Z [2024-04-04T23:05:01.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:04:00+00:00 exited with status queued for try_number 1 2024-04-04T23:05:01.875707481Z [2024-04-04T23:05:01.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:04:00+00:00 exited with status queued for try_number 1 2024-04-04T23:05:01.922145105Z [2024-04-04T23:05:01.921+0000] {scheduler_job.py:635} INFO - Setting external_id for to 533ac566-0a63-4b51-a453-205db0673e0d 2024-04-04T23:05:01.932484942Z [2024-04-04T23:05:01.932+0000] {scheduler_job.py:635} INFO - Setting external_id for to c065bf97-b007-461f-846c-744a62d6db9d 2024-04-04T23:05:01.934651556Z [2024-04-04T23:05:01.934+0000] {scheduler_job.py:635} INFO - Setting external_id for to 093ee254-c3b5-4b0f-ab46-524df08e654b 2024-04-04T23:05:01.934831804Z [2024-04-04T23:05:01.934+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc25979a-a49c-4304-8f97-7aab208174cb 2024-04-04T23:05:03.608046963Z [2024-04-04T23:05:03.607+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:05:03.609175708Z [2024-04-04T23:05:03.608+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:04:00+00:00, run_id=scheduled__2024-04-04T23:04:00+00:00, run_start_date=2024-04-04 23:05:00.959866+00:00, run_end_date=2024-04-04 23:05:03.608230+00:00, run_duration=2.648364, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:04:00+00:00, data_interval_end=2024-04-04 23:05:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:05:03.636631868Z [2024-04-04T23:05:03.636+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:05:00+00:00, run_after=2024-04-04T23:06:00+00:00 2024-04-04T23:05:03.720712750Z [2024-04-04T23:05:03.720+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:04:00+00:00 exited with status success for try_number 1 2024-04-04T23:05:03.729168452Z [2024-04-04T23:05:03.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:04:00+00:00, map_index=-1, run_start_date=2024-04-04 23:05:02.873481+00:00, run_end_date=2024-04-04 23:05:03.301386+00:00, run_duration=0.427905, state=success, executor_state=success, try_number=1, max_tries=1, job_id=172, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:05:01.086477+00:00, queued_by_job_id=1, pid=2618 2024-04-04T23:05:04.894162724Z [2024-04-04T23:05:04.893+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:05:04.894186442Z 2024-04-04T23:05:04.894489384Z [2024-04-04T23:05:04.894+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:05:04.895398810Z [2024-04-04T23:05:04.895+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:05:04.895411378Z 2024-04-04T23:05:04.899535052Z [2024-04-04T23:05:04.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-04T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T23:05:04.899992289Z [2024-04-04T23:05:04.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-04T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:05:05.015230200Z [2024-04-04T23:05:05.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:00:00+00:00 exited with status queued for try_number 1 2024-04-04T23:05:05.015348232Z [2024-04-04T23:05:05.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:00:00+00:00 exited with status success for try_number 1 2024-04-04T23:05:05.027375396Z [2024-04-04T23:05:05.026+0000] {scheduler_job.py:635} INFO - Setting external_id for to 191c6e52-830e-4403-b323-e2f1a3888bda 2024-04-04T23:05:05.027836368Z [2024-04-04T23:05:05.027+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T23:00:00+00:00, map_index=-1, run_start_date=2024-04-04 23:05:04.071351+00:00, run_end_date=2024-04-04 23:05:04.574534+00:00, run_duration=0.503183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=173, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:05:01.086477+00:00, queued_by_job_id=1, pid=2637 2024-04-04T23:05:07.061699254Z [2024-04-04T23:05:07.061+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:05:07.062200406Z [2024-04-04T23:05:07.061+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:04:00+00:00, run_id=scheduled__2024-04-04T23:04:00+00:00, run_start_date=2024-04-04 23:05:00.969628+00:00, run_end_date=2024-04-04 23:05:07.061833+00:00, run_duration=6.092205, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:04:00+00:00, data_interval_end=2024-04-04 23:05:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:05:07.075086798Z [2024-04-04T23:05:07.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:05:00+00:00, run_after=2024-04-04T23:06:00+00:00 2024-04-04T23:05:07.087209901Z [2024-04-04T23:05:07.086+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:05:07.087689269Z [2024-04-04T23:05:07.087+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:04:00+00:00, run_id=scheduled__2024-04-04T23:04:00+00:00, run_start_date=2024-04-04 23:05:00.971317+00:00, run_end_date=2024-04-04 23:05:07.087314+00:00, run_duration=6.115997, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:04:00+00:00, data_interval_end=2024-04-04 23:05:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:05:07.098875195Z [2024-04-04T23:05:07.098+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:05:00+00:00, run_after=2024-04-04T23:06:00+00:00 2024-04-04T23:05:07.186129798Z [2024-04-04T23:05:07.185+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:05:07.186162566Z 2024-04-04T23:05:07.186269163Z [2024-04-04T23:05:07.186+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:05:07.187251001Z [2024-04-04T23:05:07.186+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:05:07.187270826Z 2024-04-04T23:05:07.190622520Z [2024-04-04T23:05:07.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-04T23:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T23:05:07.190716167Z [2024-04-04T23:05:07.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-04T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T23:05:07.271292949Z [2024-04-04T23:05:07.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:00:00+00:00 exited with status queued for try_number 1 2024-04-04T23:05:07.271430383Z [2024-04-04T23:05:07.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:04:00+00:00 exited with status success for try_number 1 2024-04-04T23:05:07.271649116Z [2024-04-04T23:05:07.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:04:00+00:00 exited with status success for try_number 1 2024-04-04T23:05:07.284476919Z [2024-04-04T23:05:07.283+0000] {scheduler_job.py:635} INFO - Setting external_id for to af4cdae5-9d41-4811-bf21-f105efe2109f 2024-04-04T23:05:07.284864416Z [2024-04-04T23:05:07.284+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:04:00+00:00, map_index=-1, run_start_date=2024-04-04 23:05:04.891436+00:00, run_end_date=2024-04-04 23:05:06.560959+00:00, run_duration=1.669523, state=success, executor_state=success, try_number=1, max_tries=1, job_id=175, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:05:01.086477+00:00, queued_by_job_id=1, pid=2655 2024-04-04T23:05:07.285178444Z [2024-04-04T23:05:07.284+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:04:00+00:00, map_index=-1, run_start_date=2024-04-04 23:05:04.272043+00:00, run_end_date=2024-04-04 23:05:06.869903+00:00, run_duration=2.59786, state=success, executor_state=success, try_number=1, max_tries=1, job_id=174, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:05:01.086477+00:00, queued_by_job_id=1, pid=2638 2024-04-04T23:05:07.417962083Z [2024-04-04T23:05:07.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:00:00+00:00 exited with status success for try_number 1 2024-04-04T23:05:07.426217791Z [2024-04-04T23:05:07.425+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-04T23:00:00+00:00, map_index=-1, run_start_date=2024-04-04 23:05:06.682639+00:00, run_end_date=2024-04-04 23:05:07.070215+00:00, run_duration=0.387576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=176, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:05:04.895987+00:00, queued_by_job_id=1, pid=2667 2024-04-04T23:05:09.646840969Z [2024-04-04T23:05:09.646+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:05:09.646868479Z 2024-04-04T23:05:09.647661556Z [2024-04-04T23:05:09.646+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:05:09.648378854Z [2024-04-04T23:05:09.648+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:05:09.648390274Z 2024-04-04T23:05:09.651575201Z [2024-04-04T23:05:09.651+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-04T23:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:05:09.652186045Z [2024-04-04T23:05:09.651+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-04T23:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:05:09.748557758Z [2024-04-04T23:05:09.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:00:00+00:00 exited with status queued for try_number 1 2024-04-04T23:05:09.748590051Z [2024-04-04T23:05:09.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:00:00+00:00 exited with status success for try_number 1 2024-04-04T23:05:09.758439606Z [2024-04-04T23:05:09.757+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc955bbe-17aa-4f1f-ac7a-358fe5d7071b 2024-04-04T23:05:09.758813735Z [2024-04-04T23:05:09.758+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-04T23:00:00+00:00, map_index=0, run_start_date=2024-04-04 23:05:09.076540+00:00, run_end_date=2024-04-04 23:05:09.527295+00:00, run_duration=0.450755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=177, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:05:07.187817+00:00, queued_by_job_id=1, pid=2675 2024-04-04T23:05:12.005413916Z [2024-04-04T23:05:12.004+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:05:12.005753431Z [2024-04-04T23:05:12.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:00:00+00:00, run_id=scheduled__2024-04-04T23:00:00+00:00, run_start_date=2024-04-04 23:05:00.957006+00:00, run_end_date=2024-04-04 23:05:12.005395+00:00, run_duration=11.048389, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:00:00+00:00, data_interval_end=2024-04-04 23:05:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-04T23:05:12.016061511Z [2024-04-04T23:05:12.015+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:05:00+00:00, run_after=2024-04-04T23:10:00+00:00 2024-04-04T23:05:12.045035922Z [2024-04-04T23:05:12.044+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:00:00+00:00 exited with status success for try_number 1 2024-04-04T23:05:12.050979449Z [2024-04-04T23:05:12.050+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-04T23:00:00+00:00, map_index=-1, run_start_date=2024-04-04 23:05:11.434902+00:00, run_end_date=2024-04-04 23:05:11.883072+00:00, run_duration=0.44817, state=success, executor_state=success, try_number=1, max_tries=1, job_id=178, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:05:09.649160+00:00, queued_by_job_id=1, pid=2696 2024-04-04T23:05:39.430504996Z [2024-04-04T23:05:39.429+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-04T23:06:00.040876025Z [2024-04-04T23:06:00.040+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:06:00.065695538Z [2024-04-04T23:06:00.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:06:00+00:00, run_after=2024-04-04T23:07:00+00:00 2024-04-04T23:06:00.080251282Z [2024-04-04T23:06:00.078+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:06:00.103467565Z [2024-04-04T23:06:00.103+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:06:00+00:00, run_after=2024-04-04T23:07:00+00:00 2024-04-04T23:06:00.201262848Z [2024-04-04T23:06:00.200+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:06:00.201288831Z 2024-04-04T23:06:00.201294585Z 2024-04-04T23:06:00.201299065Z 2024-04-04T23:06:00.201303524Z 2024-04-04T23:06:00.201331836Z [2024-04-04T23:06:00.201+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:06:00.201518367Z [2024-04-04T23:06:00.201+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:06:00.201602073Z [2024-04-04T23:06:00.201+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:06:00.201673379Z [2024-04-04T23:06:00.201+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:06:00.202335617Z [2024-04-04T23:06:00.202+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:06:00.202359883Z 2024-04-04T23:06:00.202364267Z 2024-04-04T23:06:00.202368230Z 2024-04-04T23:06:00.202373053Z 2024-04-04T23:06:00.206858257Z [2024-04-04T23:06:00.206+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:06:00.207037150Z [2024-04-04T23:06:00.206+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:06:00.207432219Z [2024-04-04T23:06:00.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:06:00.207743294Z [2024-04-04T23:06:00.207+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:06:00.208019453Z [2024-04-04T23:06:00.207+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:06:00.208187579Z [2024-04-04T23:06:00.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:06:00.208534653Z [2024-04-04T23:06:00.208+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:06:00.208719475Z [2024-04-04T23:06:00.208+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:06:00.874786188Z [2024-04-04T23:06:00.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:04:00+00:00 exited with status queued for try_number 1 2024-04-04T23:06:00.874814932Z [2024-04-04T23:06:00.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:05:00+00:00 exited with status queued for try_number 1 2024-04-04T23:06:00.874841616Z [2024-04-04T23:06:00.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:05:00+00:00 exited with status queued for try_number 1 2024-04-04T23:06:00.874941739Z [2024-04-04T23:06:00.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:05:00+00:00 exited with status queued for try_number 1 2024-04-04T23:06:00.888962095Z [2024-04-04T23:06:00.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1208c70c-e206-4941-b70d-3262125e7634 2024-04-04T23:06:00.888990349Z [2024-04-04T23:06:00.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07667f82-7782-4079-9a66-f7ecf15f7a4a 2024-04-04T23:06:00.889094252Z [2024-04-04T23:06:00.888+0000] {scheduler_job.py:635} INFO - Setting external_id for to 891bd7bf-a6df-44d1-b618-7c7d3cd9417b 2024-04-04T23:06:00.889201465Z [2024-04-04T23:06:00.889+0000] {scheduler_job.py:635} INFO - Setting external_id for to a455c265-3ce9-4a48-bdc6-47c141c820da 2024-04-04T23:06:02.134459958Z [2024-04-04T23:06:02.133+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:06:02.135353595Z [2024-04-04T23:06:02.134+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:04:00+00:00, run_id=scheduled__2024-04-04T23:04:00+00:00, run_start_date=2024-04-04 23:06:00.119202+00:00, run_end_date=2024-04-04 23:06:02.134691+00:00, run_duration=2.015489, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:04:00+00:00, data_interval_end=2024-04-04 23:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:06:02.155993356Z [2024-04-04T23:06:02.155+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:06:00+00:00, run_after=2024-04-04T23:08:00+00:00 2024-04-04T23:06:02.994396672Z [2024-04-04T23:06:02.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:06:02.994787333Z [2024-04-04T23:06:02.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:05:00+00:00, run_id=scheduled__2024-04-04T23:05:00+00:00, run_start_date=2024-04-04 23:06:00.120908+00:00, run_end_date=2024-04-04 23:06:02.994474+00:00, run_duration=2.873566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:05:00+00:00, data_interval_end=2024-04-04 23:06:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:06:03.005911986Z [2024-04-04T23:06:03.005+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:06:00+00:00, run_after=2024-04-04T23:07:00+00:00 2024-04-04T23:06:03.081934649Z [2024-04-04T23:06:03.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:04:00+00:00 exited with status success for try_number 1 2024-04-04T23:06:03.082209958Z [2024-04-04T23:06:03.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:05:00+00:00 exited with status success for try_number 1 2024-04-04T23:06:03.093132869Z [2024-04-04T23:06:03.092+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:05:00+00:00, map_index=-1, run_start_date=2024-04-04 23:06:01.847170+00:00, run_end_date=2024-04-04 23:06:02.360840+00:00, run_duration=0.51367, state=success, executor_state=success, try_number=1, max_tries=1, job_id=180, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:06:00.203490+00:00, queued_by_job_id=1, pid=2708 2024-04-04T23:06:03.093984504Z [2024-04-04T23:06:03.093+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:04:00+00:00, map_index=-1, run_start_date=2024-04-04 23:06:01.513859+00:00, run_end_date=2024-04-04 23:06:02.107253+00:00, run_duration=0.593394, state=success, executor_state=success, try_number=1, max_tries=1, job_id=179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:06:00.203490+00:00, queued_by_job_id=1, pid=2706 2024-04-04T23:06:04.155636823Z [2024-04-04T23:06:04.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:06:04.155877082Z [2024-04-04T23:06:04.155+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:05:00+00:00, run_id=scheduled__2024-04-04T23:05:00+00:00, run_start_date=2024-04-04 23:06:00.122700+00:00, run_end_date=2024-04-04 23:06:04.155517+00:00, run_duration=4.032817, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:05:00+00:00, data_interval_end=2024-04-04 23:06:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:06:04.166007416Z [2024-04-04T23:06:04.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:06:00+00:00, run_after=2024-04-04T23:07:00+00:00 2024-04-04T23:06:04.206184595Z [2024-04-04T23:06:04.205+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:05:00+00:00 exited with status success for try_number 1 2024-04-04T23:06:04.212343452Z [2024-04-04T23:06:04.211+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:05:00+00:00, map_index=-1, run_start_date=2024-04-04 23:06:02.702700+00:00, run_end_date=2024-04-04 23:06:03.974655+00:00, run_duration=1.271955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=181, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:06:00.203490+00:00, queued_by_job_id=1, pid=2725 2024-04-04T23:06:05.265667441Z [2024-04-04T23:06:05.265+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:06:05.265916398Z [2024-04-04T23:06:05.265+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:05:00+00:00, run_id=scheduled__2024-04-04T23:05:00+00:00, run_start_date=2024-04-04 23:06:00.125426+00:00, run_end_date=2024-04-04 23:06:05.265532+00:00, run_duration=5.140106, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:05:00+00:00, data_interval_end=2024-04-04 23:06:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:06:05.275094606Z [2024-04-04T23:06:05.274+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:06:00+00:00, run_after=2024-04-04T23:07:00+00:00 2024-04-04T23:06:05.301551185Z [2024-04-04T23:06:05.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:05:00+00:00 exited with status success for try_number 1 2024-04-04T23:06:05.311076243Z [2024-04-04T23:06:05.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:05:00+00:00, map_index=-1, run_start_date=2024-04-04 23:06:03.316940+00:00, run_end_date=2024-04-04 23:06:04.831636+00:00, run_duration=1.514696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=182, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:06:00.203490+00:00, queued_by_job_id=1, pid=2736 2024-04-04T23:07:00.835374741Z [2024-04-04T23:07:00.834+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:07:00+00:00, run_after=2024-04-04T23:08:00+00:00 2024-04-04T23:07:00.844155146Z [2024-04-04T23:07:00.843+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:07:00.858984026Z [2024-04-04T23:07:00.858+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:07:00+00:00, run_after=2024-04-04T23:08:00+00:00 2024-04-04T23:07:00.987398690Z [2024-04-04T23:07:00.987+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:07:00.987424730Z 2024-04-04T23:07:00.987428533Z 2024-04-04T23:07:00.987431944Z 2024-04-04T23:07:01.008474161Z [2024-04-04T23:07:00.987+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:07:01.008508020Z [2024-04-04T23:07:00.987+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:07:01.008513502Z [2024-04-04T23:07:00.987+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:07:01.008519424Z [2024-04-04T23:07:00.988+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:07:01.008524240Z 2024-04-04T23:07:01.008529126Z 2024-04-04T23:07:01.008552588Z 2024-04-04T23:07:01.008561319Z [2024-04-04T23:07:00.991+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:07:01.008566431Z [2024-04-04T23:07:00.991+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:07:01.008571108Z [2024-04-04T23:07:00.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:07:01.008575659Z [2024-04-04T23:07:00.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:07:01.008580439Z [2024-04-04T23:07:00.992+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:07:01.008585360Z [2024-04-04T23:07:00.992+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:07:01.589724680Z [2024-04-04T23:07:01.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:06:00+00:00 exited with status queued for try_number 1 2024-04-04T23:07:01.592471676Z [2024-04-04T23:07:01.589+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:06:00+00:00 exited with status queued for try_number 1 2024-04-04T23:07:01.592743774Z [2024-04-04T23:07:01.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:06:00+00:00 exited with status queued for try_number 1 2024-04-04T23:07:01.603692021Z [2024-04-04T23:07:01.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to 275c3143-6c73-49f6-a525-ac85eb4cc23c 2024-04-04T23:07:01.605125889Z [2024-04-04T23:07:01.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0bae0cd-3694-464b-ace3-02c4f29b983d 2024-04-04T23:07:01.605409456Z [2024-04-04T23:07:01.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c5c76ee-3127-4b7a-b4ef-0e97ed96fb3e 2024-04-04T23:07:03.800337007Z [2024-04-04T23:07:03.799+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:07:03.800749225Z [2024-04-04T23:07:03.800+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:06:00+00:00, run_id=scheduled__2024-04-04T23:06:00+00:00, run_start_date=2024-04-04 23:07:00.871386+00:00, run_end_date=2024-04-04 23:07:03.800401+00:00, run_duration=2.929015, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:06:00+00:00, data_interval_end=2024-04-04 23:07:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:07:03.812272224Z [2024-04-04T23:07:03.811+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:07:00+00:00, run_after=2024-04-04T23:08:00+00:00 2024-04-04T23:07:03.868750675Z [2024-04-04T23:07:03.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:06:00+00:00 exited with status success for try_number 1 2024-04-04T23:07:03.877807757Z [2024-04-04T23:07:03.877+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:06:00+00:00, map_index=-1, run_start_date=2024-04-04 23:07:02.446393+00:00, run_end_date=2024-04-04 23:07:02.936782+00:00, run_duration=0.490389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=183, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:07:00.989246+00:00, queued_by_job_id=1, pid=2763 2024-04-04T23:07:06.016427977Z [2024-04-04T23:07:06.015+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:07:06.016737776Z [2024-04-04T23:07:06.016+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:06:00+00:00, run_id=scheduled__2024-04-04T23:06:00+00:00, run_start_date=2024-04-04 23:07:00.872817+00:00, run_end_date=2024-04-04 23:07:06.016340+00:00, run_duration=5.143523, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:06:00+00:00, data_interval_end=2024-04-04 23:07:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:07:06.028072186Z [2024-04-04T23:07:06.027+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:07:00+00:00, run_after=2024-04-04T23:08:00+00:00 2024-04-04T23:07:06.034725251Z [2024-04-04T23:07:06.034+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:07:06.035115592Z [2024-04-04T23:07:06.034+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:06:00+00:00, run_id=scheduled__2024-04-04T23:06:00+00:00, run_start_date=2024-04-04 23:07:00.874600+00:00, run_end_date=2024-04-04 23:07:06.034617+00:00, run_duration=5.160017, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:06:00+00:00, data_interval_end=2024-04-04 23:07:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:07:06.048458569Z [2024-04-04T23:07:06.048+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:07:00+00:00, run_after=2024-04-04T23:08:00+00:00 2024-04-04T23:07:06.090303719Z [2024-04-04T23:07:06.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:06:00+00:00 exited with status success for try_number 1 2024-04-04T23:07:06.090418539Z [2024-04-04T23:07:06.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:06:00+00:00 exited with status success for try_number 1 2024-04-04T23:07:06.096965486Z [2024-04-04T23:07:06.096+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:06:00+00:00, map_index=-1, run_start_date=2024-04-04 23:07:03.408150+00:00, run_end_date=2024-04-04 23:07:04.959002+00:00, run_duration=1.550852, state=success, executor_state=success, try_number=1, max_tries=1, job_id=184, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:07:00.989246+00:00, queued_by_job_id=1, pid=2776 2024-04-04T23:07:06.097269075Z [2024-04-04T23:07:06.097+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:06:00+00:00, map_index=-1, run_start_date=2024-04-04 23:07:03.675058+00:00, run_end_date=2024-04-04 23:07:05.627590+00:00, run_duration=1.952532, state=success, executor_state=success, try_number=1, max_tries=1, job_id=185, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:07:00.989246+00:00, queued_by_job_id=1, pid=2782 2024-04-04T23:08:00.679972290Z [2024-04-04T23:08:00.679+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:08:00+00:00, run_after=2024-04-04T23:09:00+00:00 2024-04-04T23:08:00.690767564Z [2024-04-04T23:08:00.690+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:08:00.698559060Z [2024-04-04T23:08:00.698+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:08:00.713617403Z [2024-04-04T23:08:00.713+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:08:00+00:00, run_after=2024-04-04T23:09:00+00:00 2024-04-04T23:08:00.801082663Z [2024-04-04T23:08:00.800+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:08:00.801109922Z 2024-04-04T23:08:00.801115036Z 2024-04-04T23:08:00.801118749Z 2024-04-04T23:08:00.801122826Z 2024-04-04T23:08:00.801189938Z [2024-04-04T23:08:00.800+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:08:00.801505449Z [2024-04-04T23:08:00.801+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:08:00.801781227Z [2024-04-04T23:08:00.801+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:08:00.802051229Z [2024-04-04T23:08:00.801+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:08:00.802778570Z [2024-04-04T23:08:00.802+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:08:00.802793525Z 2024-04-04T23:08:00.802799795Z 2024-04-04T23:08:00.802803245Z 2024-04-04T23:08:00.802806495Z 2024-04-04T23:08:00.807915271Z [2024-04-04T23:08:00.807+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:08:00.808181511Z [2024-04-04T23:08:00.807+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:08:00.808595592Z [2024-04-04T23:08:00.808+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:08:00.808872546Z [2024-04-04T23:08:00.808+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:08:00.809820583Z [2024-04-04T23:08:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:08:00.810035733Z [2024-04-04T23:08:00.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:08:00.810379235Z [2024-04-04T23:08:00.810+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:08:00.810591586Z [2024-04-04T23:08:00.810+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:08:01.580801325Z [2024-04-04T23:08:01.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:06:00+00:00 exited with status queued for try_number 1 2024-04-04T23:08:01.581024996Z [2024-04-04T23:08:01.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:07:00+00:00 exited with status queued for try_number 1 2024-04-04T23:08:01.581235673Z [2024-04-04T23:08:01.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:07:00+00:00 exited with status queued for try_number 1 2024-04-04T23:08:01.581550487Z [2024-04-04T23:08:01.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:07:00+00:00 exited with status queued for try_number 1 2024-04-04T23:08:01.605210333Z [2024-04-04T23:08:01.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07baba0f-9013-47bd-9876-b6962dcba35c 2024-04-04T23:08:01.605454102Z [2024-04-04T23:08:01.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7a4e383-3346-48db-93ba-b13917c52d85 2024-04-04T23:08:01.605704456Z [2024-04-04T23:08:01.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to d94e6acf-1401-4344-a2ac-4864fedb311e 2024-04-04T23:08:01.606077051Z [2024-04-04T23:08:01.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to f6bbad00-2b27-4671-b077-e9e2b940f92d 2024-04-04T23:08:03.024118171Z [2024-04-04T23:08:03.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:08:03.024774190Z [2024-04-04T23:08:03.024+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:07:00+00:00, run_id=scheduled__2024-04-04T23:07:00+00:00, run_start_date=2024-04-04 23:08:00.727770+00:00, run_end_date=2024-04-04 23:08:03.024226+00:00, run_duration=2.296456, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:07:00+00:00, data_interval_end=2024-04-04 23:08:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:08:03.043261873Z [2024-04-04T23:08:03.042+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:08:00+00:00, run_after=2024-04-04T23:09:00+00:00 2024-04-04T23:08:04.190378838Z [2024-04-04T23:08:04.189+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:08:04.190556052Z [2024-04-04T23:08:04.190+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:06:00+00:00, run_id=scheduled__2024-04-04T23:06:00+00:00, run_start_date=2024-04-04 23:08:00.726271+00:00, run_end_date=2024-04-04 23:08:04.190273+00:00, run_duration=3.464002, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:06:00+00:00, data_interval_end=2024-04-04 23:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:08:04.198372715Z [2024-04-04T23:08:04.198+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:08:00+00:00, run_after=2024-04-04T23:10:00+00:00 2024-04-04T23:08:04.245113442Z [2024-04-04T23:08:04.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:06:00+00:00 exited with status success for try_number 1 2024-04-04T23:08:04.245146182Z [2024-04-04T23:08:04.244+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:07:00+00:00 exited with status success for try_number 1 2024-04-04T23:08:04.252560876Z [2024-04-04T23:08:04.252+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:07:00+00:00, map_index=-1, run_start_date=2024-04-04 23:08:02.404928+00:00, run_end_date=2024-04-04 23:08:02.934994+00:00, run_duration=0.530066, state=success, executor_state=success, try_number=1, max_tries=1, job_id=186, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:08:00.804661+00:00, queued_by_job_id=1, pid=2815 2024-04-04T23:08:04.252724055Z [2024-04-04T23:08:04.252+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:06:00+00:00, map_index=-1, run_start_date=2024-04-04 23:08:02.423610+00:00, run_end_date=2024-04-04 23:08:03.054510+00:00, run_duration=0.6309, state=success, executor_state=success, try_number=1, max_tries=1, job_id=187, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:08:00.804661+00:00, queued_by_job_id=1, pid=2816 2024-04-04T23:08:07.614183334Z [2024-04-04T23:08:07.613+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:08:07.614369066Z [2024-04-04T23:08:07.614+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:07:00+00:00, run_id=scheduled__2024-04-04T23:07:00+00:00, run_start_date=2024-04-04 23:08:00.728968+00:00, run_end_date=2024-04-04 23:08:07.614090+00:00, run_duration=6.885122, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:07:00+00:00, data_interval_end=2024-04-04 23:08:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:08:07.623083718Z [2024-04-04T23:08:07.622+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:08:00+00:00, run_after=2024-04-04T23:09:00+00:00 2024-04-04T23:08:07.630135075Z [2024-04-04T23:08:07.629+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:08:07.630235250Z [2024-04-04T23:08:07.630+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:07:00+00:00, run_id=scheduled__2024-04-04T23:07:00+00:00, run_start_date=2024-04-04 23:08:00.730124+00:00, run_end_date=2024-04-04 23:08:07.630007+00:00, run_duration=6.899883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:07:00+00:00, data_interval_end=2024-04-04 23:08:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:08:07.639712006Z [2024-04-04T23:08:07.639+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:08:00+00:00, run_after=2024-04-04T23:09:00+00:00 2024-04-04T23:08:07.665165613Z [2024-04-04T23:08:07.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:07:00+00:00 exited with status success for try_number 1 2024-04-04T23:08:07.665187476Z [2024-04-04T23:08:07.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:07:00+00:00 exited with status success for try_number 1 2024-04-04T23:08:07.670984246Z [2024-04-04T23:08:07.670+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:07:00+00:00, map_index=-1, run_start_date=2024-04-04 23:08:03.773212+00:00, run_end_date=2024-04-04 23:08:07.028234+00:00, run_duration=3.255022, state=success, executor_state=success, try_number=1, max_tries=1, job_id=189, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:08:00.804661+00:00, queued_by_job_id=1, pid=2840 2024-04-04T23:08:07.671091495Z [2024-04-04T23:08:07.670+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:07:00+00:00, map_index=-1, run_start_date=2024-04-04 23:08:03.625765+00:00, run_end_date=2024-04-04 23:08:07.116316+00:00, run_duration=3.490551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=188, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:08:00.804661+00:00, queued_by_job_id=1, pid=2839 2024-04-04T23:09:00.391430303Z [2024-04-04T23:09:00.390+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:09:00+00:00, run_after=2024-04-04T23:10:00+00:00 2024-04-04T23:09:00.407768514Z [2024-04-04T23:09:00.407+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:09:00+00:00, run_after=2024-04-04T23:10:00+00:00 2024-04-04T23:09:00.417531651Z [2024-04-04T23:09:00.417+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:09:00.499887773Z [2024-04-04T23:09:00.497+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:09:00.499921689Z 2024-04-04T23:09:00.499925939Z 2024-04-04T23:09:00.499929160Z 2024-04-04T23:09:00.500353487Z [2024-04-04T23:09:00.500+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:09:00.500762580Z [2024-04-04T23:09:00.500+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:09:00.501187256Z [2024-04-04T23:09:00.500+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:09:00.502587099Z [2024-04-04T23:09:00.502+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:09:00.502600277Z 2024-04-04T23:09:00.502603851Z 2024-04-04T23:09:00.502607038Z 2024-04-04T23:09:00.509003275Z [2024-04-04T23:09:00.508+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:09:00.509578003Z [2024-04-04T23:09:00.509+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:09:00.510216882Z [2024-04-04T23:09:00.509+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:09:00.510678110Z [2024-04-04T23:09:00.510+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:09:00.511294139Z [2024-04-04T23:09:00.511+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:09:00.511837934Z [2024-04-04T23:09:00.511+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:09:00.978497708Z [2024-04-04T23:09:00.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:08:00+00:00 exited with status queued for try_number 1 2024-04-04T23:09:00.982789901Z [2024-04-04T23:09:00.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:08:00+00:00 exited with status queued for try_number 1 2024-04-04T23:09:00.983132114Z [2024-04-04T23:09:00.982+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:08:00+00:00 exited with status queued for try_number 1 2024-04-04T23:09:00.997594775Z [2024-04-04T23:09:00.997+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92638018-d1b2-4e9a-9ef9-3a60492d92ac 2024-04-04T23:09:00.998342430Z [2024-04-04T23:09:00.997+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b16489d-13f6-4267-8e0c-16e493f8ead7 2024-04-04T23:09:00.998820165Z [2024-04-04T23:09:00.998+0000] {scheduler_job.py:635} INFO - Setting external_id for to f353bb9a-ee01-4a1d-b01e-a9e9eb89a4ed 2024-04-04T23:09:03.598339539Z [2024-04-04T23:09:03.597+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:09:03.598503193Z [2024-04-04T23:09:03.598+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:08:00+00:00, run_id=scheduled__2024-04-04T23:08:00+00:00, run_start_date=2024-04-04 23:09:00.430282+00:00, run_end_date=2024-04-04 23:09:03.598171+00:00, run_duration=3.167889, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:08:00+00:00, data_interval_end=2024-04-04 23:09:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:09:03.608428084Z [2024-04-04T23:09:03.608+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:09:00+00:00, run_after=2024-04-04T23:10:00+00:00 2024-04-04T23:09:03.665283230Z [2024-04-04T23:09:03.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:08:00+00:00 exited with status success for try_number 1 2024-04-04T23:09:03.673335700Z [2024-04-04T23:09:03.672+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:08:00+00:00, map_index=-1, run_start_date=2024-04-04 23:09:02.008082+00:00, run_end_date=2024-04-04 23:09:02.496665+00:00, run_duration=0.488583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=190, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:09:00.504453+00:00, queued_by_job_id=1, pid=2872 2024-04-04T23:09:05.843206777Z [2024-04-04T23:09:05.842+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:09:05.843846229Z [2024-04-04T23:09:05.843+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:08:00+00:00, run_id=scheduled__2024-04-04T23:08:00+00:00, run_start_date=2024-04-04 23:09:00.431694+00:00, run_end_date=2024-04-04 23:09:05.843126+00:00, run_duration=5.411432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:08:00+00:00, data_interval_end=2024-04-04 23:09:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:09:05.868393586Z [2024-04-04T23:09:05.867+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:09:00+00:00, run_after=2024-04-04T23:10:00+00:00 2024-04-04T23:09:05.917227957Z [2024-04-04T23:09:05.916+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:08:00+00:00 exited with status success for try_number 1 2024-04-04T23:09:05.926988161Z [2024-04-04T23:09:05.926+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:08:00+00:00, map_index=-1, run_start_date=2024-04-04 23:09:03.104303+00:00, run_end_date=2024-04-04 23:09:04.784291+00:00, run_duration=1.679988, state=success, executor_state=success, try_number=1, max_tries=1, job_id=191, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:09:00.504453+00:00, queued_by_job_id=1, pid=2885 2024-04-04T23:09:07.884643598Z [2024-04-04T23:09:07.884+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:09:07.884813887Z [2024-04-04T23:09:07.884+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:08:00+00:00, run_id=scheduled__2024-04-04T23:08:00+00:00, run_start_date=2024-04-04 23:09:00.433111+00:00, run_end_date=2024-04-04 23:09:07.884494+00:00, run_duration=7.451383, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:08:00+00:00, data_interval_end=2024-04-04 23:09:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:09:07.902704048Z [2024-04-04T23:09:07.902+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:09:00+00:00, run_after=2024-04-04T23:10:00+00:00 2024-04-04T23:09:07.943839945Z [2024-04-04T23:09:07.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:08:00+00:00 exited with status success for try_number 1 2024-04-04T23:09:07.950687053Z [2024-04-04T23:09:07.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:08:00+00:00, map_index=-1, run_start_date=2024-04-04 23:09:03.498315+00:00, run_end_date=2024-04-04 23:09:07.015991+00:00, run_duration=3.517676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=192, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:09:00.504453+00:00, queued_by_job_id=1, pid=2896 2024-04-04T23:10:00.265643011Z [2024-04-04T23:10:00.265+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:10:00.278139724Z [2024-04-04T23:10:00.277+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:10:00+00:00, run_after=2024-04-04T23:11:00+00:00 2024-04-04T23:10:00.291064566Z [2024-04-04T23:10:00.290+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:10:00+00:00, run_after=2024-04-04T23:15:00+00:00 2024-04-04T23:10:00.297989863Z [2024-04-04T23:10:00.297+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:10:00.310101854Z [2024-04-04T23:10:00.309+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:10:00+00:00, run_after=2024-04-04T23:11:00+00:00 2024-04-04T23:10:00.434749502Z [2024-04-04T23:10:00.434+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-04T23:10:00.434789464Z 2024-04-04T23:10:00.434793189Z 2024-04-04T23:10:00.434799644Z 2024-04-04T23:10:00.434802877Z 2024-04-04T23:10:00.434805960Z 2024-04-04T23:10:00.434821152Z [2024-04-04T23:10:00.434+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:10:00.434969047Z [2024-04-04T23:10:00.434+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:10:00.435049733Z [2024-04-04T23:10:00.434+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:10:00.435132348Z [2024-04-04T23:10:00.435+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:10:00.435238266Z [2024-04-04T23:10:00.435+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:10:00.436125336Z [2024-04-04T23:10:00.435+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:10:00.436138757Z 2024-04-04T23:10:00.436142536Z 2024-04-04T23:10:00.436146052Z 2024-04-04T23:10:00.436149108Z 2024-04-04T23:10:00.436152091Z 2024-04-04T23:10:00.440932935Z [2024-04-04T23:10:00.440+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T23:10:00.441041186Z [2024-04-04T23:10:00.440+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:10:00.441333697Z [2024-04-04T23:10:00.441+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:10:00.441501240Z [2024-04-04T23:10:00.441+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:10:00.441676841Z [2024-04-04T23:10:00.441+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:10:00.441822401Z [2024-04-04T23:10:00.441+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:10:00.442057382Z [2024-04-04T23:10:00.441+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:10:00.442170334Z [2024-04-04T23:10:00.442+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:10:00.442466890Z [2024-04-04T23:10:00.442+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:10:00.442581555Z [2024-04-04T23:10:00.442+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:10:01.100610437Z [2024-04-04T23:10:01.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:05:00+00:00 exited with status queued for try_number 1 2024-04-04T23:10:01.101068879Z [2024-04-04T23:10:01.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:08:00+00:00 exited with status queued for try_number 1 2024-04-04T23:10:01.101467524Z [2024-04-04T23:10:01.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:09:00+00:00 exited with status queued for try_number 1 2024-04-04T23:10:01.102015249Z [2024-04-04T23:10:01.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:09:00+00:00 exited with status queued for try_number 1 2024-04-04T23:10:01.102324749Z [2024-04-04T23:10:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:09:00+00:00 exited with status queued for try_number 1 2024-04-04T23:10:01.119455440Z [2024-04-04T23:10:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0bcb0e7c-8348-4705-84f6-17ea67cc64d5 2024-04-04T23:10:01.123177011Z [2024-04-04T23:10:01.119+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f49c8e7-7513-41b2-b7e4-8f97f0a35efc 2024-04-04T23:10:01.128706460Z [2024-04-04T23:10:01.128+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19a4bd2b-b1cd-4645-88e9-da3b0734d548 2024-04-04T23:10:01.133852900Z [2024-04-04T23:10:01.130+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b60abe2-2b73-452b-8201-f9eae5e696a5 2024-04-04T23:10:01.134515834Z [2024-04-04T23:10:01.134+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea79aff1-7890-4cbb-a455-1c1c584e24d5 2024-04-04T23:10:03.257188912Z [2024-04-04T23:10:03.256+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:10:03.258473986Z [2024-04-04T23:10:03.258+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:08:00+00:00, run_id=scheduled__2024-04-04T23:08:00+00:00, run_start_date=2024-04-04 23:10:00.322546+00:00, run_end_date=2024-04-04 23:10:03.257045+00:00, run_duration=2.934499, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:08:00+00:00, data_interval_end=2024-04-04 23:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:10:03.271460919Z [2024-04-04T23:10:03.271+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:10:00+00:00, run_after=2024-04-04T23:12:00+00:00 2024-04-04T23:10:04.405672544Z [2024-04-04T23:10:04.404+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:10:04.405709872Z [2024-04-04T23:10:04.405+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:09:00+00:00, run_id=scheduled__2024-04-04T23:09:00+00:00, run_start_date=2024-04-04 23:10:00.323970+00:00, run_end_date=2024-04-04 23:10:04.405148+00:00, run_duration=4.081178, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:09:00+00:00, data_interval_end=2024-04-04 23:10:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:10:04.421816147Z [2024-04-04T23:10:04.421+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:10:00+00:00, run_after=2024-04-04T23:11:00+00:00 2024-04-04T23:10:04.483526787Z [2024-04-04T23:10:04.483+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:10:04.483553345Z 2024-04-04T23:10:04.483678457Z [2024-04-04T23:10:04.483+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:10:04.484477447Z [2024-04-04T23:10:04.484+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:10:04.484491235Z 2024-04-04T23:10:04.488884396Z [2024-04-04T23:10:04.488+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-04T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T23:10:04.489116646Z [2024-04-04T23:10:04.488+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-04T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:10:04.560251459Z [2024-04-04T23:10:04.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:05:00+00:00 exited with status queued for try_number 1 2024-04-04T23:10:04.560464552Z [2024-04-04T23:10:04.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:05:00+00:00 exited with status success for try_number 1 2024-04-04T23:10:04.560625697Z [2024-04-04T23:10:04.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:08:00+00:00 exited with status success for try_number 1 2024-04-04T23:10:04.560816256Z [2024-04-04T23:10:04.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:09:00+00:00 exited with status success for try_number 1 2024-04-04T23:10:04.574056364Z [2024-04-04T23:10:04.573+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T23:05:00+00:00, map_index=-1, run_start_date=2024-04-04 23:10:03.925413+00:00, run_end_date=2024-04-04 23:10:04.292356+00:00, run_duration=0.366943, state=success, executor_state=success, try_number=1, max_tries=1, job_id=195, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:10:00.437459+00:00, queued_by_job_id=1, pid=2952 2024-04-04T23:10:04.574506940Z [2024-04-04T23:10:04.574+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:08:00+00:00, map_index=-1, run_start_date=2024-04-04 23:10:02.632201+00:00, run_end_date=2024-04-04 23:10:03.205786+00:00, run_duration=0.573585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=193, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:10:00.437459+00:00, queued_by_job_id=1, pid=2927 2024-04-04T23:10:04.574782209Z [2024-04-04T23:10:04.574+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:09:00+00:00, map_index=-1, run_start_date=2024-04-04 23:10:02.805336+00:00, run_end_date=2024-04-04 23:10:03.485380+00:00, run_duration=0.680044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:10:00.437459+00:00, queued_by_job_id=1, pid=2929 2024-04-04T23:10:04.575063409Z [2024-04-04T23:10:04.574+0000] {scheduler_job.py:635} INFO - Setting external_id for to debda3d8-abe6-43b4-8b64-6faa637333ed 2024-04-04T23:10:05.734084646Z [2024-04-04T23:10:05.733+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:10:05.734952021Z [2024-04-04T23:10:05.734+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:09:00+00:00, run_id=scheduled__2024-04-04T23:09:00+00:00, run_start_date=2024-04-04 23:10:00.325304+00:00, run_end_date=2024-04-04 23:10:05.734405+00:00, run_duration=5.409101, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:09:00+00:00, data_interval_end=2024-04-04 23:10:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:10:05.749727354Z [2024-04-04T23:10:05.749+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:10:00+00:00, run_after=2024-04-04T23:11:00+00:00 2024-04-04T23:10:05.812107492Z [2024-04-04T23:10:05.811+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:09:00+00:00 exited with status success for try_number 1 2024-04-04T23:10:05.817860371Z [2024-04-04T23:10:05.817+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:09:00+00:00, map_index=-1, run_start_date=2024-04-04 23:10:04.022744+00:00, run_end_date=2024-04-04 23:10:05.259337+00:00, run_duration=1.236593, state=success, executor_state=success, try_number=1, max_tries=1, job_id=196, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:10:00.437459+00:00, queued_by_job_id=1, pid=2956 2024-04-04T23:10:06.856849308Z [2024-04-04T23:10:06.856+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:10:06.857053702Z [2024-04-04T23:10:06.856+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:09:00+00:00, run_id=scheduled__2024-04-04T23:09:00+00:00, run_start_date=2024-04-04 23:10:00.326400+00:00, run_end_date=2024-04-04 23:10:06.856651+00:00, run_duration=6.530251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:09:00+00:00, data_interval_end=2024-04-04 23:10:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:10:06.866623584Z [2024-04-04T23:10:06.866+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:10:00+00:00, run_after=2024-04-04T23:11:00+00:00 2024-04-04T23:10:06.896439926Z [2024-04-04T23:10:06.896+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:10:06.896466544Z 2024-04-04T23:10:06.896479416Z [2024-04-04T23:10:06.896+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:10:06.897107367Z [2024-04-04T23:10:06.896+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:10:06.897159525Z 2024-04-04T23:10:06.900156059Z [2024-04-04T23:10:06.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-04T23:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T23:10:06.900209321Z [2024-04-04T23:10:06.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-04T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T23:10:06.950862341Z [2024-04-04T23:10:06.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:05:00+00:00 exited with status queued for try_number 1 2024-04-04T23:10:06.950889226Z [2024-04-04T23:10:06.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:09:00+00:00 exited with status success for try_number 1 2024-04-04T23:10:06.950933681Z [2024-04-04T23:10:06.950+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:05:00+00:00 exited with status success for try_number 1 2024-04-04T23:10:06.958523789Z [2024-04-04T23:10:06.958+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-04T23:05:00+00:00, map_index=-1, run_start_date=2024-04-04 23:10:06.166674+00:00, run_end_date=2024-04-04 23:10:06.497558+00:00, run_duration=0.330884, state=success, executor_state=success, try_number=1, max_tries=1, job_id=198, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:10:04.484958+00:00, queued_by_job_id=1, pid=2980 2024-04-04T23:10:06.958613100Z [2024-04-04T23:10:06.958+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5b07772-a30f-4237-bae9-8ed6c9cdef8f 2024-04-04T23:10:06.958806882Z [2024-04-04T23:10:06.958+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:09:00+00:00, map_index=-1, run_start_date=2024-04-04 23:10:04.192839+00:00, run_end_date=2024-04-04 23:10:05.760009+00:00, run_duration=1.56717, state=success, executor_state=success, try_number=1, max_tries=1, job_id=197, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:10:00.437459+00:00, queued_by_job_id=1, pid=2957 2024-04-04T23:10:09.373924245Z [2024-04-04T23:10:09.373+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:10:09.373945684Z 2024-04-04T23:10:09.374073577Z [2024-04-04T23:10:09.373+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:10:09.375221520Z [2024-04-04T23:10:09.374+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:10:09.375239427Z 2024-04-04T23:10:09.378980513Z [2024-04-04T23:10:09.378+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-04T23:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:10:09.379167323Z [2024-04-04T23:10:09.378+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-04T23:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:10:09.436322408Z [2024-04-04T23:10:09.435+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:05:00+00:00 exited with status queued for try_number 1 2024-04-04T23:10:09.436351301Z [2024-04-04T23:10:09.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:05:00+00:00 exited with status success for try_number 1 2024-04-04T23:10:09.448883206Z [2024-04-04T23:10:09.448+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e0b97f3-3d3e-4608-98e8-815029a96948 2024-04-04T23:10:09.449320543Z [2024-04-04T23:10:09.448+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-04T23:05:00+00:00, map_index=0, run_start_date=2024-04-04 23:10:08.529333+00:00, run_end_date=2024-04-04 23:10:08.867396+00:00, run_duration=0.338063, state=success, executor_state=success, try_number=1, max_tries=1, job_id=199, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:10:06.897547+00:00, queued_by_job_id=1, pid=2988 2024-04-04T23:10:11.704625265Z [2024-04-04T23:10:11.704+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:10:11.705036994Z [2024-04-04T23:10:11.704+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:05:00+00:00, run_id=scheduled__2024-04-04T23:05:00+00:00, run_start_date=2024-04-04 23:10:00.321360+00:00, run_end_date=2024-04-04 23:10:11.704512+00:00, run_duration=11.383152, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:05:00+00:00, data_interval_end=2024-04-04 23:10:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-04T23:10:11.715284684Z [2024-04-04T23:10:11.714+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:10:00+00:00, run_after=2024-04-04T23:15:00+00:00 2024-04-04T23:10:11.751500332Z [2024-04-04T23:10:11.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:05:00+00:00 exited with status success for try_number 1 2024-04-04T23:10:11.760672178Z [2024-04-04T23:10:11.759+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-04T23:05:00+00:00, map_index=-1, run_start_date=2024-04-04 23:10:11.028597+00:00, run_end_date=2024-04-04 23:10:11.438375+00:00, run_duration=0.409778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=200, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:10:09.376136+00:00, queued_by_job_id=1, pid=3007 2024-04-04T23:10:39.489778304Z [2024-04-04T23:10:39.489+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-04T23:11:00.662513356Z [2024-04-04T23:11:00.662+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:11:00.675847006Z [2024-04-04T23:11:00.675+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:11:00+00:00, run_after=2024-04-04T23:12:00+00:00 2024-04-04T23:11:00.690472410Z [2024-04-04T23:11:00.690+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:11:00+00:00, run_after=2024-04-04T23:12:00+00:00 2024-04-04T23:11:00.778265031Z [2024-04-04T23:11:00.777+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:11:00.778292868Z 2024-04-04T23:11:00.778296702Z 2024-04-04T23:11:00.778299944Z 2024-04-04T23:11:00.778315445Z [2024-04-04T23:11:00.778+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:11:00.778438263Z [2024-04-04T23:11:00.778+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:11:00.778498178Z [2024-04-04T23:11:00.778+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:11:00.779361615Z [2024-04-04T23:11:00.779+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:11:00.779375119Z 2024-04-04T23:11:00.779378843Z 2024-04-04T23:11:00.779382199Z 2024-04-04T23:11:00.783594177Z [2024-04-04T23:11:00.783+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:11:00.783725639Z [2024-04-04T23:11:00.783+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:11:00.784086872Z [2024-04-04T23:11:00.783+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:11:00.784241422Z [2024-04-04T23:11:00.784+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:11:00.784419156Z [2024-04-04T23:11:00.784+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:11:00.784489116Z [2024-04-04T23:11:00.784+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:11:01.351695816Z [2024-04-04T23:11:01.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:10:00+00:00 exited with status queued for try_number 1 2024-04-04T23:11:01.351721438Z [2024-04-04T23:11:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:10:00+00:00 exited with status queued for try_number 1 2024-04-04T23:11:01.351732726Z [2024-04-04T23:11:01.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:10:00+00:00 exited with status queued for try_number 1 2024-04-04T23:11:01.368980535Z [2024-04-04T23:11:01.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to 488f7089-acc1-4155-a9d0-635774a5d561 2024-04-04T23:11:01.369041737Z [2024-04-04T23:11:01.368+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b91b756-c399-436a-9f37-654c5e899857 2024-04-04T23:11:01.369138153Z [2024-04-04T23:11:01.369+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33ab814b-8aac-437f-a2ed-93326101463a 2024-04-04T23:11:02.537259361Z [2024-04-04T23:11:02.536+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:11:02.537800260Z [2024-04-04T23:11:02.537+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:10:00+00:00, run_id=scheduled__2024-04-04T23:10:00+00:00, run_start_date=2024-04-04 23:11:00.703123+00:00, run_end_date=2024-04-04 23:11:02.537267+00:00, run_duration=1.834144, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:10:00+00:00, data_interval_end=2024-04-04 23:11:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:11:02.566636688Z [2024-04-04T23:11:02.566+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:11:00+00:00, run_after=2024-04-04T23:12:00+00:00 2024-04-04T23:11:02.655858993Z [2024-04-04T23:11:02.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:10:00+00:00 exited with status success for try_number 1 2024-04-04T23:11:02.665034331Z [2024-04-04T23:11:02.664+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:10:00+00:00, map_index=-1, run_start_date=2024-04-04 23:11:01.849852+00:00, run_end_date=2024-04-04 23:11:02.256957+00:00, run_duration=0.407105, state=success, executor_state=success, try_number=1, max_tries=1, job_id=201, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:11:00.780252+00:00, queued_by_job_id=1, pid=3019 2024-04-04T23:11:05.138563227Z [2024-04-04T23:11:05.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:11:05.138914129Z [2024-04-04T23:11:05.138+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:10:00+00:00, run_id=scheduled__2024-04-04T23:10:00+00:00, run_start_date=2024-04-04 23:11:00.704986+00:00, run_end_date=2024-04-04 23:11:05.138449+00:00, run_duration=4.433463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:10:00+00:00, data_interval_end=2024-04-04 23:11:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:11:05.149216264Z [2024-04-04T23:11:05.148+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:11:00+00:00, run_after=2024-04-04T23:12:00+00:00 2024-04-04T23:11:05.155454970Z [2024-04-04T23:11:05.155+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:11:05.155835756Z [2024-04-04T23:11:05.155+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:10:00+00:00, run_id=scheduled__2024-04-04T23:10:00+00:00, run_start_date=2024-04-04 23:11:00.706287+00:00, run_end_date=2024-04-04 23:11:05.155355+00:00, run_duration=4.449068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:10:00+00:00, data_interval_end=2024-04-04 23:11:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:11:05.165422911Z [2024-04-04T23:11:05.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:11:00+00:00, run_after=2024-04-04T23:12:00+00:00 2024-04-04T23:11:05.191427897Z [2024-04-04T23:11:05.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:10:00+00:00 exited with status success for try_number 1 2024-04-04T23:11:05.191623500Z [2024-04-04T23:11:05.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:10:00+00:00 exited with status success for try_number 1 2024-04-04T23:11:05.198127792Z [2024-04-04T23:11:05.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:10:00+00:00, map_index=-1, run_start_date=2024-04-04 23:11:03.061811+00:00, run_end_date=2024-04-04 23:11:04.885934+00:00, run_duration=1.824123, state=success, executor_state=success, try_number=1, max_tries=1, job_id=203, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:11:00.780252+00:00, queued_by_job_id=1, pid=3037 2024-04-04T23:11:05.198337051Z [2024-04-04T23:11:05.198+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:10:00+00:00, map_index=-1, run_start_date=2024-04-04 23:11:03.071869+00:00, run_end_date=2024-04-04 23:11:04.369155+00:00, run_duration=1.297286, state=success, executor_state=success, try_number=1, max_tries=1, job_id=202, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:11:00.780252+00:00, queued_by_job_id=1, pid=3038 2024-04-04T23:12:01.047954176Z [2024-04-04T23:12:01.046+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:12:01.065868902Z [2024-04-04T23:12:01.065+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:12:00+00:00, run_after=2024-04-04T23:13:00+00:00 2024-04-04T23:12:01.083034417Z [2024-04-04T23:12:01.082+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:12:00+00:00, run_after=2024-04-04T23:13:00+00:00 2024-04-04T23:12:01.094332648Z [2024-04-04T23:12:01.093+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:12:01.214962728Z [2024-04-04T23:12:01.214+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:12:01.214988405Z 2024-04-04T23:12:01.214992465Z 2024-04-04T23:12:01.214995724Z 2024-04-04T23:12:01.214998934Z 2024-04-04T23:12:01.215002866Z [2024-04-04T23:12:01.214+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:12:01.222057505Z [2024-04-04T23:12:01.214+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:12:01.222076355Z [2024-04-04T23:12:01.215+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:12:01.222080357Z [2024-04-04T23:12:01.215+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:12:01.222084496Z [2024-04-04T23:12:01.215+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:12:01.222088341Z 2024-04-04T23:12:01.222091643Z 2024-04-04T23:12:01.222094871Z 2024-04-04T23:12:01.222098025Z 2024-04-04T23:12:01.222744756Z [2024-04-04T23:12:01.222+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:12:01.231804240Z [2024-04-04T23:12:01.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:12:01.231849275Z [2024-04-04T23:12:01.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:12:01.231854764Z [2024-04-04T23:12:01.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:12:01.231859267Z [2024-04-04T23:12:01.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:12:01.231863528Z [2024-04-04T23:12:01.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:12:01.231868135Z [2024-04-04T23:12:01.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:12:01.231872539Z [2024-04-04T23:12:01.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:12:01.798934155Z [2024-04-04T23:12:01.797+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:10:00+00:00 exited with status queued for try_number 1 2024-04-04T23:12:01.798973761Z [2024-04-04T23:12:01.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:11:00+00:00 exited with status queued for try_number 1 2024-04-04T23:12:01.798980088Z [2024-04-04T23:12:01.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:11:00+00:00 exited with status queued for try_number 1 2024-04-04T23:12:01.798985160Z [2024-04-04T23:12:01.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:11:00+00:00 exited with status queued for try_number 1 2024-04-04T23:12:01.841812223Z [2024-04-04T23:12:01.841+0000] {scheduler_job.py:635} INFO - Setting external_id for to e15dcf6e-a589-4de2-8c37-c113b512e3d0 2024-04-04T23:12:01.842344091Z [2024-04-04T23:12:01.841+0000] {scheduler_job.py:635} INFO - Setting external_id for to e1273152-9b12-41fd-aa54-4f9675cb6412 2024-04-04T23:12:01.842632702Z [2024-04-04T23:12:01.842+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a72d062-24d8-482c-a84c-18e095af3ccc 2024-04-04T23:12:01.848213916Z [2024-04-04T23:12:01.847+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c7ed1df-20f2-4b94-96b0-853084640bc5 2024-04-04T23:12:03.054419462Z [2024-04-04T23:12:03.053+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:12:03.054823445Z [2024-04-04T23:12:03.054+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:11:00+00:00, run_id=scheduled__2024-04-04T23:11:00+00:00, run_start_date=2024-04-04 23:12:01.110045+00:00, run_end_date=2024-04-04 23:12:03.054287+00:00, run_duration=1.944242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:11:00+00:00, data_interval_end=2024-04-04 23:12:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:12:03.065412185Z [2024-04-04T23:12:03.065+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:12:00+00:00, run_after=2024-04-04T23:13:00+00:00 2024-04-04T23:12:03.127355595Z [2024-04-04T23:12:03.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:11:00+00:00 exited with status success for try_number 1 2024-04-04T23:12:03.136704322Z [2024-04-04T23:12:03.136+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:11:00+00:00, map_index=-1, run_start_date=2024-04-04 23:12:02.276877+00:00, run_end_date=2024-04-04 23:12:02.755631+00:00, run_duration=0.478754, state=success, executor_state=success, try_number=1, max_tries=1, job_id=204, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:12:01.216741+00:00, queued_by_job_id=1, pid=3071 2024-04-04T23:12:03.760953740Z [2024-04-04T23:12:03.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:12:03.761153242Z [2024-04-04T23:12:03.760+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:10:00+00:00, run_id=scheduled__2024-04-04T23:10:00+00:00, run_start_date=2024-04-04 23:12:01.107042+00:00, run_end_date=2024-04-04 23:12:03.760837+00:00, run_duration=2.653795, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:10:00+00:00, data_interval_end=2024-04-04 23:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:12:03.771137567Z [2024-04-04T23:12:03.770+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:12:00+00:00, run_after=2024-04-04T23:14:00+00:00 2024-04-04T23:12:03.848440341Z [2024-04-04T23:12:03.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:10:00+00:00 exited with status success for try_number 1 2024-04-04T23:12:03.856739871Z [2024-04-04T23:12:03.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:10:00+00:00, map_index=-1, run_start_date=2024-04-04 23:12:02.512613+00:00, run_end_date=2024-04-04 23:12:03.069846+00:00, run_duration=0.557233, state=success, executor_state=success, try_number=1, max_tries=1, job_id=205, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:12:01.216741+00:00, queued_by_job_id=1, pid=3072 2024-04-04T23:12:06.001882773Z [2024-04-04T23:12:06.001+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:12:06.002196407Z [2024-04-04T23:12:06.001+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:11:00+00:00, run_id=scheduled__2024-04-04T23:11:00+00:00, run_start_date=2024-04-04 23:12:01.111999+00:00, run_end_date=2024-04-04 23:12:06.001841+00:00, run_duration=4.889842, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:11:00+00:00, data_interval_end=2024-04-04 23:12:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:12:06.011157131Z [2024-04-04T23:12:06.010+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:12:00+00:00, run_after=2024-04-04T23:13:00+00:00 2024-04-04T23:12:06.049735502Z [2024-04-04T23:12:06.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:11:00+00:00 exited with status success for try_number 1 2024-04-04T23:12:06.055807104Z [2024-04-04T23:12:06.055+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:11:00+00:00, map_index=-1, run_start_date=2024-04-04 23:12:03.735725+00:00, run_end_date=2024-04-04 23:12:05.650384+00:00, run_duration=1.914659, state=success, executor_state=success, try_number=1, max_tries=1, job_id=206, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:12:01.216741+00:00, queued_by_job_id=1, pid=3090 2024-04-04T23:12:07.097943119Z [2024-04-04T23:12:07.097+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:12:07.098276036Z [2024-04-04T23:12:07.098+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:11:00+00:00, run_id=scheduled__2024-04-04T23:11:00+00:00, run_start_date=2024-04-04 23:12:01.113753+00:00, run_end_date=2024-04-04 23:12:07.097824+00:00, run_duration=5.984071, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:11:00+00:00, data_interval_end=2024-04-04 23:12:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:12:07.111974185Z [2024-04-04T23:12:07.111+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:12:00+00:00, run_after=2024-04-04T23:13:00+00:00 2024-04-04T23:12:07.145629022Z [2024-04-04T23:12:07.145+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:11:00+00:00 exited with status success for try_number 1 2024-04-04T23:12:07.152978515Z [2024-04-04T23:12:07.152+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:11:00+00:00, map_index=-1, run_start_date=2024-04-04 23:12:04.106028+00:00, run_end_date=2024-04-04 23:12:06.606526+00:00, run_duration=2.500498, state=success, executor_state=success, try_number=1, max_tries=1, job_id=207, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:12:01.216741+00:00, queued_by_job_id=1, pid=3101 2024-04-04T23:13:00.693344715Z [2024-04-04T23:13:00.692+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:13:00+00:00, run_after=2024-04-04T23:14:00+00:00 2024-04-04T23:13:00.705324935Z [2024-04-04T23:13:00.704+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:13:00.718840602Z [2024-04-04T23:13:00.718+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:13:00+00:00, run_after=2024-04-04T23:14:00+00:00 2024-04-04T23:13:00.803966474Z [2024-04-04T23:13:00.803+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:13:00.803994968Z 2024-04-04T23:13:00.803998930Z 2024-04-04T23:13:00.804002250Z 2024-04-04T23:13:00.804062928Z [2024-04-04T23:13:00.803+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:13:00.804067931Z [2024-04-04T23:13:00.803+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:13:00.804142616Z [2024-04-04T23:13:00.804+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:13:00.805083351Z [2024-04-04T23:13:00.804+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:13:00.805095688Z 2024-04-04T23:13:00.805099208Z 2024-04-04T23:13:00.805102364Z 2024-04-04T23:13:00.812181450Z [2024-04-04T23:13:00.811+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:13:00.812258722Z [2024-04-04T23:13:00.812+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:13:00.812459785Z [2024-04-04T23:13:00.812+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:13:00.812532311Z [2024-04-04T23:13:00.812+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:13:00.812715818Z [2024-04-04T23:13:00.812+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:13:00.812813504Z [2024-04-04T23:13:00.812+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:13:01.187834688Z [2024-04-04T23:13:01.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:12:00+00:00 exited with status queued for try_number 1 2024-04-04T23:13:01.187859361Z [2024-04-04T23:13:01.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:12:00+00:00 exited with status queued for try_number 1 2024-04-04T23:13:01.207691078Z [2024-04-04T23:13:01.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:12:00+00:00 exited with status queued for try_number 1 2024-04-04T23:13:01.230244386Z [2024-04-04T23:13:01.229+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98f9fa13-b1df-4a48-b43b-274d107e43af 2024-04-04T23:13:01.231471108Z [2024-04-04T23:13:01.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to 205fd1a1-eeae-49dd-bf2b-334404075978 2024-04-04T23:13:01.231486043Z [2024-04-04T23:13:01.230+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f6b53a0-e1b4-4b04-93bc-141335fa77d6 2024-04-04T23:13:03.758216156Z [2024-04-04T23:13:03.757+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:13:03.759024210Z [2024-04-04T23:13:03.758+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:12:00+00:00, run_id=scheduled__2024-04-04T23:12:00+00:00, run_start_date=2024-04-04 23:13:00.747193+00:00, run_end_date=2024-04-04 23:13:03.758052+00:00, run_duration=3.010859, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:12:00+00:00, data_interval_end=2024-04-04 23:13:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:13:03.769681319Z [2024-04-04T23:13:03.769+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:13:00+00:00, run_after=2024-04-04T23:14:00+00:00 2024-04-04T23:13:03.836018726Z [2024-04-04T23:13:03.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:12:00+00:00 exited with status success for try_number 1 2024-04-04T23:13:03.842449176Z [2024-04-04T23:13:03.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:12:00+00:00, map_index=-1, run_start_date=2024-04-04 23:13:01.826329+00:00, run_end_date=2024-04-04 23:13:02.660013+00:00, run_duration=0.833684, state=success, executor_state=success, try_number=1, max_tries=1, job_id=208, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:13:00.805723+00:00, queued_by_job_id=1, pid=3129 2024-04-04T23:13:05.750760309Z [2024-04-04T23:13:05.750+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:13:05.751124532Z [2024-04-04T23:13:05.750+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:12:00+00:00, run_id=scheduled__2024-04-04T23:12:00+00:00, run_start_date=2024-04-04 23:13:00.751987+00:00, run_end_date=2024-04-04 23:13:05.750755+00:00, run_duration=4.998768, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:12:00+00:00, data_interval_end=2024-04-04 23:13:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:13:05.762533309Z [2024-04-04T23:13:05.762+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:13:00+00:00, run_after=2024-04-04T23:14:00+00:00 2024-04-04T23:13:05.803215245Z [2024-04-04T23:13:05.802+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:12:00+00:00 exited with status success for try_number 1 2024-04-04T23:13:05.809231669Z [2024-04-04T23:13:05.808+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:12:00+00:00, map_index=-1, run_start_date=2024-04-04 23:13:03.301108+00:00, run_end_date=2024-04-04 23:13:05.248361+00:00, run_duration=1.947253, state=success, executor_state=success, try_number=1, max_tries=1, job_id=209, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:13:00.805723+00:00, queued_by_job_id=1, pid=3142 2024-04-04T23:13:06.869833568Z [2024-04-04T23:13:06.869+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:13:06.870316233Z [2024-04-04T23:13:06.870+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:12:00+00:00, run_id=scheduled__2024-04-04T23:12:00+00:00, run_start_date=2024-04-04 23:13:00.753342+00:00, run_end_date=2024-04-04 23:13:06.869812+00:00, run_duration=6.11647, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:12:00+00:00, data_interval_end=2024-04-04 23:13:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:13:06.884099686Z [2024-04-04T23:13:06.883+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:13:00+00:00, run_after=2024-04-04T23:14:00+00:00 2024-04-04T23:13:06.925620827Z [2024-04-04T23:13:06.925+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:12:00+00:00 exited with status success for try_number 1 2024-04-04T23:13:06.931798833Z [2024-04-04T23:13:06.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:12:00+00:00, map_index=-1, run_start_date=2024-04-04 23:13:03.635269+00:00, run_end_date=2024-04-04 23:13:06.052445+00:00, run_duration=2.417176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=210, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:13:00.805723+00:00, queued_by_job_id=1, pid=3151 2024-04-04T23:14:00.436824316Z [2024-04-04T23:14:00.436+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:14:00.454686861Z [2024-04-04T23:14:00.452+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:14:00.471769775Z [2024-04-04T23:14:00.471+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:14:00+00:00, run_after=2024-04-04T23:15:00+00:00 2024-04-04T23:14:00.485690725Z [2024-04-04T23:14:00.485+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:14:00+00:00, run_after=2024-04-04T23:15:00+00:00 2024-04-04T23:14:00.567536842Z [2024-04-04T23:14:00.567+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:14:00.567580822Z 2024-04-04T23:14:00.567586361Z 2024-04-04T23:14:00.567589813Z 2024-04-04T23:14:00.567593268Z 2024-04-04T23:14:00.567955334Z [2024-04-04T23:14:00.567+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:14:00.568144582Z [2024-04-04T23:14:00.568+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:14:00.568316570Z [2024-04-04T23:14:00.568+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:14:00.568487675Z [2024-04-04T23:14:00.568+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:14:00.569307436Z [2024-04-04T23:14:00.569+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:14:00.569319524Z 2024-04-04T23:14:00.569323146Z 2024-04-04T23:14:00.569326662Z 2024-04-04T23:14:00.569351763Z 2024-04-04T23:14:00.573248330Z [2024-04-04T23:14:00.572+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:14:00.573734850Z [2024-04-04T23:14:00.573+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:14:00.574063744Z [2024-04-04T23:14:00.573+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:14:00.574228804Z [2024-04-04T23:14:00.574+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:14:00.574596677Z [2024-04-04T23:14:00.574+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:14:00.574815614Z [2024-04-04T23:14:00.574+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:14:00.575098024Z [2024-04-04T23:14:00.574+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:14:00.575271384Z [2024-04-04T23:14:00.575+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:14:01.255353680Z [2024-04-04T23:14:01.254+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:12:00+00:00 exited with status queued for try_number 1 2024-04-04T23:14:01.303811655Z [2024-04-04T23:14:01.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:13:00+00:00 exited with status queued for try_number 1 2024-04-04T23:14:01.307744492Z [2024-04-04T23:14:01.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:13:00+00:00 exited with status queued for try_number 1 2024-04-04T23:14:01.308032979Z [2024-04-04T23:14:01.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:13:00+00:00 exited with status queued for try_number 1 2024-04-04T23:14:01.360405552Z [2024-04-04T23:14:01.354+0000] {scheduler_job.py:635} INFO - Setting external_id for to e779d3d5-84ab-4731-bd9c-a77e9bb1673c 2024-04-04T23:14:01.360841054Z [2024-04-04T23:14:01.360+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d57783d-64ca-423f-861b-8fe4fd88d8a1 2024-04-04T23:14:01.366339072Z [2024-04-04T23:14:01.364+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f2b0404-77f9-4315-ab9b-08ddb38f7579 2024-04-04T23:14:01.369839030Z [2024-04-04T23:14:01.369+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62e62863-855a-4e5d-88f2-5219087c725e 2024-04-04T23:14:03.920248436Z [2024-04-04T23:14:03.919+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:14:03.920463079Z [2024-04-04T23:14:03.920+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:12:00+00:00, run_id=scheduled__2024-04-04T23:12:00+00:00, run_start_date=2024-04-04 23:14:00.498122+00:00, run_end_date=2024-04-04 23:14:03.920147+00:00, run_duration=3.422025, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:12:00+00:00, data_interval_end=2024-04-04 23:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:14:03.930505644Z [2024-04-04T23:14:03.930+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:14:00+00:00, run_after=2024-04-04T23:16:00+00:00 2024-04-04T23:14:03.939850456Z [2024-04-04T23:14:03.939+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:14:03.940132271Z [2024-04-04T23:14:03.939+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:13:00+00:00, run_id=scheduled__2024-04-04T23:13:00+00:00, run_start_date=2024-04-04 23:14:00.499397+00:00, run_end_date=2024-04-04 23:14:03.939805+00:00, run_duration=3.440408, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:13:00+00:00, data_interval_end=2024-04-04 23:14:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:14:03.962863449Z [2024-04-04T23:14:03.962+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:14:00+00:00, run_after=2024-04-04T23:15:00+00:00 2024-04-04T23:14:04.016210518Z [2024-04-04T23:14:04.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:12:00+00:00 exited with status success for try_number 1 2024-04-04T23:14:04.018466888Z [2024-04-04T23:14:04.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:13:00+00:00 exited with status success for try_number 1 2024-04-04T23:14:04.026056594Z [2024-04-04T23:14:04.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:12:00+00:00, map_index=-1, run_start_date=2024-04-04 23:14:02.020380+00:00, run_end_date=2024-04-04 23:14:02.849164+00:00, run_duration=0.828784, state=success, executor_state=success, try_number=1, max_tries=1, job_id=211, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:14:00.570239+00:00, queued_by_job_id=1, pid=3182 2024-04-04T23:14:04.026288250Z [2024-04-04T23:14:04.026+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:13:00+00:00, map_index=-1, run_start_date=2024-04-04 23:14:02.127177+00:00, run_end_date=2024-04-04 23:14:02.968385+00:00, run_duration=0.841208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=212, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:14:00.570239+00:00, queued_by_job_id=1, pid=3183 2024-04-04T23:14:06.456787953Z [2024-04-04T23:14:06.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:14:06.457330610Z [2024-04-04T23:14:06.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:13:00+00:00, run_id=scheduled__2024-04-04T23:13:00+00:00, run_start_date=2024-04-04 23:14:00.500510+00:00, run_end_date=2024-04-04 23:14:06.456666+00:00, run_duration=5.956156, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:13:00+00:00, data_interval_end=2024-04-04 23:14:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:14:06.466990416Z [2024-04-04T23:14:06.466+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:14:00+00:00, run_after=2024-04-04T23:15:00+00:00 2024-04-04T23:14:06.477387456Z [2024-04-04T23:14:06.476+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:14:06.477815009Z [2024-04-04T23:14:06.477+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:13:00+00:00, run_id=scheduled__2024-04-04T23:13:00+00:00, run_start_date=2024-04-04 23:14:00.501567+00:00, run_end_date=2024-04-04 23:14:06.477241+00:00, run_duration=5.975674, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:13:00+00:00, data_interval_end=2024-04-04 23:14:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:14:06.488349090Z [2024-04-04T23:14:06.488+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:14:00+00:00, run_after=2024-04-04T23:15:00+00:00 2024-04-04T23:14:06.535421261Z [2024-04-04T23:14:06.534+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:13:00+00:00 exited with status success for try_number 1 2024-04-04T23:14:06.542170105Z [2024-04-04T23:14:06.541+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:13:00+00:00, map_index=-1, run_start_date=2024-04-04 23:14:03.964529+00:00, run_end_date=2024-04-04 23:14:06.085129+00:00, run_duration=2.1206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=214, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:14:00.570239+00:00, queued_by_job_id=1, pid=3207 2024-04-04T23:14:07.636967827Z [2024-04-04T23:14:07.635+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:13:00+00:00 exited with status success for try_number 1 2024-04-04T23:14:07.641584677Z [2024-04-04T23:14:07.640+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:13:00+00:00, map_index=-1, run_start_date=2024-04-04 23:14:03.838246+00:00, run_end_date=2024-04-04 23:14:06.384127+00:00, run_duration=2.545881, state=success, executor_state=success, try_number=1, max_tries=1, job_id=213, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:14:00.570239+00:00, queued_by_job_id=1, pid=3206 2024-04-04T23:15:00.111685376Z [2024-04-04T23:15:00.111+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:15:00+00:00, run_after=2024-04-04T23:16:00+00:00 2024-04-04T23:15:00.127724439Z [2024-04-04T23:15:00.127+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:15:00+00:00, run_after=2024-04-04T23:16:00+00:00 2024-04-04T23:15:00.139870608Z [2024-04-04T23:15:00.139+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:15:00+00:00, run_after=2024-04-04T23:20:00+00:00 2024-04-04T23:15:00.145663396Z [2024-04-04T23:15:00.145+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:15:00.225227056Z [2024-04-04T23:15:00.224+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:15:00.225260380Z 2024-04-04T23:15:00.225267275Z 2024-04-04T23:15:00.225271849Z 2024-04-04T23:15:00.225276714Z 2024-04-04T23:15:00.225483804Z [2024-04-04T23:15:00.225+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:15:00.225578770Z [2024-04-04T23:15:00.225+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:15:00.225697238Z [2024-04-04T23:15:00.225+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:15:00.225807556Z [2024-04-04T23:15:00.225+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:15:00.226499795Z [2024-04-04T23:15:00.226+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:15:00.226511386Z 2024-04-04T23:15:00.226528496Z 2024-04-04T23:15:00.226531726Z 2024-04-04T23:15:00.226534755Z 2024-04-04T23:15:00.230784405Z [2024-04-04T23:15:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T23:15:00.230887369Z [2024-04-04T23:15:00.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:15:00.231231285Z [2024-04-04T23:15:00.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:15:00.231365756Z [2024-04-04T23:15:00.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:15:00.231615659Z [2024-04-04T23:15:00.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:15:00.231814550Z [2024-04-04T23:15:00.231+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:15:00.232011575Z [2024-04-04T23:15:00.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:15:00.232182891Z [2024-04-04T23:15:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:15:00.555101720Z [2024-04-04T23:15:00.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:10:00+00:00 exited with status queued for try_number 1 2024-04-04T23:15:00.555472169Z [2024-04-04T23:15:00.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:14:00+00:00 exited with status queued for try_number 1 2024-04-04T23:15:00.555753150Z [2024-04-04T23:15:00.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:14:00+00:00 exited with status queued for try_number 1 2024-04-04T23:15:00.556050930Z [2024-04-04T23:15:00.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:14:00+00:00 exited with status queued for try_number 1 2024-04-04T23:15:00.565659575Z [2024-04-04T23:15:00.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2a0790e-d9c2-4a5f-a7ff-85d91e42868b 2024-04-04T23:15:00.565985813Z [2024-04-04T23:15:00.565+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6c38200-d691-4e26-bb74-a4d45af66fd6 2024-04-04T23:15:00.566602312Z [2024-04-04T23:15:00.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54ed72be-d0ff-4abf-bf4a-1ee2bfd9c89b 2024-04-04T23:15:00.567010081Z [2024-04-04T23:15:00.566+0000] {scheduler_job.py:635} INFO - Setting external_id for to c02f80ca-bcf6-49bc-86f5-9bc6223c8b07 2024-04-04T23:15:02.412044911Z [2024-04-04T23:15:02.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:15:02.412377965Z [2024-04-04T23:15:02.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:14:00+00:00, run_id=scheduled__2024-04-04T23:14:00+00:00, run_start_date=2024-04-04 23:15:00.155197+00:00, run_end_date=2024-04-04 23:15:02.411981+00:00, run_duration=2.256784, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:14:00+00:00, data_interval_end=2024-04-04 23:15:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:15:02.426439823Z [2024-04-04T23:15:02.426+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:15:00+00:00, run_after=2024-04-04T23:16:00+00:00 2024-04-04T23:15:03.745570475Z [2024-04-04T23:15:03.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:14:00+00:00 exited with status success for try_number 1 2024-04-04T23:15:03.754120706Z [2024-04-04T23:15:03.753+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:14:00+00:00, map_index=-1, run_start_date=2024-04-04 23:15:01.574022+00:00, run_end_date=2024-04-04 23:15:02.349492+00:00, run_duration=0.77547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=215, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:15:00.227299+00:00, queued_by_job_id=1, pid=3240 2024-04-04T23:15:04.827304404Z [2024-04-04T23:15:04.826+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:15:04.828051695Z [2024-04-04T23:15:04.827+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:14:00+00:00, run_id=scheduled__2024-04-04T23:14:00+00:00, run_start_date=2024-04-04 23:15:00.156159+00:00, run_end_date=2024-04-04 23:15:04.827462+00:00, run_duration=4.671303, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:14:00+00:00, data_interval_end=2024-04-04 23:15:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:15:04.844736761Z [2024-04-04T23:15:04.844+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:15:00+00:00, run_after=2024-04-04T23:16:00+00:00 2024-04-04T23:15:04.881918311Z [2024-04-04T23:15:04.881+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:15:04.881946759Z 2024-04-04T23:15:04.882303391Z [2024-04-04T23:15:04.882+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:15:04.883110923Z [2024-04-04T23:15:04.882+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:15:04.883123489Z 2024-04-04T23:15:04.886426894Z [2024-04-04T23:15:04.886+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-04T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T23:15:04.886764476Z [2024-04-04T23:15:04.886+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-04T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:15:04.964644901Z [2024-04-04T23:15:04.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:10:00+00:00 exited with status queued for try_number 1 2024-04-04T23:15:04.965691746Z [2024-04-04T23:15:04.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:10:00+00:00 exited with status success for try_number 1 2024-04-04T23:15:04.965994929Z [2024-04-04T23:15:04.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:14:00+00:00 exited with status success for try_number 1 2024-04-04T23:15:04.983148250Z [2024-04-04T23:15:04.982+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0899054-4fa5-43ff-a333-74115cbc2904 2024-04-04T23:15:04.983512227Z [2024-04-04T23:15:04.983+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:14:00+00:00, map_index=-1, run_start_date=2024-04-04 23:15:03.147785+00:00, run_end_date=2024-04-04 23:15:04.477639+00:00, run_duration=1.329854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=216, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:15:00.227299+00:00, queued_by_job_id=1, pid=3264 2024-04-04T23:15:04.984068005Z [2024-04-04T23:15:04.983+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T23:10:00+00:00, map_index=-1, run_start_date=2024-04-04 23:15:03.385369+00:00, run_end_date=2024-04-04 23:15:03.818380+00:00, run_duration=0.433011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=218, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:15:00.227299+00:00, queued_by_job_id=1, pid=3266 2024-04-04T23:15:05.044101924Z [2024-04-04T23:15:05.043+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:15:05.044452756Z [2024-04-04T23:15:05.044+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:14:00+00:00, run_id=scheduled__2024-04-04T23:14:00+00:00, run_start_date=2024-04-04 23:15:00.157057+00:00, run_end_date=2024-04-04 23:15:05.044092+00:00, run_duration=4.887035, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:14:00+00:00, data_interval_end=2024-04-04 23:15:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:15:05.055631637Z [2024-04-04T23:15:05.055+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:15:00+00:00, run_after=2024-04-04T23:16:00+00:00 2024-04-04T23:15:06.294753016Z [2024-04-04T23:15:06.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:14:00+00:00 exited with status success for try_number 1 2024-04-04T23:15:06.306998336Z [2024-04-04T23:15:06.301+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:14:00+00:00, map_index=-1, run_start_date=2024-04-04 23:15:03.315863+00:00, run_end_date=2024-04-04 23:15:05.010211+00:00, run_duration=1.694348, state=success, executor_state=success, try_number=1, max_tries=1, job_id=217, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:15:00.227299+00:00, queued_by_job_id=1, pid=3265 2024-04-04T23:15:07.410830546Z [2024-04-04T23:15:07.410+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:15:07.410849714Z 2024-04-04T23:15:07.411093581Z [2024-04-04T23:15:07.410+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:15:07.412154908Z [2024-04-04T23:15:07.411+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:15:07.412210910Z 2024-04-04T23:15:07.417354037Z [2024-04-04T23:15:07.416+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-04T23:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T23:15:07.417851885Z [2024-04-04T23:15:07.417+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-04T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T23:15:07.480969387Z [2024-04-04T23:15:07.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:10:00+00:00 exited with status queued for try_number 1 2024-04-04T23:15:07.481176760Z [2024-04-04T23:15:07.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:10:00+00:00 exited with status success for try_number 1 2024-04-04T23:15:07.487052072Z [2024-04-04T23:15:07.486+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1187f627-a6c9-4739-85e9-41689d910446 2024-04-04T23:15:07.487400758Z [2024-04-04T23:15:07.487+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-04T23:10:00+00:00, map_index=-1, run_start_date=2024-04-04 23:15:06.797480+00:00, run_end_date=2024-04-04 23:15:07.145403+00:00, run_duration=0.347923, state=success, executor_state=success, try_number=1, max_tries=1, job_id=219, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:15:04.883706+00:00, queued_by_job_id=1, pid=3289 2024-04-04T23:15:10.457130118Z [2024-04-04T23:15:10.456+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:15:10.457167468Z 2024-04-04T23:15:10.457553831Z [2024-04-04T23:15:10.457+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:15:10.458774510Z [2024-04-04T23:15:10.458+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:15:10.458798071Z 2024-04-04T23:15:10.463410827Z [2024-04-04T23:15:10.463+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-04T23:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:15:10.463793764Z [2024-04-04T23:15:10.463+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-04T23:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:15:10.529568295Z [2024-04-04T23:15:10.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:10:00+00:00 exited with status queued for try_number 1 2024-04-04T23:15:10.529600695Z [2024-04-04T23:15:10.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:10:00+00:00 exited with status success for try_number 1 2024-04-04T23:15:10.535969334Z [2024-04-04T23:15:10.535+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d3c24ca-23e6-4549-aaf8-0294d1126454 2024-04-04T23:15:10.536110953Z [2024-04-04T23:15:10.535+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-04T23:10:00+00:00, map_index=0, run_start_date=2024-04-04 23:15:09.212981+00:00, run_end_date=2024-04-04 23:15:09.571029+00:00, run_duration=0.358048, state=success, executor_state=success, try_number=1, max_tries=1, job_id=220, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:15:07.412650+00:00, queued_by_job_id=1, pid=3297 2024-04-04T23:15:13.793759264Z [2024-04-04T23:15:13.793+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:15:13.794824232Z [2024-04-04T23:15:13.794+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:10:00+00:00, run_id=scheduled__2024-04-04T23:10:00+00:00, run_start_date=2024-04-04 23:15:00.154143+00:00, run_end_date=2024-04-04 23:15:13.794326+00:00, run_duration=13.640183, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:10:00+00:00, data_interval_end=2024-04-04 23:15:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-04T23:15:13.806033494Z [2024-04-04T23:15:13.805+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:15:00+00:00, run_after=2024-04-04T23:20:00+00:00 2024-04-04T23:15:13.835793471Z [2024-04-04T23:15:13.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:10:00+00:00 exited with status success for try_number 1 2024-04-04T23:15:13.842182686Z [2024-04-04T23:15:13.841+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-04T23:10:00+00:00, map_index=-1, run_start_date=2024-04-04 23:15:12.306518+00:00, run_end_date=2024-04-04 23:15:12.699984+00:00, run_duration=0.393466, state=success, executor_state=success, try_number=1, max_tries=1, job_id=221, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:15:10.459615+00:00, queued_by_job_id=1, pid=3318 2024-04-04T23:15:39.553638291Z [2024-04-04T23:15:39.553+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-04T23:16:00.365915961Z [2024-04-04T23:16:00.365+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:16:00.378944712Z [2024-04-04T23:16:00.378+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:16:00+00:00, run_after=2024-04-04T23:17:00+00:00 2024-04-04T23:16:00.391387602Z [2024-04-04T23:16:00.391+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:16:00+00:00, run_after=2024-04-04T23:17:00+00:00 2024-04-04T23:16:00.397962019Z [2024-04-04T23:16:00.397+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:16:00.485246006Z [2024-04-04T23:16:00.484+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:16:00.485286942Z 2024-04-04T23:16:00.485301837Z 2024-04-04T23:16:00.485321604Z 2024-04-04T23:16:00.485326867Z 2024-04-04T23:16:00.485407695Z [2024-04-04T23:16:00.485+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:16:00.485645275Z [2024-04-04T23:16:00.485+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:16:00.485801732Z [2024-04-04T23:16:00.485+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:16:00.485945126Z [2024-04-04T23:16:00.485+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:16:00.486698838Z [2024-04-04T23:16:00.486+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:16:00.486706241Z 2024-04-04T23:16:00.486709591Z 2024-04-04T23:16:00.486713080Z 2024-04-04T23:16:00.486716387Z 2024-04-04T23:16:00.490694839Z [2024-04-04T23:16:00.490+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:16:00.490929967Z [2024-04-04T23:16:00.490+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:16:00.491196941Z [2024-04-04T23:16:00.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:16:00.491357129Z [2024-04-04T23:16:00.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:16:00.491587392Z [2024-04-04T23:16:00.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:16:00.491792571Z [2024-04-04T23:16:00.491+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:16:00.492031835Z [2024-04-04T23:16:00.491+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:16:00.492166841Z [2024-04-04T23:16:00.492+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:16:01.166704092Z [2024-04-04T23:16:01.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:14:00+00:00 exited with status queued for try_number 1 2024-04-04T23:16:01.166731023Z [2024-04-04T23:16:01.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:15:00+00:00 exited with status queued for try_number 1 2024-04-04T23:16:01.166734650Z [2024-04-04T23:16:01.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:15:00+00:00 exited with status queued for try_number 1 2024-04-04T23:16:01.166738412Z [2024-04-04T23:16:01.164+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:15:00+00:00 exited with status queued for try_number 1 2024-04-04T23:16:01.217942640Z [2024-04-04T23:16:01.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2db6c9a4-e6fb-43b6-aa80-2f023b19528d 2024-04-04T23:16:01.217962451Z [2024-04-04T23:16:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59c02dde-061d-4537-9490-513d70df947c 2024-04-04T23:16:01.217965930Z [2024-04-04T23:16:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f7bc64e-c8f3-4bfa-bd43-913d2e2b5ba2 2024-04-04T23:16:01.217969359Z [2024-04-04T23:16:01.205+0000] {scheduler_job.py:635} INFO - Setting external_id for to f021fedb-ca18-4fb8-81e0-3d33b7a53e3a 2024-04-04T23:16:03.365290094Z [2024-04-04T23:16:03.364+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:16:03.366059331Z [2024-04-04T23:16:03.365+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:15:00+00:00, run_id=scheduled__2024-04-04T23:15:00+00:00, run_start_date=2024-04-04 23:16:00.410237+00:00, run_end_date=2024-04-04 23:16:03.365150+00:00, run_duration=2.954913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:15:00+00:00, data_interval_end=2024-04-04 23:16:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:16:03.387238241Z [2024-04-04T23:16:03.386+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:16:00+00:00, run_after=2024-04-04T23:17:00+00:00 2024-04-04T23:16:03.400397019Z [2024-04-04T23:16:03.399+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:16:03.400926048Z [2024-04-04T23:16:03.400+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:14:00+00:00, run_id=scheduled__2024-04-04T23:14:00+00:00, run_start_date=2024-04-04 23:16:00.408644+00:00, run_end_date=2024-04-04 23:16:03.400451+00:00, run_duration=2.991807, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:14:00+00:00, data_interval_end=2024-04-04 23:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:16:03.413479006Z [2024-04-04T23:16:03.413+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:16:00+00:00, run_after=2024-04-04T23:18:00+00:00 2024-04-04T23:16:03.467244845Z [2024-04-04T23:16:03.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:14:00+00:00 exited with status success for try_number 1 2024-04-04T23:16:03.469382054Z [2024-04-04T23:16:03.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:15:00+00:00 exited with status success for try_number 1 2024-04-04T23:16:03.476648525Z [2024-04-04T23:16:03.476+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:14:00+00:00, map_index=-1, run_start_date=2024-04-04 23:16:02.019990+00:00, run_end_date=2024-04-04 23:16:02.542074+00:00, run_duration=0.522084, state=success, executor_state=success, try_number=1, max_tries=1, job_id=222, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:16:00.487662+00:00, queued_by_job_id=1, pid=3329 2024-04-04T23:16:03.476935085Z [2024-04-04T23:16:03.476+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:15:00+00:00, map_index=-1, run_start_date=2024-04-04 23:16:02.160071+00:00, run_end_date=2024-04-04 23:16:02.908110+00:00, run_duration=0.748039, state=success, executor_state=success, try_number=1, max_tries=1, job_id=223, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:16:00.487662+00:00, queued_by_job_id=1, pid=3330 2024-04-04T23:16:05.627598094Z [2024-04-04T23:16:05.627+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:16:05.627888299Z [2024-04-04T23:16:05.627+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:15:00+00:00, run_id=scheduled__2024-04-04T23:15:00+00:00, run_start_date=2024-04-04 23:16:00.411507+00:00, run_end_date=2024-04-04 23:16:05.627548+00:00, run_duration=5.216041, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:15:00+00:00, data_interval_end=2024-04-04 23:16:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:16:05.636944629Z [2024-04-04T23:16:05.636+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:16:00+00:00, run_after=2024-04-04T23:17:00+00:00 2024-04-04T23:16:05.688383582Z [2024-04-04T23:16:05.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:15:00+00:00 exited with status success for try_number 1 2024-04-04T23:16:05.693540939Z [2024-04-04T23:16:05.693+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:15:00+00:00, map_index=-1, run_start_date=2024-04-04 23:16:03.192091+00:00, run_end_date=2024-04-04 23:16:04.821964+00:00, run_duration=1.629873, state=success, executor_state=success, try_number=1, max_tries=1, job_id=224, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:16:00.487662+00:00, queued_by_job_id=1, pid=3347 2024-04-04T23:16:07.790332839Z [2024-04-04T23:16:07.789+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:16:07.790453652Z [2024-04-04T23:16:07.790+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:15:00+00:00, run_id=scheduled__2024-04-04T23:15:00+00:00, run_start_date=2024-04-04 23:16:00.412786+00:00, run_end_date=2024-04-04 23:16:07.790129+00:00, run_duration=7.377343, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:15:00+00:00, data_interval_end=2024-04-04 23:16:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:16:07.799485066Z [2024-04-04T23:16:07.799+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:16:00+00:00, run_after=2024-04-04T23:17:00+00:00 2024-04-04T23:16:07.828819057Z [2024-04-04T23:16:07.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:15:00+00:00 exited with status success for try_number 1 2024-04-04T23:16:07.836062813Z [2024-04-04T23:16:07.835+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:15:00+00:00, map_index=-1, run_start_date=2024-04-04 23:16:03.746839+00:00, run_end_date=2024-04-04 23:16:07.066620+00:00, run_duration=3.319781, state=success, executor_state=success, try_number=1, max_tries=1, job_id=225, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:16:00.487662+00:00, queued_by_job_id=1, pid=3358 2024-04-04T23:17:00.182334254Z [2024-04-04T23:17:00.181+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:17:00+00:00, run_after=2024-04-04T23:18:00+00:00 2024-04-04T23:17:00.198755588Z [2024-04-04T23:17:00.198+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:17:00.213027175Z [2024-04-04T23:17:00.212+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:17:00+00:00, run_after=2024-04-04T23:18:00+00:00 2024-04-04T23:17:00.310026572Z [2024-04-04T23:17:00.309+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:17:00.310060660Z 2024-04-04T23:17:00.310064887Z 2024-04-04T23:17:00.310068492Z 2024-04-04T23:17:00.310081303Z [2024-04-04T23:17:00.309+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:17:00.310084630Z [2024-04-04T23:17:00.309+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:17:00.311901647Z [2024-04-04T23:17:00.311+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:17:00.313948609Z [2024-04-04T23:17:00.313+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:17:00.313962401Z 2024-04-04T23:17:00.313966029Z 2024-04-04T23:17:00.313969300Z 2024-04-04T23:17:00.317902867Z [2024-04-04T23:17:00.316+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:17:00.317917424Z [2024-04-04T23:17:00.317+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:17:00.317921450Z [2024-04-04T23:17:00.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:17:00.317924769Z [2024-04-04T23:17:00.317+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:17:00.317928028Z [2024-04-04T23:17:00.317+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:17:00.317931434Z [2024-04-04T23:17:00.317+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:17:00.778749379Z [2024-04-04T23:17:00.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:16:00+00:00 exited with status queued for try_number 1 2024-04-04T23:17:00.778885729Z [2024-04-04T23:17:00.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:16:00+00:00 exited with status queued for try_number 1 2024-04-04T23:17:00.778992613Z [2024-04-04T23:17:00.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:16:00+00:00 exited with status queued for try_number 1 2024-04-04T23:17:00.791659956Z [2024-04-04T23:17:00.791+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ec5c855-bf26-45af-8501-0a363e6a2906 2024-04-04T23:17:00.794759818Z [2024-04-04T23:17:00.794+0000] {scheduler_job.py:635} INFO - Setting external_id for to b80960b5-231c-40a1-808a-5a2af237efb6 2024-04-04T23:17:00.794902168Z [2024-04-04T23:17:00.794+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d3166b6-1c7f-4864-a676-c343fcb8fce1 2024-04-04T23:17:02.868730930Z [2024-04-04T23:17:02.868+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:17:02.869081786Z [2024-04-04T23:17:02.868+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:16:00+00:00, run_id=scheduled__2024-04-04T23:16:00+00:00, run_start_date=2024-04-04 23:17:00.223694+00:00, run_end_date=2024-04-04 23:17:02.868626+00:00, run_duration=2.644932, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:16:00+00:00, data_interval_end=2024-04-04 23:17:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:17:02.884020854Z [2024-04-04T23:17:02.882+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:17:00+00:00, run_after=2024-04-04T23:18:00+00:00 2024-04-04T23:17:02.963500574Z [2024-04-04T23:17:02.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:16:00+00:00 exited with status success for try_number 1 2024-04-04T23:17:02.970078294Z [2024-04-04T23:17:02.969+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:16:00+00:00, map_index=-1, run_start_date=2024-04-04 23:17:01.360974+00:00, run_end_date=2024-04-04 23:17:01.919346+00:00, run_duration=0.558372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=226, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:17:00.314250+00:00, queued_by_job_id=1, pid=3385 2024-04-04T23:17:04.166764955Z [2024-04-04T23:17:04.166+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:17:04.167140723Z [2024-04-04T23:17:04.166+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:16:00+00:00, run_id=scheduled__2024-04-04T23:16:00+00:00, run_start_date=2024-04-04 23:17:00.225172+00:00, run_end_date=2024-04-04 23:17:04.166679+00:00, run_duration=3.941507, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:16:00+00:00, data_interval_end=2024-04-04 23:17:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:17:04.177110411Z [2024-04-04T23:17:04.176+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:17:00+00:00, run_after=2024-04-04T23:18:00+00:00 2024-04-04T23:17:05.312943775Z [2024-04-04T23:17:05.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:16:00+00:00 exited with status success for try_number 1 2024-04-04T23:17:05.318690406Z [2024-04-04T23:17:05.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:16:00+00:00, map_index=-1, run_start_date=2024-04-04 23:17:02.855172+00:00, run_end_date=2024-04-04 23:17:04.131217+00:00, run_duration=1.276045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=227, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:17:00.314250+00:00, queued_by_job_id=1, pid=3398 2024-04-04T23:17:06.363177176Z [2024-04-04T23:17:06.361+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:17:06.363203575Z [2024-04-04T23:17:06.361+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:16:00+00:00, run_id=scheduled__2024-04-04T23:16:00+00:00, run_start_date=2024-04-04 23:17:00.228420+00:00, run_end_date=2024-04-04 23:17:06.361675+00:00, run_duration=6.133255, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:16:00+00:00, data_interval_end=2024-04-04 23:17:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:17:06.371614212Z [2024-04-04T23:17:06.371+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:17:00+00:00, run_after=2024-04-04T23:18:00+00:00 2024-04-04T23:17:06.401684330Z [2024-04-04T23:17:06.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:16:00+00:00 exited with status success for try_number 1 2024-04-04T23:17:06.406343257Z [2024-04-04T23:17:06.406+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:16:00+00:00, map_index=-1, run_start_date=2024-04-04 23:17:03.180239+00:00, run_end_date=2024-04-04 23:17:05.609374+00:00, run_duration=2.429135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=228, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:17:00.314250+00:00, queued_by_job_id=1, pid=3404 2024-04-04T23:18:00.959059428Z [2024-04-04T23:18:00.958+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:18:00+00:00, run_after=2024-04-04T23:19:00+00:00 2024-04-04T23:18:00.972286421Z [2024-04-04T23:18:00.971+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:18:00.995117729Z [2024-04-04T23:18:00.994+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:18:00+00:00, run_after=2024-04-04T23:19:00+00:00 2024-04-04T23:18:01.005756082Z [2024-04-04T23:18:01.005+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:18:01.097626020Z [2024-04-04T23:18:01.097+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:18:01.097670691Z 2024-04-04T23:18:01.097680918Z 2024-04-04T23:18:01.097687733Z 2024-04-04T23:18:01.097694975Z 2024-04-04T23:18:01.097785531Z [2024-04-04T23:18:01.097+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:18:01.097796363Z [2024-04-04T23:18:01.097+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:18:01.097807697Z [2024-04-04T23:18:01.097+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:18:01.097881083Z [2024-04-04T23:18:01.097+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:18:01.098434684Z [2024-04-04T23:18:01.098+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:18:01.098456302Z 2024-04-04T23:18:01.098464190Z 2024-04-04T23:18:01.098470580Z 2024-04-04T23:18:01.098477679Z 2024-04-04T23:18:01.102863542Z [2024-04-04T23:18:01.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:18:01.102895839Z [2024-04-04T23:18:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:18:01.103159041Z [2024-04-04T23:18:01.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:18:01.103246601Z [2024-04-04T23:18:01.103+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:18:01.103546497Z [2024-04-04T23:18:01.103+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:18:01.103675119Z [2024-04-04T23:18:01.103+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:18:01.104021538Z [2024-04-04T23:18:01.103+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:18:01.104181407Z [2024-04-04T23:18:01.104+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:18:01.699884898Z [2024-04-04T23:18:01.696+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:16:00+00:00 exited with status queued for try_number 1 2024-04-04T23:18:01.700379460Z [2024-04-04T23:18:01.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:17:00+00:00 exited with status queued for try_number 1 2024-04-04T23:18:01.701606406Z [2024-04-04T23:18:01.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:17:00+00:00 exited with status queued for try_number 1 2024-04-04T23:18:01.701904352Z [2024-04-04T23:18:01.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:17:00+00:00 exited with status queued for try_number 1 2024-04-04T23:18:01.727467871Z [2024-04-04T23:18:01.727+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9a00516-04a8-4958-a7c8-2b4fd6947e31 2024-04-04T23:18:01.732305327Z [2024-04-04T23:18:01.731+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4067493-7952-4e3a-a509-ff824eaf6457 2024-04-04T23:18:01.732720101Z [2024-04-04T23:18:01.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to ecf4ef87-d148-4d09-a0f6-0f9649c5e566 2024-04-04T23:18:01.733006473Z [2024-04-04T23:18:01.732+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2ddafad-18d8-45d7-83a2-0c04700e6587 2024-04-04T23:18:03.389652611Z [2024-04-04T23:18:03.389+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:18:03.389853746Z [2024-04-04T23:18:03.389+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:16:00+00:00, run_id=scheduled__2024-04-04T23:16:00+00:00, run_start_date=2024-04-04 23:18:01.018147+00:00, run_end_date=2024-04-04 23:18:03.389513+00:00, run_duration=2.371366, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:16:00+00:00, data_interval_end=2024-04-04 23:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:18:03.397885367Z [2024-04-04T23:18:03.397+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:18:00+00:00, run_after=2024-04-04T23:20:00+00:00 2024-04-04T23:18:03.407584383Z [2024-04-04T23:18:03.406+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:18:03.407790661Z [2024-04-04T23:18:03.407+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:17:00+00:00, run_id=scheduled__2024-04-04T23:17:00+00:00, run_start_date=2024-04-04 23:18:01.019727+00:00, run_end_date=2024-04-04 23:18:03.407440+00:00, run_duration=2.387713, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:17:00+00:00, data_interval_end=2024-04-04 23:18:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:18:03.419684482Z [2024-04-04T23:18:03.419+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:18:00+00:00, run_after=2024-04-04T23:19:00+00:00 2024-04-04T23:18:03.491956035Z [2024-04-04T23:18:03.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:16:00+00:00 exited with status success for try_number 1 2024-04-04T23:18:03.492305950Z [2024-04-04T23:18:03.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:17:00+00:00 exited with status success for try_number 1 2024-04-04T23:18:03.500187826Z [2024-04-04T23:18:03.499+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:17:00+00:00, map_index=-1, run_start_date=2024-04-04 23:18:02.459445+00:00, run_end_date=2024-04-04 23:18:02.943482+00:00, run_duration=0.484037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=229, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:18:01.099342+00:00, queued_by_job_id=1, pid=3438 2024-04-04T23:18:03.500656854Z [2024-04-04T23:18:03.500+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:16:00+00:00, map_index=-1, run_start_date=2024-04-04 23:18:02.521724+00:00, run_end_date=2024-04-04 23:18:03.005560+00:00, run_duration=0.483836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=230, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:18:01.099342+00:00, queued_by_job_id=1, pid=3439 2024-04-04T23:18:07.138586535Z [2024-04-04T23:18:07.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:18:07.139116933Z [2024-04-04T23:18:07.138+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:17:00+00:00, run_id=scheduled__2024-04-04T23:17:00+00:00, run_start_date=2024-04-04 23:18:01.021200+00:00, run_end_date=2024-04-04 23:18:07.138804+00:00, run_duration=6.117604, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:17:00+00:00, data_interval_end=2024-04-04 23:18:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:18:07.150286769Z [2024-04-04T23:18:07.149+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:18:00+00:00, run_after=2024-04-04T23:19:00+00:00 2024-04-04T23:18:07.157562063Z [2024-04-04T23:18:07.157+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:18:07.158070374Z [2024-04-04T23:18:07.157+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:17:00+00:00, run_id=scheduled__2024-04-04T23:17:00+00:00, run_start_date=2024-04-04 23:18:01.022322+00:00, run_end_date=2024-04-04 23:18:07.157754+00:00, run_duration=6.135432, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:17:00+00:00, data_interval_end=2024-04-04 23:18:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:18:07.167225929Z [2024-04-04T23:18:07.166+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:18:00+00:00, run_after=2024-04-04T23:19:00+00:00 2024-04-04T23:18:07.198386427Z [2024-04-04T23:18:07.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:17:00+00:00 exited with status success for try_number 1 2024-04-04T23:18:07.198773018Z [2024-04-04T23:18:07.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:17:00+00:00 exited with status success for try_number 1 2024-04-04T23:18:07.205871960Z [2024-04-04T23:18:07.205+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:17:00+00:00, map_index=-1, run_start_date=2024-04-04 23:18:03.867165+00:00, run_end_date=2024-04-04 23:18:06.478393+00:00, run_duration=2.611228, state=success, executor_state=success, try_number=1, max_tries=1, job_id=232, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:18:01.099342+00:00, queued_by_job_id=1, pid=3463 2024-04-04T23:18:07.206559202Z [2024-04-04T23:18:07.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:17:00+00:00, map_index=-1, run_start_date=2024-04-04 23:18:03.800758+00:00, run_end_date=2024-04-04 23:18:06.785398+00:00, run_duration=2.98464, state=success, executor_state=success, try_number=1, max_tries=1, job_id=231, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:18:01.099342+00:00, queued_by_job_id=1, pid=3462 2024-04-04T23:19:00.037991405Z [2024-04-04T23:19:00.037+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:19:00.069231081Z [2024-04-04T23:19:00.067+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:19:00+00:00, run_after=2024-04-04T23:20:00+00:00 2024-04-04T23:19:00.083687811Z [2024-04-04T23:19:00.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:19:00+00:00, run_after=2024-04-04T23:20:00+00:00 2024-04-04T23:19:00.184844037Z [2024-04-04T23:19:00.184+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:19:00.184867383Z 2024-04-04T23:19:00.184871106Z 2024-04-04T23:19:00.184874758Z 2024-04-04T23:19:00.184933691Z [2024-04-04T23:19:00.184+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:19:00.184964520Z [2024-04-04T23:19:00.184+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:19:00.185070768Z [2024-04-04T23:19:00.184+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:19:00.185694305Z [2024-04-04T23:19:00.185+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:19:00.185705546Z 2024-04-04T23:19:00.185708878Z 2024-04-04T23:19:00.185712121Z 2024-04-04T23:19:00.189078877Z [2024-04-04T23:19:00.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:19:00.189191989Z [2024-04-04T23:19:00.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:19:00.189371184Z [2024-04-04T23:19:00.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:19:00.189460667Z [2024-04-04T23:19:00.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:19:00.189636755Z [2024-04-04T23:19:00.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:19:00.189741367Z [2024-04-04T23:19:00.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:19:00.715285712Z [2024-04-04T23:19:00.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:18:00+00:00 exited with status queued for try_number 1 2024-04-04T23:19:00.715632690Z [2024-04-04T23:19:00.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:18:00+00:00 exited with status queued for try_number 1 2024-04-04T23:19:00.715861898Z [2024-04-04T23:19:00.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:18:00+00:00 exited with status queued for try_number 1 2024-04-04T23:19:00.744672602Z [2024-04-04T23:19:00.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to d2aff236-3d06-4a9b-bb11-dce4e4d55972 2024-04-04T23:19:00.745063189Z [2024-04-04T23:19:00.744+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7901017f-853f-431f-ae66-e311c56a47af 2024-04-04T23:19:00.746430112Z [2024-04-04T23:19:00.746+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7896694c-615e-41ce-82a9-3883279a535c 2024-04-04T23:19:02.049094027Z [2024-04-04T23:19:02.048+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:19:02.050093398Z [2024-04-04T23:19:02.049+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:18:00+00:00, run_id=scheduled__2024-04-04T23:18:00+00:00, run_start_date=2024-04-04 23:19:00.094427+00:00, run_end_date=2024-04-04 23:19:02.049609+00:00, run_duration=1.955182, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:18:00+00:00, data_interval_end=2024-04-04 23:19:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:19:02.062049867Z [2024-04-04T23:19:02.061+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:19:00+00:00, run_after=2024-04-04T23:20:00+00:00 2024-04-04T23:19:02.147974015Z [2024-04-04T23:19:02.147+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:18:00+00:00 exited with status success for try_number 1 2024-04-04T23:19:02.163916171Z [2024-04-04T23:19:02.163+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:18:00+00:00, map_index=-1, run_start_date=2024-04-04 23:19:01.136328+00:00, run_end_date=2024-04-04 23:19:01.707220+00:00, run_duration=0.570892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=233, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:19:00.186523+00:00, queued_by_job_id=1, pid=3494 2024-04-04T23:19:04.888927565Z [2024-04-04T23:19:04.888+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:19:04.889091587Z [2024-04-04T23:19:04.888+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:18:00+00:00, run_id=scheduled__2024-04-04T23:18:00+00:00, run_start_date=2024-04-04 23:19:00.096226+00:00, run_end_date=2024-04-04 23:19:04.888795+00:00, run_duration=4.792569, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:18:00+00:00, data_interval_end=2024-04-04 23:19:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:19:04.898156356Z [2024-04-04T23:19:04.897+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:19:00+00:00, run_after=2024-04-04T23:20:00+00:00 2024-04-04T23:19:04.936170050Z [2024-04-04T23:19:04.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:18:00+00:00 exited with status success for try_number 1 2024-04-04T23:19:04.941152571Z [2024-04-04T23:19:04.940+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:18:00+00:00, map_index=-1, run_start_date=2024-04-04 23:19:02.845668+00:00, run_end_date=2024-04-04 23:19:04.112078+00:00, run_duration=1.26641, state=success, executor_state=success, try_number=1, max_tries=1, job_id=234, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:19:00.186523+00:00, queued_by_job_id=1, pid=3507 2024-04-04T23:19:05.845436409Z [2024-04-04T23:19:05.844+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:19:05.845550371Z [2024-04-04T23:19:05.845+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:18:00+00:00, run_id=scheduled__2024-04-04T23:18:00+00:00, run_start_date=2024-04-04 23:19:00.097787+00:00, run_end_date=2024-04-04 23:19:05.845313+00:00, run_duration=5.747526, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:18:00+00:00, data_interval_end=2024-04-04 23:19:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:19:05.854078453Z [2024-04-04T23:19:05.853+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:19:00+00:00, run_after=2024-04-04T23:20:00+00:00 2024-04-04T23:19:05.886239117Z [2024-04-04T23:19:05.885+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:18:00+00:00 exited with status success for try_number 1 2024-04-04T23:19:05.893315066Z [2024-04-04T23:19:05.892+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:18:00+00:00, map_index=-1, run_start_date=2024-04-04 23:19:03.174164+00:00, run_end_date=2024-04-04 23:19:05.153698+00:00, run_duration=1.979534, state=success, executor_state=success, try_number=1, max_tries=1, job_id=235, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:19:00.186523+00:00, queued_by_job_id=1, pid=3518 2024-04-04T23:20:00.725988847Z [2024-04-04T23:20:00.725+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:20:00+00:00, run_after=2024-04-04T23:25:00+00:00 2024-04-04T23:20:00.750437501Z [2024-04-04T23:20:00.750+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:20:00.767407620Z [2024-04-04T23:20:00.767+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:20:00+00:00, run_after=2024-04-04T23:21:00+00:00 2024-04-04T23:20:00.776887422Z [2024-04-04T23:20:00.775+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:20:00.790521331Z [2024-04-04T23:20:00.790+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:20:00+00:00, run_after=2024-04-04T23:21:00+00:00 2024-04-04T23:20:00.932223669Z [2024-04-04T23:20:00.931+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-04T23:20:00.932252636Z 2024-04-04T23:20:00.932257620Z 2024-04-04T23:20:00.932265772Z 2024-04-04T23:20:00.932270687Z 2024-04-04T23:20:00.932275372Z 2024-04-04T23:20:00.932345251Z [2024-04-04T23:20:00.932+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:20:00.932499972Z [2024-04-04T23:20:00.932+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:20:00.932641183Z [2024-04-04T23:20:00.932+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:20:00.932779239Z [2024-04-04T23:20:00.932+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:20:00.932969303Z [2024-04-04T23:20:00.932+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:20:00.933665454Z [2024-04-04T23:20:00.933+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:20:00.933680231Z 2024-04-04T23:20:00.933694787Z 2024-04-04T23:20:00.933700090Z 2024-04-04T23:20:00.933705317Z 2024-04-04T23:20:00.933710372Z 2024-04-04T23:20:00.939606015Z [2024-04-04T23:20:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T23:20:00.939755257Z [2024-04-04T23:20:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:20:00.940028623Z [2024-04-04T23:20:00.939+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:20:00.940151985Z [2024-04-04T23:20:00.939+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:20:00.940394235Z [2024-04-04T23:20:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:20:00.940532102Z [2024-04-04T23:20:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:20:00.940765063Z [2024-04-04T23:20:00.940+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:20:00.940996132Z [2024-04-04T23:20:00.940+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:20:00.941265109Z [2024-04-04T23:20:00.941+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:20:00.941400205Z [2024-04-04T23:20:00.941+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:20:01.491058629Z [2024-04-04T23:20:01.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:15:00+00:00 exited with status queued for try_number 1 2024-04-04T23:20:01.491178721Z [2024-04-04T23:20:01.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:18:00+00:00 exited with status queued for try_number 1 2024-04-04T23:20:01.491238542Z [2024-04-04T23:20:01.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:19:00+00:00 exited with status queued for try_number 1 2024-04-04T23:20:01.491339224Z [2024-04-04T23:20:01.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:19:00+00:00 exited with status queued for try_number 1 2024-04-04T23:20:01.491452458Z [2024-04-04T23:20:01.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:19:00+00:00 exited with status queued for try_number 1 2024-04-04T23:20:01.508010353Z [2024-04-04T23:20:01.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to c42da0fb-2856-47ea-b6de-8c0f2d7e9419 2024-04-04T23:20:01.508198901Z [2024-04-04T23:20:01.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91833a24-2365-4856-96c8-86d563f725d8 2024-04-04T23:20:01.508397638Z [2024-04-04T23:20:01.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to 05cf7428-c155-4646-8dc1-c7f79b75591a 2024-04-04T23:20:01.508533651Z [2024-04-04T23:20:01.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3937f29f-1035-4757-bf0b-de1b25ebedfa 2024-04-04T23:20:01.508681740Z [2024-04-04T23:20:01.508+0000] {scheduler_job.py:635} INFO - Setting external_id for to a55d2841-d9b3-43c6-bdf4-1b235c7fcec9 2024-04-04T23:20:04.220869270Z [2024-04-04T23:20:04.220+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:20:04.221406827Z [2024-04-04T23:20:04.221+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:18:00+00:00, run_id=scheduled__2024-04-04T23:18:00+00:00, run_start_date=2024-04-04 23:20:00.811445+00:00, run_end_date=2024-04-04 23:20:04.220808+00:00, run_duration=3.409363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:18:00+00:00, data_interval_end=2024-04-04 23:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:20:04.237659886Z [2024-04-04T23:20:04.237+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:20:00+00:00, run_after=2024-04-04T23:22:00+00:00 2024-04-04T23:20:04.267499202Z [2024-04-04T23:20:04.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:20:04.268103771Z [2024-04-04T23:20:04.267+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:19:00+00:00, run_id=scheduled__2024-04-04T23:19:00+00:00, run_start_date=2024-04-04 23:20:00.813114+00:00, run_end_date=2024-04-04 23:20:04.267395+00:00, run_duration=3.454281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:19:00+00:00, data_interval_end=2024-04-04 23:20:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:20:04.286065608Z [2024-04-04T23:20:04.285+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:20:00+00:00, run_after=2024-04-04T23:21:00+00:00 2024-04-04T23:20:04.362702195Z [2024-04-04T23:20:04.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:18:00+00:00 exited with status success for try_number 1 2024-04-04T23:20:04.362874764Z [2024-04-04T23:20:04.362+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:19:00+00:00 exited with status success for try_number 1 2024-04-04T23:20:04.379405306Z [2024-04-04T23:20:04.378+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:19:00+00:00, map_index=-1, run_start_date=2024-04-04 23:20:02.866338+00:00, run_end_date=2024-04-04 23:20:03.506781+00:00, run_duration=0.640443, state=success, executor_state=success, try_number=1, max_tries=1, job_id=236, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:20:00.934736+00:00, queued_by_job_id=1, pid=3548 2024-04-04T23:20:04.379820079Z [2024-04-04T23:20:04.379+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:18:00+00:00, map_index=-1, run_start_date=2024-04-04 23:20:03.187404+00:00, run_end_date=2024-04-04 23:20:03.733768+00:00, run_duration=0.546364, state=success, executor_state=success, try_number=1, max_tries=1, job_id=237, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:20:00.934736+00:00, queued_by_job_id=1, pid=3550 2024-04-04T23:20:05.504137577Z [2024-04-04T23:20:05.503+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:20:05.504189280Z 2024-04-04T23:20:05.505230444Z [2024-04-04T23:20:05.504+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:20:05.506522187Z [2024-04-04T23:20:05.506+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:20:05.506538168Z 2024-04-04T23:20:05.513363670Z [2024-04-04T23:20:05.512+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-04T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T23:20:05.513937727Z [2024-04-04T23:20:05.513+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-04T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:20:05.569346809Z [2024-04-04T23:20:05.568+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:15:00+00:00 exited with status queued for try_number 1 2024-04-04T23:20:05.569512818Z [2024-04-04T23:20:05.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:15:00+00:00 exited with status success for try_number 1 2024-04-04T23:20:05.580632861Z [2024-04-04T23:20:05.580+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cd21f9a-67c4-49f9-96ae-9b284c9e4e81 2024-04-04T23:20:05.581264330Z [2024-04-04T23:20:05.580+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T23:15:00+00:00, map_index=-1, run_start_date=2024-04-04 23:20:03.817425+00:00, run_end_date=2024-04-04 23:20:04.293665+00:00, run_duration=0.47624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=238, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:20:00.934736+00:00, queued_by_job_id=1, pid=3567 2024-04-04T23:20:06.728797263Z [2024-04-04T23:20:06.728+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:20:06.729059978Z [2024-04-04T23:20:06.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:19:00+00:00, run_id=scheduled__2024-04-04T23:19:00+00:00, run_start_date=2024-04-04 23:20:00.814544+00:00, run_end_date=2024-04-04 23:20:06.728671+00:00, run_duration=5.914127, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:19:00+00:00, data_interval_end=2024-04-04 23:20:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:20:06.740422143Z [2024-04-04T23:20:06.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:20:00+00:00, run_after=2024-04-04T23:21:00+00:00 2024-04-04T23:20:06.753012293Z [2024-04-04T23:20:06.752+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:20:06.753495871Z [2024-04-04T23:20:06.753+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:19:00+00:00, run_id=scheduled__2024-04-04T23:19:00+00:00, run_start_date=2024-04-04 23:20:00.815895+00:00, run_end_date=2024-04-04 23:20:06.752929+00:00, run_duration=5.937034, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:19:00+00:00, data_interval_end=2024-04-04 23:20:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:20:06.766311739Z [2024-04-04T23:20:06.765+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:20:00+00:00, run_after=2024-04-04T23:21:00+00:00 2024-04-04T23:20:06.819687731Z [2024-04-04T23:20:06.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:19:00+00:00 exited with status success for try_number 1 2024-04-04T23:20:06.819921055Z [2024-04-04T23:20:06.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:19:00+00:00 exited with status success for try_number 1 2024-04-04T23:20:06.829019333Z [2024-04-04T23:20:06.828+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:19:00+00:00, map_index=-1, run_start_date=2024-04-04 23:20:04.335066+00:00, run_end_date=2024-04-04 23:20:06.452325+00:00, run_duration=2.117259, state=success, executor_state=success, try_number=1, max_tries=1, job_id=239, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:20:00.934736+00:00, queued_by_job_id=1, pid=3583 2024-04-04T23:20:06.829245569Z [2024-04-04T23:20:06.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:19:00+00:00, map_index=-1, run_start_date=2024-04-04 23:20:04.575672+00:00, run_end_date=2024-04-04 23:20:06.191837+00:00, run_duration=1.616165, state=success, executor_state=success, try_number=1, max_tries=1, job_id=240, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:20:00.934736+00:00, queued_by_job_id=1, pid=3584 2024-04-04T23:20:08.013304470Z [2024-04-04T23:20:08.012+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:20:08.013354544Z 2024-04-04T23:20:08.013589951Z [2024-04-04T23:20:08.013+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:20:08.014349648Z [2024-04-04T23:20:08.014+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:20:08.014363633Z 2024-04-04T23:20:08.016975196Z [2024-04-04T23:20:08.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-04T23:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T23:20:08.017275659Z [2024-04-04T23:20:08.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-04T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T23:20:08.064869528Z [2024-04-04T23:20:08.064+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:15:00+00:00 exited with status queued for try_number 1 2024-04-04T23:20:08.067002553Z [2024-04-04T23:20:08.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:15:00+00:00 exited with status success for try_number 1 2024-04-04T23:20:08.075125484Z [2024-04-04T23:20:08.074+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c8d320c-9df2-4e49-8f53-2f3712aa6649 2024-04-04T23:20:08.075319698Z [2024-04-04T23:20:08.075+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-04T23:15:00+00:00, map_index=-1, run_start_date=2024-04-04 23:20:07.442308+00:00, run_end_date=2024-04-04 23:20:07.752395+00:00, run_duration=0.310087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=241, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:20:05.507459+00:00, queued_by_job_id=1, pid=3602 2024-04-04T23:20:10.444153638Z [2024-04-04T23:20:10.443+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:20:10.444251245Z 2024-04-04T23:20:10.444631330Z [2024-04-04T23:20:10.444+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:20:10.445647506Z [2024-04-04T23:20:10.445+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:20:10.445663411Z 2024-04-04T23:20:10.449340679Z [2024-04-04T23:20:10.448+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-04T23:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:20:10.449711010Z [2024-04-04T23:20:10.449+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-04T23:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:20:10.518868822Z [2024-04-04T23:20:10.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:15:00+00:00 exited with status queued for try_number 1 2024-04-04T23:20:10.519411366Z [2024-04-04T23:20:10.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:15:00+00:00 exited with status success for try_number 1 2024-04-04T23:20:10.529808545Z [2024-04-04T23:20:10.528+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95d319fb-c6bb-4bad-b93d-80a67f8ecad9 2024-04-04T23:20:10.530642869Z [2024-04-04T23:20:10.530+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-04T23:15:00+00:00, map_index=0, run_start_date=2024-04-04 23:20:09.676711+00:00, run_end_date=2024-04-04 23:20:09.989113+00:00, run_duration=0.312402, state=success, executor_state=success, try_number=1, max_tries=1, job_id=242, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:20:08.014819+00:00, queued_by_job_id=1, pid=3620 2024-04-04T23:20:13.097454836Z [2024-04-04T23:20:13.096+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:20:13.097817413Z [2024-04-04T23:20:13.097+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:15:00+00:00, run_id=scheduled__2024-04-04T23:15:00+00:00, run_start_date=2024-04-04 23:20:00.809774+00:00, run_end_date=2024-04-04 23:20:13.097353+00:00, run_duration=12.287579, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:15:00+00:00, data_interval_end=2024-04-04 23:20:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-04T23:20:13.110477942Z [2024-04-04T23:20:13.109+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:20:00+00:00, run_after=2024-04-04T23:25:00+00:00 2024-04-04T23:20:13.150672704Z [2024-04-04T23:20:13.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:15:00+00:00 exited with status success for try_number 1 2024-04-04T23:20:13.157347494Z [2024-04-04T23:20:13.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-04T23:15:00+00:00, map_index=-1, run_start_date=2024-04-04 23:20:12.364000+00:00, run_end_date=2024-04-04 23:20:12.727087+00:00, run_duration=0.363087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=243, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:20:10.446330+00:00, queued_by_job_id=1, pid=3631 2024-04-04T23:20:39.607973563Z [2024-04-04T23:20:39.607+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-04T23:21:00.728356352Z [2024-04-04T23:21:00.728+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:21:00+00:00, run_after=2024-04-04T23:22:00+00:00 2024-04-04T23:21:00.741396355Z [2024-04-04T23:21:00.741+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:21:00+00:00, run_after=2024-04-04T23:22:00+00:00 2024-04-04T23:21:00.748854767Z [2024-04-04T23:21:00.748+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:21:00.834082637Z [2024-04-04T23:21:00.833+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:21:00.834108324Z 2024-04-04T23:21:00.834112284Z 2024-04-04T23:21:00.834116053Z 2024-04-04T23:21:00.834410753Z [2024-04-04T23:21:00.834+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:21:00.834628426Z [2024-04-04T23:21:00.834+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:21:00.834843833Z [2024-04-04T23:21:00.834+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:21:00.835607033Z [2024-04-04T23:21:00.835+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:21:00.835620127Z 2024-04-04T23:21:00.835623898Z 2024-04-04T23:21:00.835627832Z 2024-04-04T23:21:00.840179488Z [2024-04-04T23:21:00.839+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:21:00.840417164Z [2024-04-04T23:21:00.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:21:00.840786053Z [2024-04-04T23:21:00.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:21:00.841011389Z [2024-04-04T23:21:00.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:21:00.841440718Z [2024-04-04T23:21:00.841+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:21:00.841658878Z [2024-04-04T23:21:00.841+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:21:01.141119173Z [2024-04-04T23:21:01.140+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:20:00+00:00 exited with status queued for try_number 1 2024-04-04T23:21:01.141464006Z [2024-04-04T23:21:01.141+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:20:00+00:00 exited with status queued for try_number 1 2024-04-04T23:21:01.144000555Z [2024-04-04T23:21:01.143+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:20:00+00:00 exited with status queued for try_number 1 2024-04-04T23:21:01.174955093Z [2024-04-04T23:21:01.166+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a0944ec-48fa-4a21-9ff3-2e26897b03d6 2024-04-04T23:21:01.174977948Z [2024-04-04T23:21:01.167+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07da0c1b-74ea-48c8-96ac-d46c28aac4bb 2024-04-04T23:21:01.174981546Z [2024-04-04T23:21:01.167+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3cd87173-8c72-4825-b0cb-86d4a99df9bc 2024-04-04T23:21:02.621816154Z [2024-04-04T23:21:02.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:21:02.622062442Z [2024-04-04T23:21:02.621+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:20:00+00:00, run_id=scheduled__2024-04-04T23:20:00+00:00, run_start_date=2024-04-04 23:21:00.765886+00:00, run_end_date=2024-04-04 23:21:02.621740+00:00, run_duration=1.855854, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:20:00+00:00, data_interval_end=2024-04-04 23:21:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:21:02.644773382Z [2024-04-04T23:21:02.642+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:21:00+00:00, run_after=2024-04-04T23:22:00+00:00 2024-04-04T23:21:02.726983783Z [2024-04-04T23:21:02.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:20:00+00:00 exited with status success for try_number 1 2024-04-04T23:21:02.733731039Z [2024-04-04T23:21:02.733+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:20:00+00:00, map_index=-1, run_start_date=2024-04-04 23:21:02.028657+00:00, run_end_date=2024-04-04 23:21:02.470495+00:00, run_duration=0.441838, state=success, executor_state=success, try_number=1, max_tries=1, job_id=244, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:21:00.836809+00:00, queued_by_job_id=1, pid=3640 2024-04-04T23:21:04.559987087Z [2024-04-04T23:21:04.559+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:21:04.560355782Z [2024-04-04T23:21:04.560+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:20:00+00:00, run_id=scheduled__2024-04-04T23:20:00+00:00, run_start_date=2024-04-04 23:21:00.768029+00:00, run_end_date=2024-04-04 23:21:04.559844+00:00, run_duration=3.791815, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:20:00+00:00, data_interval_end=2024-04-04 23:21:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:21:04.572637819Z [2024-04-04T23:21:04.572+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:21:00+00:00, run_after=2024-04-04T23:22:00+00:00 2024-04-04T23:21:04.616011426Z [2024-04-04T23:21:04.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:20:00+00:00 exited with status success for try_number 1 2024-04-04T23:21:04.622361015Z [2024-04-04T23:21:04.621+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:20:00+00:00, map_index=-1, run_start_date=2024-04-04 23:21:03.134151+00:00, run_end_date=2024-04-04 23:21:04.443091+00:00, run_duration=1.30894, state=success, executor_state=success, try_number=1, max_tries=1, job_id=245, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:21:00.836809+00:00, queued_by_job_id=1, pid=3658 2024-04-04T23:21:05.663665081Z [2024-04-04T23:21:05.663+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:21:05.664151770Z [2024-04-04T23:21:05.663+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:20:00+00:00, run_id=scheduled__2024-04-04T23:20:00+00:00, run_start_date=2024-04-04 23:21:00.769789+00:00, run_end_date=2024-04-04 23:21:05.663665+00:00, run_duration=4.893876, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:20:00+00:00, data_interval_end=2024-04-04 23:21:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:21:05.677999988Z [2024-04-04T23:21:05.677+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:21:00+00:00, run_after=2024-04-04T23:22:00+00:00 2024-04-04T23:21:05.717982135Z [2024-04-04T23:21:05.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:20:00+00:00 exited with status success for try_number 1 2024-04-04T23:21:05.725863422Z [2024-04-04T23:21:05.725+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:20:00+00:00, map_index=-1, run_start_date=2024-04-04 23:21:03.337499+00:00, run_end_date=2024-04-04 23:21:04.876190+00:00, run_duration=1.538691, state=success, executor_state=success, try_number=1, max_tries=1, job_id=246, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:21:00.836809+00:00, queued_by_job_id=1, pid=3659 2024-04-04T23:22:00.555026298Z [2024-04-04T23:22:00.554+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:22:00.571639633Z [2024-04-04T23:22:00.571+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:22:00+00:00, run_after=2024-04-04T23:23:00+00:00 2024-04-04T23:22:00.584053286Z [2024-04-04T23:22:00.583+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:22:00.603358142Z [2024-04-04T23:22:00.602+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:22:00+00:00, run_after=2024-04-04T23:23:00+00:00 2024-04-04T23:22:00.685434588Z [2024-04-04T23:22:00.685+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:22:00.685524043Z 2024-04-04T23:22:00.685531684Z 2024-04-04T23:22:00.685535160Z 2024-04-04T23:22:00.685538534Z 2024-04-04T23:22:00.685565985Z [2024-04-04T23:22:00.685+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:22:00.685639179Z [2024-04-04T23:22:00.685+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:22:00.685789665Z [2024-04-04T23:22:00.685+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:22:00.685868733Z [2024-04-04T23:22:00.685+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:22:00.686646269Z [2024-04-04T23:22:00.686+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:22:00.686675846Z 2024-04-04T23:22:00.686680157Z 2024-04-04T23:22:00.686683379Z 2024-04-04T23:22:00.686686329Z 2024-04-04T23:22:00.691428049Z [2024-04-04T23:22:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:22:00.691582536Z [2024-04-04T23:22:00.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:22:00.691891258Z [2024-04-04T23:22:00.691+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:22:00.692011019Z [2024-04-04T23:22:00.691+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:22:00.692271286Z [2024-04-04T23:22:00.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:22:00.692400274Z [2024-04-04T23:22:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:22:00.692634666Z [2024-04-04T23:22:00.692+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:22:00.692740414Z [2024-04-04T23:22:00.692+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:22:01.633462439Z [2024-04-04T23:22:01.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:20:00+00:00 exited with status queued for try_number 1 2024-04-04T23:22:01.635886530Z [2024-04-04T23:22:01.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:21:00+00:00 exited with status queued for try_number 1 2024-04-04T23:22:01.636292839Z [2024-04-04T23:22:01.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:21:00+00:00 exited with status queued for try_number 1 2024-04-04T23:22:01.636880284Z [2024-04-04T23:22:01.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:21:00+00:00 exited with status queued for try_number 1 2024-04-04T23:22:01.657740569Z [2024-04-04T23:22:01.657+0000] {scheduler_job.py:635} INFO - Setting external_id for to 579b57d0-71b1-4671-87d1-90bdb6e28721 2024-04-04T23:22:01.661933897Z [2024-04-04T23:22:01.661+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40e86aaa-b5b2-44c1-8c4d-c292cb49ca4e 2024-04-04T23:22:01.664468609Z [2024-04-04T23:22:01.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc8176b0-89a5-436a-9beb-02052ce74326 2024-04-04T23:22:01.665012895Z [2024-04-04T23:22:01.664+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3f332f1-d207-4d34-92ae-790ffc5be4a5 2024-04-04T23:22:02.996975351Z [2024-04-04T23:22:02.996+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:22:02.997192624Z [2024-04-04T23:22:02.997+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:21:00+00:00, run_id=scheduled__2024-04-04T23:21:00+00:00, run_start_date=2024-04-04 23:22:00.617493+00:00, run_end_date=2024-04-04 23:22:02.996855+00:00, run_duration=2.379362, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:21:00+00:00, data_interval_end=2024-04-04 23:22:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:22:03.012565216Z [2024-04-04T23:22:03.011+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:22:00+00:00, run_after=2024-04-04T23:23:00+00:00 2024-04-04T23:22:03.138328363Z [2024-04-04T23:22:03.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:21:00+00:00 exited with status success for try_number 1 2024-04-04T23:22:03.150614912Z [2024-04-04T23:22:03.150+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:21:00+00:00, map_index=-1, run_start_date=2024-04-04 23:22:02.124219+00:00, run_end_date=2024-04-04 23:22:02.681355+00:00, run_duration=0.557136, state=success, executor_state=success, try_number=1, max_tries=1, job_id=247, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:22:00.688150+00:00, queued_by_job_id=1, pid=3692 2024-04-04T23:22:03.518330978Z [2024-04-04T23:22:03.517+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:22:03.518868962Z [2024-04-04T23:22:03.518+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:20:00+00:00, run_id=scheduled__2024-04-04T23:20:00+00:00, run_start_date=2024-04-04 23:22:00.616028+00:00, run_end_date=2024-04-04 23:22:03.518224+00:00, run_duration=2.902196, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:20:00+00:00, data_interval_end=2024-04-04 23:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:22:03.530618099Z [2024-04-04T23:22:03.530+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:22:00+00:00, run_after=2024-04-04T23:24:00+00:00 2024-04-04T23:22:03.584723670Z [2024-04-04T23:22:03.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:20:00+00:00 exited with status success for try_number 1 2024-04-04T23:22:03.593051936Z [2024-04-04T23:22:03.592+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:20:00+00:00, map_index=-1, run_start_date=2024-04-04 23:22:02.807501+00:00, run_end_date=2024-04-04 23:22:03.322870+00:00, run_duration=0.515369, state=success, executor_state=success, try_number=1, max_tries=1, job_id=248, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:22:00.688150+00:00, queued_by_job_id=1, pid=3698 2024-04-04T23:22:06.037246267Z [2024-04-04T23:22:06.036+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:22:06.037400969Z [2024-04-04T23:22:06.037+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:21:00+00:00, run_id=scheduled__2024-04-04T23:21:00+00:00, run_start_date=2024-04-04 23:22:00.620204+00:00, run_end_date=2024-04-04 23:22:06.037157+00:00, run_duration=5.416953, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:21:00+00:00, data_interval_end=2024-04-04 23:22:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:22:06.047168510Z [2024-04-04T23:22:06.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:22:00+00:00, run_after=2024-04-04T23:23:00+00:00 2024-04-04T23:22:06.088016670Z [2024-04-04T23:22:06.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:21:00+00:00 exited with status success for try_number 1 2024-04-04T23:22:06.096165050Z [2024-04-04T23:22:06.095+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:21:00+00:00, map_index=-1, run_start_date=2024-04-04 23:22:03.828632+00:00, run_end_date=2024-04-04 23:22:05.599506+00:00, run_duration=1.770874, state=success, executor_state=success, try_number=1, max_tries=1, job_id=249, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:22:00.688150+00:00, queued_by_job_id=1, pid=3711 2024-04-04T23:22:07.136693981Z [2024-04-04T23:22:07.136+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:22:07.137009809Z [2024-04-04T23:22:07.136+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:21:00+00:00, run_id=scheduled__2024-04-04T23:21:00+00:00, run_start_date=2024-04-04 23:22:00.618835+00:00, run_end_date=2024-04-04 23:22:07.136537+00:00, run_duration=6.517702, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:21:00+00:00, data_interval_end=2024-04-04 23:22:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:22:07.147117302Z [2024-04-04T23:22:07.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:22:00+00:00, run_after=2024-04-04T23:23:00+00:00 2024-04-04T23:22:07.183677599Z [2024-04-04T23:22:07.183+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:21:00+00:00 exited with status success for try_number 1 2024-04-04T23:22:07.191351392Z [2024-04-04T23:22:07.190+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:21:00+00:00, map_index=-1, run_start_date=2024-04-04 23:22:04.426722+00:00, run_end_date=2024-04-04 23:22:06.468787+00:00, run_duration=2.042065, state=success, executor_state=success, try_number=1, max_tries=1, job_id=250, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:22:00.688150+00:00, queued_by_job_id=1, pid=3722 2024-04-04T23:23:00.338137693Z [2024-04-04T23:23:00.337+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:23:00+00:00, run_after=2024-04-04T23:24:00+00:00 2024-04-04T23:23:00.359405353Z [2024-04-04T23:23:00.359+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:23:00+00:00, run_after=2024-04-04T23:24:00+00:00 2024-04-04T23:23:00.369751187Z [2024-04-04T23:23:00.369+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:23:00.456962780Z [2024-04-04T23:23:00.456+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:23:00.456989814Z 2024-04-04T23:23:00.456999340Z 2024-04-04T23:23:00.457004141Z 2024-04-04T23:23:00.457441794Z [2024-04-04T23:23:00.457+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:23:00.457805781Z [2024-04-04T23:23:00.457+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:23:00.458132711Z [2024-04-04T23:23:00.457+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:23:00.459094149Z [2024-04-04T23:23:00.458+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:23:00.459107743Z 2024-04-04T23:23:00.459113189Z 2024-04-04T23:23:00.459136526Z 2024-04-04T23:23:00.464077834Z [2024-04-04T23:23:00.463+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:23:00.464409126Z [2024-04-04T23:23:00.464+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:23:00.464952480Z [2024-04-04T23:23:00.464+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:23:00.465259191Z [2024-04-04T23:23:00.465+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:23:00.465662253Z [2024-04-04T23:23:00.465+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:23:00.466013635Z [2024-04-04T23:23:00.465+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:23:00.937694423Z [2024-04-04T23:23:00.936+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:22:00+00:00 exited with status queued for try_number 1 2024-04-04T23:23:00.937901107Z [2024-04-04T23:23:00.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:22:00+00:00 exited with status queued for try_number 1 2024-04-04T23:23:00.938080674Z [2024-04-04T23:23:00.937+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:22:00+00:00 exited with status queued for try_number 1 2024-04-04T23:23:00.959115577Z [2024-04-04T23:23:00.958+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3464f20-ab69-4a98-82af-a904960edfe5 2024-04-04T23:23:00.964199116Z [2024-04-04T23:23:00.963+0000] {scheduler_job.py:635} INFO - Setting external_id for to 285a4682-3d15-4811-863c-5d7fe522b558 2024-04-04T23:23:00.964474654Z [2024-04-04T23:23:00.964+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9139a542-a66c-43c7-82a6-bee82c00d543 2024-04-04T23:23:03.373452701Z [2024-04-04T23:23:03.372+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:23:03.374088089Z [2024-04-04T23:23:03.373+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:22:00+00:00, run_id=scheduled__2024-04-04T23:22:00+00:00, run_start_date=2024-04-04 23:23:00.383150+00:00, run_end_date=2024-04-04 23:23:03.373387+00:00, run_duration=2.990237, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:22:00+00:00, data_interval_end=2024-04-04 23:23:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:23:03.399196265Z [2024-04-04T23:23:03.398+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:23:00+00:00, run_after=2024-04-04T23:24:00+00:00 2024-04-04T23:23:03.490624927Z [2024-04-04T23:23:03.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:22:00+00:00 exited with status success for try_number 1 2024-04-04T23:23:03.505363800Z [2024-04-04T23:23:03.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:22:00+00:00, map_index=-1, run_start_date=2024-04-04 23:23:02.124523+00:00, run_end_date=2024-04-04 23:23:02.656834+00:00, run_duration=0.532311, state=success, executor_state=success, try_number=1, max_tries=1, job_id=251, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:23:00.460413+00:00, queued_by_job_id=1, pid=3749 2024-04-04T23:23:05.484581399Z [2024-04-04T23:23:05.484+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:23:05.485027772Z [2024-04-04T23:23:05.484+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:22:00+00:00, run_id=scheduled__2024-04-04T23:22:00+00:00, run_start_date=2024-04-04 23:23:00.384517+00:00, run_end_date=2024-04-04 23:23:05.484424+00:00, run_duration=5.099907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:22:00+00:00, data_interval_end=2024-04-04 23:23:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:23:05.499118146Z [2024-04-04T23:23:05.498+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:23:00+00:00, run_after=2024-04-04T23:24:00+00:00 2024-04-04T23:23:05.539024736Z [2024-04-04T23:23:05.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:22:00+00:00 exited with status success for try_number 1 2024-04-04T23:23:05.544239165Z [2024-04-04T23:23:05.543+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:22:00+00:00, map_index=-1, run_start_date=2024-04-04 23:23:03.352758+00:00, run_end_date=2024-04-04 23:23:05.366417+00:00, run_duration=2.013659, state=success, executor_state=success, try_number=1, max_tries=1, job_id=252, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:23:00.460413+00:00, queued_by_job_id=1, pid=3767 2024-04-04T23:23:06.590447544Z [2024-04-04T23:23:06.589+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:23:06.591059245Z [2024-04-04T23:23:06.590+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:22:00+00:00, run_id=scheduled__2024-04-04T23:22:00+00:00, run_start_date=2024-04-04 23:23:00.385802+00:00, run_end_date=2024-04-04 23:23:06.590517+00:00, run_duration=6.204715, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:22:00+00:00, data_interval_end=2024-04-04 23:23:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:23:06.607139665Z [2024-04-04T23:23:06.606+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:23:00+00:00, run_after=2024-04-04T23:24:00+00:00 2024-04-04T23:23:06.643660118Z [2024-04-04T23:23:06.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:22:00+00:00 exited with status success for try_number 1 2024-04-04T23:23:06.651857748Z [2024-04-04T23:23:06.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:22:00+00:00, map_index=-1, run_start_date=2024-04-04 23:23:03.459980+00:00, run_end_date=2024-04-04 23:23:06.130686+00:00, run_duration=2.670706, state=success, executor_state=success, try_number=1, max_tries=1, job_id=253, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:23:00.460413+00:00, queued_by_job_id=1, pid=3768 2024-04-04T23:24:00.099581215Z [2024-04-04T23:24:00.099+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:24:00.119662469Z [2024-04-04T23:24:00.119+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:24:00.145597668Z [2024-04-04T23:24:00.145+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:24:00+00:00, run_after=2024-04-04T23:25:00+00:00 2024-04-04T23:24:00.170783615Z [2024-04-04T23:24:00.170+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:24:00+00:00, run_after=2024-04-04T23:25:00+00:00 2024-04-04T23:24:00.244378178Z [2024-04-04T23:24:00.243+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:24:00.244403857Z 2024-04-04T23:24:00.244412446Z 2024-04-04T23:24:00.244416822Z 2024-04-04T23:24:00.244421129Z 2024-04-04T23:24:00.244631883Z [2024-04-04T23:24:00.244+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:24:00.244826110Z [2024-04-04T23:24:00.244+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:24:00.244937318Z [2024-04-04T23:24:00.244+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:24:00.245065999Z [2024-04-04T23:24:00.244+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:24:00.245976246Z [2024-04-04T23:24:00.245+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:24:00.245988192Z 2024-04-04T23:24:00.245992518Z 2024-04-04T23:24:00.245996131Z 2024-04-04T23:24:00.245999410Z 2024-04-04T23:24:00.250528701Z [2024-04-04T23:24:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:24:00.250675905Z [2024-04-04T23:24:00.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:24:00.251105747Z [2024-04-04T23:24:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:24:00.251355113Z [2024-04-04T23:24:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:24:00.251745628Z [2024-04-04T23:24:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:24:00.251904873Z [2024-04-04T23:24:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:24:00.252280131Z [2024-04-04T23:24:00.252+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:24:00.252483517Z [2024-04-04T23:24:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:24:00.863277838Z [2024-04-04T23:24:00.862+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:22:00+00:00 exited with status queued for try_number 1 2024-04-04T23:24:00.864968123Z [2024-04-04T23:24:00.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:23:00+00:00 exited with status queued for try_number 1 2024-04-04T23:24:00.867879343Z [2024-04-04T23:24:00.864+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:23:00+00:00 exited with status queued for try_number 1 2024-04-04T23:24:00.868014253Z [2024-04-04T23:24:00.867+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:23:00+00:00 exited with status queued for try_number 1 2024-04-04T23:24:00.908219776Z [2024-04-04T23:24:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a7e3f90-8509-4eb6-990a-189a4a733fac 2024-04-04T23:24:00.908473193Z [2024-04-04T23:24:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19d198d0-8ca1-4ced-82a8-e842aba607b6 2024-04-04T23:24:00.908638021Z [2024-04-04T23:24:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9d3e916-8107-410e-94f3-2dcd2b55f317 2024-04-04T23:24:00.911852333Z [2024-04-04T23:24:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to af7e5c2f-68f9-41d6-89d6-5ed20fd79a79 2024-04-04T23:24:02.338493255Z [2024-04-04T23:24:02.338+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:24:02.338989729Z [2024-04-04T23:24:02.338+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:23:00+00:00, run_id=scheduled__2024-04-04T23:23:00+00:00, run_start_date=2024-04-04 23:24:00.184310+00:00, run_end_date=2024-04-04 23:24:02.338404+00:00, run_duration=2.154094, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:23:00+00:00, data_interval_end=2024-04-04 23:24:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:24:02.352757617Z [2024-04-04T23:24:02.352+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:24:00+00:00, run_after=2024-04-04T23:25:00+00:00 2024-04-04T23:24:02.464850539Z [2024-04-04T23:24:02.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:23:00+00:00 exited with status success for try_number 1 2024-04-04T23:24:02.477394386Z [2024-04-04T23:24:02.477+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:23:00+00:00, map_index=-1, run_start_date=2024-04-04 23:24:01.497091+00:00, run_end_date=2024-04-04 23:24:02.140115+00:00, run_duration=0.643024, state=success, executor_state=success, try_number=1, max_tries=1, job_id=254, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:24:00.247064+00:00, queued_by_job_id=1, pid=3801 2024-04-04T23:24:03.534247880Z [2024-04-04T23:24:03.533+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:24:03.534799233Z [2024-04-04T23:24:03.534+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:22:00+00:00, run_id=scheduled__2024-04-04T23:22:00+00:00, run_start_date=2024-04-04 23:24:00.182659+00:00, run_end_date=2024-04-04 23:24:03.534358+00:00, run_duration=3.351699, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:22:00+00:00, data_interval_end=2024-04-04 23:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:24:03.546703559Z [2024-04-04T23:24:03.546+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:24:00+00:00, run_after=2024-04-04T23:26:00+00:00 2024-04-04T23:24:03.622259576Z [2024-04-04T23:24:03.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:22:00+00:00 exited with status success for try_number 1 2024-04-04T23:24:03.629822235Z [2024-04-04T23:24:03.629+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:22:00+00:00, map_index=-1, run_start_date=2024-04-04 23:24:02.239113+00:00, run_end_date=2024-04-04 23:24:02.771849+00:00, run_duration=0.532736, state=success, executor_state=success, try_number=1, max_tries=1, job_id=255, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:24:00.247064+00:00, queued_by_job_id=1, pid=3809 2024-04-04T23:24:04.615519678Z [2024-04-04T23:24:04.614+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:24:04.616285887Z [2024-04-04T23:24:04.615+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:23:00+00:00, run_id=scheduled__2024-04-04T23:23:00+00:00, run_start_date=2024-04-04 23:24:00.185390+00:00, run_end_date=2024-04-04 23:24:04.615455+00:00, run_duration=4.430065, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:23:00+00:00, data_interval_end=2024-04-04 23:24:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:24:04.632721221Z [2024-04-04T23:24:04.632+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:24:00+00:00, run_after=2024-04-04T23:25:00+00:00 2024-04-04T23:24:04.682817515Z [2024-04-04T23:24:04.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:23:00+00:00 exited with status success for try_number 1 2024-04-04T23:24:04.693349686Z [2024-04-04T23:24:04.692+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:23:00+00:00, map_index=-1, run_start_date=2024-04-04 23:24:03.152864+00:00, run_end_date=2024-04-04 23:24:04.434153+00:00, run_duration=1.281289, state=success, executor_state=success, try_number=1, max_tries=1, job_id=257, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:24:00.247064+00:00, queued_by_job_id=1, pid=3826 2024-04-04T23:24:05.750498722Z [2024-04-04T23:24:05.749+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:24:05.751419769Z [2024-04-04T23:24:05.750+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:23:00+00:00, run_id=scheduled__2024-04-04T23:23:00+00:00, run_start_date=2024-04-04 23:24:00.186461+00:00, run_end_date=2024-04-04 23:24:05.750455+00:00, run_duration=5.563994, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:23:00+00:00, data_interval_end=2024-04-04 23:24:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:24:05.768527236Z [2024-04-04T23:24:05.768+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:24:00+00:00, run_after=2024-04-04T23:25:00+00:00 2024-04-04T23:24:05.800453758Z [2024-04-04T23:24:05.800+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:23:00+00:00 exited with status success for try_number 1 2024-04-04T23:24:05.807527678Z [2024-04-04T23:24:05.807+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:23:00+00:00, map_index=-1, run_start_date=2024-04-04 23:24:03.127860+00:00, run_end_date=2024-04-04 23:24:04.709282+00:00, run_duration=1.581422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=256, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:24:00.247064+00:00, queued_by_job_id=1, pid=3825 2024-04-04T23:25:00.915711332Z [2024-04-04T23:25:00.915+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:25:00.935835220Z [2024-04-04T23:25:00.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:25:00+00:00, run_after=2024-04-04T23:26:00+00:00 2024-04-04T23:25:00.952746343Z [2024-04-04T23:25:00.952+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:25:00+00:00, run_after=2024-04-04T23:26:00+00:00 2024-04-04T23:25:00.967414046Z [2024-04-04T23:25:00.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:25:00+00:00, run_after=2024-04-04T23:30:00+00:00 2024-04-04T23:25:01.088197743Z [2024-04-04T23:25:01.087+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:25:01.088226596Z 2024-04-04T23:25:01.088230822Z 2024-04-04T23:25:01.088234581Z 2024-04-04T23:25:01.088237815Z 2024-04-04T23:25:01.088679647Z [2024-04-04T23:25:01.088+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:25:01.089164918Z [2024-04-04T23:25:01.088+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:25:01.089609639Z [2024-04-04T23:25:01.089+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:25:01.090005050Z [2024-04-04T23:25:01.089+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:25:01.091203914Z [2024-04-04T23:25:01.090+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:25:01.091217816Z 2024-04-04T23:25:01.091227798Z 2024-04-04T23:25:01.091273947Z 2024-04-04T23:25:01.091278814Z 2024-04-04T23:25:01.098431972Z [2024-04-04T23:25:01.098+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T23:25:01.098790223Z [2024-04-04T23:25:01.098+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:25:01.099179617Z [2024-04-04T23:25:01.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:25:01.099446456Z [2024-04-04T23:25:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:25:01.099868827Z [2024-04-04T23:25:01.099+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:25:01.100156386Z [2024-04-04T23:25:01.099+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:25:01.100645980Z [2024-04-04T23:25:01.100+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:25:01.101069471Z [2024-04-04T23:25:01.100+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:25:01.755545329Z [2024-04-04T23:25:01.754+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:20:00+00:00 exited with status queued for try_number 1 2024-04-04T23:25:01.755810212Z [2024-04-04T23:25:01.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:24:00+00:00 exited with status queued for try_number 1 2024-04-04T23:25:01.757626562Z [2024-04-04T23:25:01.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:24:00+00:00 exited with status queued for try_number 1 2024-04-04T23:25:01.778242347Z [2024-04-04T23:25:01.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:24:00+00:00 exited with status queued for try_number 1 2024-04-04T23:25:01.799637371Z [2024-04-04T23:25:01.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed8309d3-71f5-4723-b3be-27ee031a8991 2024-04-04T23:25:01.799660868Z [2024-04-04T23:25:01.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d85db4f-0e33-4613-83d5-85b60fb683fa 2024-04-04T23:25:01.799665001Z [2024-04-04T23:25:01.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to c35f2f5a-6540-48c0-ade9-7c25cb19cdaf 2024-04-04T23:25:01.799672851Z [2024-04-04T23:25:01.797+0000] {scheduler_job.py:635} INFO - Setting external_id for to 089d4639-5a92-4c14-9136-451adbd7e04f 2024-04-04T23:25:04.443478937Z [2024-04-04T23:25:04.442+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:25:04.444343424Z [2024-04-04T23:25:04.443+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:24:00+00:00, run_id=scheduled__2024-04-04T23:24:00+00:00, run_start_date=2024-04-04 23:25:00.981393+00:00, run_end_date=2024-04-04 23:25:04.443675+00:00, run_duration=3.462282, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:24:00+00:00, data_interval_end=2024-04-04 23:25:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:25:04.466222384Z [2024-04-04T23:25:04.465+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:25:00+00:00, run_after=2024-04-04T23:26:00+00:00 2024-04-04T23:25:04.539630783Z [2024-04-04T23:25:04.539+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:25:04.539681704Z 2024-04-04T23:25:04.540263768Z [2024-04-04T23:25:04.539+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:25:04.541498199Z [2024-04-04T23:25:04.541+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:25:04.541537294Z 2024-04-04T23:25:04.546514443Z [2024-04-04T23:25:04.546+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-04T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T23:25:04.546905995Z [2024-04-04T23:25:04.546+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-04T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:25:04.631060288Z [2024-04-04T23:25:04.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:20:00+00:00 exited with status queued for try_number 1 2024-04-04T23:25:04.633411547Z [2024-04-04T23:25:04.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:24:00+00:00 exited with status success for try_number 1 2024-04-04T23:25:04.639888136Z [2024-04-04T23:25:04.639+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea26b715-22ab-45ea-b610-e1cafb8b3907 2024-04-04T23:25:04.640278580Z [2024-04-04T23:25:04.639+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:24:00+00:00, map_index=-1, run_start_date=2024-04-04 23:25:02.745517+00:00, run_end_date=2024-04-04 23:25:03.292697+00:00, run_duration=0.54718, state=success, executor_state=success, try_number=1, max_tries=1, job_id=258, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:25:01.092629+00:00, queued_by_job_id=1, pid=3859 2024-04-04T23:25:04.755413494Z [2024-04-04T23:25:04.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:20:00+00:00 exited with status success for try_number 1 2024-04-04T23:25:04.762481775Z [2024-04-04T23:25:04.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T23:20:00+00:00, map_index=-1, run_start_date=2024-04-04 23:25:03.973110+00:00, run_end_date=2024-04-04 23:25:04.428798+00:00, run_duration=0.455688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=259, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:25:01.092629+00:00, queued_by_job_id=1, pid=3878 2024-04-04T23:25:06.189852631Z [2024-04-04T23:25:06.189+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:25:06.193075362Z [2024-04-04T23:25:06.189+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:24:00+00:00, run_id=scheduled__2024-04-04T23:24:00+00:00, run_start_date=2024-04-04 23:25:00.995761+00:00, run_end_date=2024-04-04 23:25:06.189737+00:00, run_duration=5.193976, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:24:00+00:00, data_interval_end=2024-04-04 23:25:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:25:06.207696437Z [2024-04-04T23:25:06.207+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:25:00+00:00, run_after=2024-04-04T23:26:00+00:00 2024-04-04T23:25:06.221926247Z [2024-04-04T23:25:06.220+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:25:06.222161899Z [2024-04-04T23:25:06.221+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:24:00+00:00, run_id=scheduled__2024-04-04T23:24:00+00:00, run_start_date=2024-04-04 23:25:00.999102+00:00, run_end_date=2024-04-04 23:25:06.221840+00:00, run_duration=5.222738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:24:00+00:00, data_interval_end=2024-04-04 23:25:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:25:06.233516595Z [2024-04-04T23:25:06.233+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:25:00+00:00, run_after=2024-04-04T23:26:00+00:00 2024-04-04T23:25:06.303797063Z [2024-04-04T23:25:06.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:24:00+00:00 exited with status success for try_number 1 2024-04-04T23:25:06.314668543Z [2024-04-04T23:25:06.314+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:24:00+00:00, map_index=-1, run_start_date=2024-04-04 23:25:04.141073+00:00, run_end_date=2024-04-04 23:25:05.695012+00:00, run_duration=1.553939, state=success, executor_state=success, try_number=1, max_tries=1, job_id=260, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:25:01.092629+00:00, queued_by_job_id=1, pid=3884 2024-04-04T23:25:06.966809337Z [2024-04-04T23:25:06.966+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:25:06.966839339Z 2024-04-04T23:25:06.967024610Z [2024-04-04T23:25:06.966+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:25:06.967856644Z [2024-04-04T23:25:06.967+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:25:06.967868462Z 2024-04-04T23:25:06.970978421Z [2024-04-04T23:25:06.970+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-04T23:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T23:25:06.971223920Z [2024-04-04T23:25:06.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-04T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T23:25:07.018350273Z [2024-04-04T23:25:07.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:20:00+00:00 exited with status queued for try_number 1 2024-04-04T23:25:07.018381896Z [2024-04-04T23:25:07.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:24:00+00:00 exited with status success for try_number 1 2024-04-04T23:25:07.018468935Z [2024-04-04T23:25:07.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:20:00+00:00 exited with status success for try_number 1 2024-04-04T23:25:07.029577709Z [2024-04-04T23:25:07.029+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-04T23:20:00+00:00, map_index=-1, run_start_date=2024-04-04 23:25:06.287920+00:00, run_end_date=2024-04-04 23:25:06.634145+00:00, run_duration=0.346225, state=success, executor_state=success, try_number=1, max_tries=1, job_id=262, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:25:04.542310+00:00, queued_by_job_id=1, pid=3908 2024-04-04T23:25:07.030114989Z [2024-04-04T23:25:07.029+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:24:00+00:00, map_index=-1, run_start_date=2024-04-04 23:25:04.282112+00:00, run_end_date=2024-04-04 23:25:06.134857+00:00, run_duration=1.852745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=261, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:25:01.092629+00:00, queued_by_job_id=1, pid=3885 2024-04-04T23:25:07.030667671Z [2024-04-04T23:25:07.030+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e956bc2-ed9d-42a9-93bc-61e0274378ae 2024-04-04T23:25:09.283485902Z [2024-04-04T23:25:09.282+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:25:09.283513315Z 2024-04-04T23:25:09.283827913Z [2024-04-04T23:25:09.283+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:25:09.285266332Z [2024-04-04T23:25:09.284+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:25:09.285282478Z 2024-04-04T23:25:09.290609370Z [2024-04-04T23:25:09.290+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-04T23:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:25:09.290644793Z [2024-04-04T23:25:09.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-04T23:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:25:09.362357943Z [2024-04-04T23:25:09.361+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:20:00+00:00 exited with status queued for try_number 1 2024-04-04T23:25:09.363387650Z [2024-04-04T23:25:09.363+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:20:00+00:00 exited with status success for try_number 1 2024-04-04T23:25:09.373967906Z [2024-04-04T23:25:09.373+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9094258-0ffa-4a8b-8ee7-d4a6c6492c59 2024-04-04T23:25:09.374374225Z [2024-04-04T23:25:09.374+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-04T23:20:00+00:00, map_index=0, run_start_date=2024-04-04 23:25:08.606449+00:00, run_end_date=2024-04-04 23:25:08.937138+00:00, run_duration=0.330689, state=success, executor_state=success, try_number=1, max_tries=1, job_id=263, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:25:06.968419+00:00, queued_by_job_id=1, pid=3916 2024-04-04T23:25:11.581459833Z [2024-04-04T23:25:11.581+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:25:11.582002166Z [2024-04-04T23:25:11.581+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:20:00+00:00, run_id=scheduled__2024-04-04T23:20:00+00:00, run_start_date=2024-04-04 23:25:00.980071+00:00, run_end_date=2024-04-04 23:25:11.581368+00:00, run_duration=10.601297, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:20:00+00:00, data_interval_end=2024-04-04 23:25:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-04T23:25:11.588101627Z [2024-04-04T23:25:11.587+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:25:00+00:00, run_after=2024-04-04T23:30:00+00:00 2024-04-04T23:25:11.623005558Z [2024-04-04T23:25:11.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:20:00+00:00 exited with status success for try_number 1 2024-04-04T23:25:11.631493131Z [2024-04-04T23:25:11.631+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-04T23:20:00+00:00, map_index=-1, run_start_date=2024-04-04 23:25:10.979906+00:00, run_end_date=2024-04-04 23:25:11.393322+00:00, run_duration=0.413416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=264, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:25:09.285653+00:00, queued_by_job_id=1, pid=3933 2024-04-04T23:25:39.675892114Z [2024-04-04T23:25:39.675+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-04T23:26:00.813217817Z [2024-04-04T23:26:00.812+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:26:00.820705440Z [2024-04-04T23:26:00.820+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:26:00.834030204Z [2024-04-04T23:26:00.833+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:26:00+00:00, run_after=2024-04-04T23:27:00+00:00 2024-04-04T23:26:00.853383847Z [2024-04-04T23:26:00.852+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:26:00+00:00, run_after=2024-04-04T23:27:00+00:00 2024-04-04T23:26:00.962580644Z [2024-04-04T23:26:00.961+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:26:00.962608802Z 2024-04-04T23:26:00.962618973Z 2024-04-04T23:26:00.962622588Z 2024-04-04T23:26:00.962625854Z 2024-04-04T23:26:00.962630882Z [2024-04-04T23:26:00.962+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:26:00.962634667Z [2024-04-04T23:26:00.962+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:26:00.962639537Z [2024-04-04T23:26:00.962+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:26:00.963067887Z [2024-04-04T23:26:00.962+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:26:00.963749720Z [2024-04-04T23:26:00.963+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:26:00.963763373Z 2024-04-04T23:26:00.963767496Z 2024-04-04T23:26:00.963771339Z 2024-04-04T23:26:00.963774629Z 2024-04-04T23:26:00.970393574Z [2024-04-04T23:26:00.968+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:26:00.970754035Z [2024-04-04T23:26:00.970+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:26:00.971285703Z [2024-04-04T23:26:00.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:26:00.971634924Z [2024-04-04T23:26:00.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:26:00.972214048Z [2024-04-04T23:26:00.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:26:00.972646111Z [2024-04-04T23:26:00.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:26:00.973129244Z [2024-04-04T23:26:00.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:26:00.973456096Z [2024-04-04T23:26:00.973+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:26:01.664295601Z [2024-04-04T23:26:01.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:24:00+00:00 exited with status queued for try_number 1 2024-04-04T23:26:01.664576377Z [2024-04-04T23:26:01.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:25:00+00:00 exited with status queued for try_number 1 2024-04-04T23:26:01.664809007Z [2024-04-04T23:26:01.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:25:00+00:00 exited with status queued for try_number 1 2024-04-04T23:26:01.665094874Z [2024-04-04T23:26:01.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:25:00+00:00 exited with status queued for try_number 1 2024-04-04T23:26:01.679025357Z [2024-04-04T23:26:01.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to d87d11f8-3ba0-4b0c-9835-ec1e583700c2 2024-04-04T23:26:01.679329364Z [2024-04-04T23:26:01.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bae9698-1985-4fb1-be44-963985817c3a 2024-04-04T23:26:01.679706905Z [2024-04-04T23:26:01.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad81328e-c107-4cc0-a8f0-0ffe67f3a705 2024-04-04T23:26:01.679993316Z [2024-04-04T23:26:01.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2686bde3-3b30-4dc5-bb67-e8b8b2a80543 2024-04-04T23:26:02.727882889Z [2024-04-04T23:26:02.727+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:26:02.728233711Z [2024-04-04T23:26:02.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:25:00+00:00, run_id=scheduled__2024-04-04T23:25:00+00:00, run_start_date=2024-04-04 23:26:00.867567+00:00, run_end_date=2024-04-04 23:26:02.727867+00:00, run_duration=1.8603, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:25:00+00:00, data_interval_end=2024-04-04 23:26:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:26:02.741785383Z [2024-04-04T23:26:02.741+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:26:00+00:00, run_after=2024-04-04T23:27:00+00:00 2024-04-04T23:26:02.844748517Z [2024-04-04T23:26:02.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:25:00+00:00 exited with status success for try_number 1 2024-04-04T23:26:02.864635737Z [2024-04-04T23:26:02.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:25:00+00:00, map_index=-1, run_start_date=2024-04-04 23:26:01.980539+00:00, run_end_date=2024-04-04 23:26:02.512483+00:00, run_duration=0.531944, state=success, executor_state=success, try_number=1, max_tries=1, job_id=265, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:26:00.964760+00:00, queued_by_job_id=1, pid=3946 2024-04-04T23:26:03.957116717Z [2024-04-04T23:26:03.956+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:26:03.957914408Z [2024-04-04T23:26:03.957+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:24:00+00:00, run_id=scheduled__2024-04-04T23:24:00+00:00, run_start_date=2024-04-04 23:26:00.866269+00:00, run_end_date=2024-04-04 23:26:03.957322+00:00, run_duration=3.091053, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:24:00+00:00, data_interval_end=2024-04-04 23:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:26:03.973739409Z [2024-04-04T23:26:03.973+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:26:00+00:00, run_after=2024-04-04T23:28:00+00:00 2024-04-04T23:26:04.081377643Z [2024-04-04T23:26:04.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:24:00+00:00 exited with status success for try_number 1 2024-04-04T23:26:04.090226629Z [2024-04-04T23:26:04.089+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:24:00+00:00, map_index=-1, run_start_date=2024-04-04 23:26:02.312459+00:00, run_end_date=2024-04-04 23:26:02.788303+00:00, run_duration=0.475844, state=success, executor_state=success, try_number=1, max_tries=1, job_id=266, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:26:00.964760+00:00, queued_by_job_id=1, pid=3947 2024-04-04T23:26:05.454689283Z [2024-04-04T23:26:05.454+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:26:05.455092200Z [2024-04-04T23:26:05.454+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:25:00+00:00, run_id=scheduled__2024-04-04T23:25:00+00:00, run_start_date=2024-04-04 23:26:00.870072+00:00, run_end_date=2024-04-04 23:26:05.454574+00:00, run_duration=4.584502, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:25:00+00:00, data_interval_end=2024-04-04 23:26:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:26:05.465076655Z [2024-04-04T23:26:05.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:26:00+00:00, run_after=2024-04-04T23:27:00+00:00 2024-04-04T23:26:05.505770501Z [2024-04-04T23:26:05.505+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:25:00+00:00 exited with status success for try_number 1 2024-04-04T23:26:05.510905828Z [2024-04-04T23:26:05.510+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:25:00+00:00, map_index=-1, run_start_date=2024-04-04 23:26:03.570781+00:00, run_end_date=2024-04-04 23:26:05.339153+00:00, run_duration=1.768372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=267, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:26:00.964760+00:00, queued_by_job_id=1, pid=3965 2024-04-04T23:26:06.551069657Z [2024-04-04T23:26:06.550+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:26:06.551228226Z [2024-04-04T23:26:06.551+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:25:00+00:00, run_id=scheduled__2024-04-04T23:25:00+00:00, run_start_date=2024-04-04 23:26:00.868749+00:00, run_end_date=2024-04-04 23:26:06.550955+00:00, run_duration=5.682206, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:25:00+00:00, data_interval_end=2024-04-04 23:26:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:26:06.560253478Z [2024-04-04T23:26:06.559+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:26:00+00:00, run_after=2024-04-04T23:27:00+00:00 2024-04-04T23:26:06.587107350Z [2024-04-04T23:26:06.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:25:00+00:00 exited with status success for try_number 1 2024-04-04T23:26:06.592392664Z [2024-04-04T23:26:06.592+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:25:00+00:00, map_index=-1, run_start_date=2024-04-04 23:26:03.984556+00:00, run_end_date=2024-04-04 23:26:05.801795+00:00, run_duration=1.817239, state=success, executor_state=success, try_number=1, max_tries=1, job_id=268, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:26:00.964760+00:00, queued_by_job_id=1, pid=3976 2024-04-04T23:27:00.792332948Z [2024-04-04T23:27:00.791+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:27:00+00:00, run_after=2024-04-04T23:28:00+00:00 2024-04-04T23:27:00.813562646Z [2024-04-04T23:27:00.813+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:27:00+00:00, run_after=2024-04-04T23:28:00+00:00 2024-04-04T23:27:00.825201094Z [2024-04-04T23:27:00.824+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:27:00.961327800Z [2024-04-04T23:27:00.960+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:27:00.961358910Z 2024-04-04T23:27:00.961364879Z 2024-04-04T23:27:00.961370003Z 2024-04-04T23:27:00.961436512Z [2024-04-04T23:27:00.961+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:27:00.961570783Z [2024-04-04T23:27:00.961+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:27:00.961669301Z [2024-04-04T23:27:00.961+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:27:00.963022101Z [2024-04-04T23:27:00.962+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:27:00.963038407Z 2024-04-04T23:27:00.963041717Z 2024-04-04T23:27:00.963044933Z 2024-04-04T23:27:00.970707461Z [2024-04-04T23:27:00.970+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:27:00.971070897Z [2024-04-04T23:27:00.970+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:27:00.971896023Z [2024-04-04T23:27:00.971+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:27:00.972176911Z [2024-04-04T23:27:00.971+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:27:00.972632112Z [2024-04-04T23:27:00.972+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:27:00.972884818Z [2024-04-04T23:27:00.972+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:27:01.519326763Z [2024-04-04T23:27:01.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:26:00+00:00 exited with status queued for try_number 1 2024-04-04T23:27:01.523295257Z [2024-04-04T23:27:01.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:26:00+00:00 exited with status queued for try_number 1 2024-04-04T23:27:01.523640630Z [2024-04-04T23:27:01.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:26:00+00:00 exited with status queued for try_number 1 2024-04-04T23:27:01.537223114Z [2024-04-04T23:27:01.536+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91a1c746-3c21-45d8-930c-21d9cf5b2c8d 2024-04-04T23:27:01.537765915Z [2024-04-04T23:27:01.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to 70882f00-ff64-40b0-991b-8af8e947351e 2024-04-04T23:27:01.538192784Z [2024-04-04T23:27:01.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0bf65b1-aa68-41d9-9c97-c28b9656ea40 2024-04-04T23:27:02.732591603Z [2024-04-04T23:27:02.731+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:27:02.732624980Z [2024-04-04T23:27:02.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:26:00+00:00, run_id=scheduled__2024-04-04T23:26:00+00:00, run_start_date=2024-04-04 23:27:00.841974+00:00, run_end_date=2024-04-04 23:27:02.731899+00:00, run_duration=1.889925, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:26:00+00:00, data_interval_end=2024-04-04 23:27:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:27:02.744537698Z [2024-04-04T23:27:02.744+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:27:00+00:00, run_after=2024-04-04T23:28:00+00:00 2024-04-04T23:27:03.733048641Z [2024-04-04T23:27:03.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:26:00+00:00 exited with status success for try_number 1 2024-04-04T23:27:03.745582583Z [2024-04-04T23:27:03.745+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:26:00+00:00, map_index=-1, run_start_date=2024-04-04 23:27:02.273214+00:00, run_end_date=2024-04-04 23:27:02.713296+00:00, run_duration=0.440082, state=success, executor_state=success, try_number=1, max_tries=1, job_id=269, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:27:00.964540+00:00, queued_by_job_id=1, pid=4003 2024-04-04T23:27:07.023785675Z [2024-04-04T23:27:07.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:27:07.024117295Z [2024-04-04T23:27:07.023+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:26:00+00:00, run_id=scheduled__2024-04-04T23:26:00+00:00, run_start_date=2024-04-04 23:27:00.844008+00:00, run_end_date=2024-04-04 23:27:07.023684+00:00, run_duration=6.179676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:26:00+00:00, data_interval_end=2024-04-04 23:27:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:27:07.033388318Z [2024-04-04T23:27:07.033+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:27:00+00:00, run_after=2024-04-04T23:28:00+00:00 2024-04-04T23:27:07.083720853Z [2024-04-04T23:27:07.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:26:00+00:00 exited with status success for try_number 1 2024-04-04T23:27:07.090262098Z [2024-04-04T23:27:07.089+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:26:00+00:00, map_index=-1, run_start_date=2024-04-04 23:27:03.395448+00:00, run_end_date=2024-04-04 23:27:06.780078+00:00, run_duration=3.38463, state=success, executor_state=success, try_number=1, max_tries=1, job_id=271, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:27:00.964540+00:00, queued_by_job_id=1, pid=4022 2024-04-04T23:27:08.143689892Z [2024-04-04T23:27:08.143+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:27:08.143983610Z [2024-04-04T23:27:08.143+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:26:00+00:00, run_id=scheduled__2024-04-04T23:26:00+00:00, run_start_date=2024-04-04 23:27:00.846031+00:00, run_end_date=2024-04-04 23:27:08.143478+00:00, run_duration=7.297447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:26:00+00:00, data_interval_end=2024-04-04 23:27:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:27:08.152209214Z [2024-04-04T23:27:08.151+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:27:00+00:00, run_after=2024-04-04T23:28:00+00:00 2024-04-04T23:27:08.177164010Z [2024-04-04T23:27:08.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:26:00+00:00 exited with status success for try_number 1 2024-04-04T23:27:08.182105114Z [2024-04-04T23:27:08.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:26:00+00:00, map_index=-1, run_start_date=2024-04-04 23:27:03.317111+00:00, run_end_date=2024-04-04 23:27:07.132201+00:00, run_duration=3.81509, state=success, executor_state=success, try_number=1, max_tries=1, job_id=270, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:27:00.964540+00:00, queued_by_job_id=1, pid=4021 2024-04-04T23:28:00.651057526Z [2024-04-04T23:28:00.650+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:28:00+00:00, run_after=2024-04-04T23:29:00+00:00 2024-04-04T23:28:00.671881030Z [2024-04-04T23:28:00.671+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:28:00.704887654Z [2024-04-04T23:28:00.704+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:28:00+00:00, run_after=2024-04-04T23:29:00+00:00 2024-04-04T23:28:00.716268363Z [2024-04-04T23:28:00.715+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:28:00.824894049Z [2024-04-04T23:28:00.824+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:28:00.824925343Z 2024-04-04T23:28:00.824932248Z 2024-04-04T23:28:00.824937519Z 2024-04-04T23:28:00.824943262Z 2024-04-04T23:28:00.825003610Z [2024-04-04T23:28:00.824+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:28:00.825142333Z [2024-04-04T23:28:00.825+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:28:00.825267539Z [2024-04-04T23:28:00.825+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:28:00.825421009Z [2024-04-04T23:28:00.825+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:28:00.826329785Z [2024-04-04T23:28:00.826+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:28:00.826339490Z 2024-04-04T23:28:00.826343164Z 2024-04-04T23:28:00.826346447Z 2024-04-04T23:28:00.826349773Z 2024-04-04T23:28:00.830712981Z [2024-04-04T23:28:00.830+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:28:00.830784216Z [2024-04-04T23:28:00.830+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:28:00.831020873Z [2024-04-04T23:28:00.830+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:28:00.831087120Z [2024-04-04T23:28:00.830+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:28:00.831262316Z [2024-04-04T23:28:00.831+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:28:00.831321383Z [2024-04-04T23:28:00.831+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:28:00.831494184Z [2024-04-04T23:28:00.831+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:28:00.831554359Z [2024-04-04T23:28:00.831+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:28:01.326029413Z [2024-04-04T23:28:01.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:26:00+00:00 exited with status queued for try_number 1 2024-04-04T23:28:01.326149469Z [2024-04-04T23:28:01.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:27:00+00:00 exited with status queued for try_number 1 2024-04-04T23:28:01.326303750Z [2024-04-04T23:28:01.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:27:00+00:00 exited with status queued for try_number 1 2024-04-04T23:28:01.326444613Z [2024-04-04T23:28:01.326+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:27:00+00:00 exited with status queued for try_number 1 2024-04-04T23:28:01.343575356Z [2024-04-04T23:28:01.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to baf124a6-6e44-4b53-8c1a-dfa1e8acd6c8 2024-04-04T23:28:01.343887747Z [2024-04-04T23:28:01.343+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfa64c79-5715-4f6e-ada1-813e12223a08 2024-04-04T23:28:01.344182282Z [2024-04-04T23:28:01.343+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25b02509-5380-4a49-9104-6317e731503b 2024-04-04T23:28:01.344421290Z [2024-04-04T23:28:01.344+0000] {scheduler_job.py:635} INFO - Setting external_id for to b61aeee4-4b5e-4cb7-be51-d42e75acea9b 2024-04-04T23:28:02.694355119Z [2024-04-04T23:28:02.693+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:28:02.695013004Z [2024-04-04T23:28:02.694+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:26:00+00:00, run_id=scheduled__2024-04-04T23:26:00+00:00, run_start_date=2024-04-04 23:28:00.731739+00:00, run_end_date=2024-04-04 23:28:02.694356+00:00, run_duration=1.962617, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:26:00+00:00, data_interval_end=2024-04-04 23:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:28:02.709575474Z [2024-04-04T23:28:02.709+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:28:00+00:00, run_after=2024-04-04T23:30:00+00:00 2024-04-04T23:28:02.809118420Z [2024-04-04T23:28:02.808+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:26:00+00:00 exited with status success for try_number 1 2024-04-04T23:28:02.818531567Z [2024-04-04T23:28:02.818+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:26:00+00:00, map_index=-1, run_start_date=2024-04-04 23:28:01.943296+00:00, run_end_date=2024-04-04 23:28:02.363592+00:00, run_duration=0.420296, state=success, executor_state=success, try_number=1, max_tries=1, job_id=272, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:28:00.827606+00:00, queued_by_job_id=1, pid=4055 2024-04-04T23:28:03.862259311Z [2024-04-04T23:28:03.861+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:28:03.862598403Z [2024-04-04T23:28:03.862+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:27:00+00:00, run_id=scheduled__2024-04-04T23:27:00+00:00, run_start_date=2024-04-04 23:28:00.734013+00:00, run_end_date=2024-04-04 23:28:03.862131+00:00, run_duration=3.128118, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:27:00+00:00, data_interval_end=2024-04-04 23:28:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:28:03.875724045Z [2024-04-04T23:28:03.875+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:28:00+00:00, run_after=2024-04-04T23:29:00+00:00 2024-04-04T23:28:03.948951755Z [2024-04-04T23:28:03.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:27:00+00:00 exited with status success for try_number 1 2024-04-04T23:28:03.955900541Z [2024-04-04T23:28:03.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:27:00+00:00, map_index=-1, run_start_date=2024-04-04 23:28:02.291085+00:00, run_end_date=2024-04-04 23:28:02.887865+00:00, run_duration=0.59678, state=success, executor_state=success, try_number=1, max_tries=1, job_id=273, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:28:00.827606+00:00, queued_by_job_id=1, pid=4061 2024-04-04T23:28:05.729406514Z [2024-04-04T23:28:05.728+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:28:05.729929294Z [2024-04-04T23:28:05.729+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:27:00+00:00, run_id=scheduled__2024-04-04T23:27:00+00:00, run_start_date=2024-04-04 23:28:00.735887+00:00, run_end_date=2024-04-04 23:28:05.729436+00:00, run_duration=4.993549, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:27:00+00:00, data_interval_end=2024-04-04 23:28:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:28:05.742202389Z [2024-04-04T23:28:05.741+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:28:00+00:00, run_after=2024-04-04T23:29:00+00:00 2024-04-04T23:28:05.784552556Z [2024-04-04T23:28:05.784+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:27:00+00:00 exited with status success for try_number 1 2024-04-04T23:28:05.792942825Z [2024-04-04T23:28:05.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:27:00+00:00, map_index=-1, run_start_date=2024-04-04 23:28:03.615568+00:00, run_end_date=2024-04-04 23:28:05.450430+00:00, run_duration=1.834862, state=success, executor_state=success, try_number=1, max_tries=1, job_id=274, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:28:00.827606+00:00, queued_by_job_id=1, pid=4074 2024-04-04T23:28:07.439982539Z [2024-04-04T23:28:07.439+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:28:07.440681270Z [2024-04-04T23:28:07.440+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:27:00+00:00, run_id=scheduled__2024-04-04T23:27:00+00:00, run_start_date=2024-04-04 23:28:00.737895+00:00, run_end_date=2024-04-04 23:28:07.440090+00:00, run_duration=6.702195, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:27:00+00:00, data_interval_end=2024-04-04 23:28:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:28:07.451606851Z [2024-04-04T23:28:07.451+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:28:00+00:00, run_after=2024-04-04T23:29:00+00:00 2024-04-04T23:28:07.491576627Z [2024-04-04T23:28:07.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:27:00+00:00 exited with status success for try_number 1 2024-04-04T23:28:07.498474625Z [2024-04-04T23:28:07.497+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:27:00+00:00, map_index=-1, run_start_date=2024-04-04 23:28:03.846278+00:00, run_end_date=2024-04-04 23:28:06.655837+00:00, run_duration=2.809559, state=success, executor_state=success, try_number=1, max_tries=1, job_id=275, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:28:00.827606+00:00, queued_by_job_id=1, pid=4080 2024-04-04T23:29:00.397302671Z [2024-04-04T23:29:00.396+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:29:00.419145394Z [2024-04-04T23:29:00.418+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:29:00+00:00, run_after=2024-04-04T23:30:00+00:00 2024-04-04T23:29:00.435592587Z [2024-04-04T23:29:00.435+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:29:00+00:00, run_after=2024-04-04T23:30:00+00:00 2024-04-04T23:29:00.557019646Z [2024-04-04T23:29:00.556+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:29:00.557045915Z 2024-04-04T23:29:00.557050160Z 2024-04-04T23:29:00.557053461Z 2024-04-04T23:29:00.568167324Z [2024-04-04T23:29:00.567+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:29:00.568299017Z [2024-04-04T23:29:00.568+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:29:00.568443928Z [2024-04-04T23:29:00.568+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:29:00.569223306Z [2024-04-04T23:29:00.568+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:29:00.569236291Z 2024-04-04T23:29:00.569239753Z 2024-04-04T23:29:00.569243373Z 2024-04-04T23:29:00.579509466Z [2024-04-04T23:29:00.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:29:00.579823106Z [2024-04-04T23:29:00.579+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:29:00.580053617Z [2024-04-04T23:29:00.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:29:00.580141475Z [2024-04-04T23:29:00.580+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:29:00.580419629Z [2024-04-04T23:29:00.580+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:29:00.580517510Z [2024-04-04T23:29:00.580+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:29:01.068352109Z [2024-04-04T23:29:01.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:28:00+00:00 exited with status queued for try_number 1 2024-04-04T23:29:01.068535579Z [2024-04-04T23:29:01.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:28:00+00:00 exited with status queued for try_number 1 2024-04-04T23:29:01.068687976Z [2024-04-04T23:29:01.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:28:00+00:00 exited with status queued for try_number 1 2024-04-04T23:29:01.076583100Z [2024-04-04T23:29:01.075+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd9ac378-96ec-4187-9ac7-eda6d84f44af 2024-04-04T23:29:01.076603957Z [2024-04-04T23:29:01.076+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d588725-fd67-4d8c-bfdf-8ff6367fc642 2024-04-04T23:29:01.076734500Z [2024-04-04T23:29:01.076+0000] {scheduler_job.py:635} INFO - Setting external_id for to d495dec9-ea28-42d4-b490-c6cefcd4e412 2024-04-04T23:29:03.686204621Z [2024-04-04T23:29:03.685+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:29:03.686868739Z [2024-04-04T23:29:03.686+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:28:00+00:00, run_id=scheduled__2024-04-04T23:28:00+00:00, run_start_date=2024-04-04 23:29:00.447979+00:00, run_end_date=2024-04-04 23:29:03.686296+00:00, run_duration=3.238317, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:28:00+00:00, data_interval_end=2024-04-04 23:29:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:29:03.706345912Z [2024-04-04T23:29:03.705+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:29:00+00:00, run_after=2024-04-04T23:30:00+00:00 2024-04-04T23:29:03.774832873Z [2024-04-04T23:29:03.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:28:00+00:00 exited with status success for try_number 1 2024-04-04T23:29:03.786912046Z [2024-04-04T23:29:03.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:28:00+00:00, map_index=-1, run_start_date=2024-04-04 23:29:02.237987+00:00, run_end_date=2024-04-04 23:29:02.750581+00:00, run_duration=0.512594, state=success, executor_state=success, try_number=1, max_tries=1, job_id=276, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:29:00.576601+00:00, queued_by_job_id=1, pid=4112 2024-04-04T23:29:05.941907265Z [2024-04-04T23:29:05.941+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:29:05.942265162Z [2024-04-04T23:29:05.941+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:28:00+00:00, run_id=scheduled__2024-04-04T23:28:00+00:00, run_start_date=2024-04-04 23:29:00.450307+00:00, run_end_date=2024-04-04 23:29:05.941874+00:00, run_duration=5.491567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:28:00+00:00, data_interval_end=2024-04-04 23:29:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:29:05.954056284Z [2024-04-04T23:29:05.953+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:29:00+00:00, run_after=2024-04-04T23:30:00+00:00 2024-04-04T23:29:06.017835294Z [2024-04-04T23:29:06.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:28:00+00:00 exited with status success for try_number 1 2024-04-04T23:29:06.036378786Z [2024-04-04T23:29:06.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:28:00+00:00, map_index=-1, run_start_date=2024-04-04 23:29:03.394615+00:00, run_end_date=2024-04-04 23:29:05.472630+00:00, run_duration=2.078015, state=success, executor_state=success, try_number=1, max_tries=1, job_id=277, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:29:00.576601+00:00, queued_by_job_id=1, pid=4125 2024-04-04T23:29:06.160513526Z [2024-04-04T23:29:06.159+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:29:06.160571839Z [2024-04-04T23:29:06.160+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:28:00+00:00, run_id=scheduled__2024-04-04T23:28:00+00:00, run_start_date=2024-04-04 23:29:00.449216+00:00, run_end_date=2024-04-04 23:29:06.160218+00:00, run_duration=5.711002, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:28:00+00:00, data_interval_end=2024-04-04 23:29:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:29:06.170598307Z [2024-04-04T23:29:06.170+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:29:00+00:00, run_after=2024-04-04T23:30:00+00:00 2024-04-04T23:29:06.206466238Z [2024-04-04T23:29:06.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:28:00+00:00 exited with status success for try_number 1 2024-04-04T23:29:06.213698375Z [2024-04-04T23:29:06.212+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:28:00+00:00, map_index=-1, run_start_date=2024-04-04 23:29:03.769469+00:00, run_end_date=2024-04-04 23:29:05.988587+00:00, run_duration=2.219118, state=success, executor_state=success, try_number=1, max_tries=1, job_id=278, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:29:00.576601+00:00, queued_by_job_id=1, pid=4136 2024-04-04T23:30:00.348827102Z [2024-04-04T23:30:00.348+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:30:00+00:00, run_after=2024-04-04T23:35:00+00:00 2024-04-04T23:30:00.368430453Z [2024-04-04T23:30:00.368+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:30:00+00:00, run_after=2024-04-04T23:31:00+00:00 2024-04-04T23:30:00.375920652Z [2024-04-04T23:30:00.375+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:30:00.387930759Z [2024-04-04T23:30:00.387+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:30:00+00:00, run_after=2024-04-04T23:31:00+00:00 2024-04-04T23:30:00.394722210Z [2024-04-04T23:30:00.394+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:30:00.511414763Z [2024-04-04T23:30:00.511+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-04T23:30:00.511439801Z 2024-04-04T23:30:00.511445033Z 2024-04-04T23:30:00.511449752Z 2024-04-04T23:30:00.511454287Z 2024-04-04T23:30:00.511458518Z 2024-04-04T23:30:00.511585048Z [2024-04-04T23:30:00.511+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:30:00.511784370Z [2024-04-04T23:30:00.511+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:30:00.511947645Z [2024-04-04T23:30:00.511+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:30:00.512073605Z [2024-04-04T23:30:00.511+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:30:00.512172449Z [2024-04-04T23:30:00.512+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:30:00.512825640Z [2024-04-04T23:30:00.512+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:30:00.512838639Z 2024-04-04T23:30:00.512845129Z 2024-04-04T23:30:00.512851702Z 2024-04-04T23:30:00.512857229Z 2024-04-04T23:30:00.512862907Z 2024-04-04T23:30:00.516841693Z [2024-04-04T23:30:00.516+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T23:30:00.517004898Z [2024-04-04T23:30:00.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:30:00.517261886Z [2024-04-04T23:30:00.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:30:00.517403535Z [2024-04-04T23:30:00.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:30:00.517628222Z [2024-04-04T23:30:00.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:30:00.517750624Z [2024-04-04T23:30:00.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:30:00.517940195Z [2024-04-04T23:30:00.517+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:30:00.518062107Z [2024-04-04T23:30:00.517+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:30:00.518282842Z [2024-04-04T23:30:00.518+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:30:00.518427371Z [2024-04-04T23:30:00.518+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:30:01.450709605Z [2024-04-04T23:30:01.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:25:00+00:00 exited with status queued for try_number 1 2024-04-04T23:30:01.450965312Z [2024-04-04T23:30:01.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:28:00+00:00 exited with status queued for try_number 1 2024-04-04T23:30:01.451199954Z [2024-04-04T23:30:01.450+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:29:00+00:00 exited with status queued for try_number 1 2024-04-04T23:30:01.451446818Z [2024-04-04T23:30:01.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:29:00+00:00 exited with status queued for try_number 1 2024-04-04T23:30:01.451737037Z [2024-04-04T23:30:01.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:29:00+00:00 exited with status queued for try_number 1 2024-04-04T23:30:01.477609928Z [2024-04-04T23:30:01.477+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2a36a2a-3e16-4971-a8ab-20e7237d2ac1 2024-04-04T23:30:01.482197978Z [2024-04-04T23:30:01.481+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31721467-39dc-4c88-b49c-0af3d0ee382f 2024-04-04T23:30:01.482830350Z [2024-04-04T23:30:01.482+0000] {scheduler_job.py:635} INFO - Setting external_id for to 802479ca-18c7-4519-8799-c70877acaafd 2024-04-04T23:30:01.483252542Z [2024-04-04T23:30:01.483+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc29a726-2915-4f63-9558-a4a180f0a75e 2024-04-04T23:30:01.483643877Z [2024-04-04T23:30:01.483+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9aea0667-eb95-4838-a781-4ffb58c42632 2024-04-04T23:30:04.814494832Z [2024-04-04T23:30:04.814+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:30:04.815075919Z [2024-04-04T23:30:04.814+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:28:00+00:00, run_id=scheduled__2024-04-04T23:28:00+00:00, run_start_date=2024-04-04 23:30:00.414466+00:00, run_end_date=2024-04-04 23:30:04.814608+00:00, run_duration=4.400142, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:28:00+00:00, data_interval_end=2024-04-04 23:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:30:04.830448915Z [2024-04-04T23:30:04.830+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:30:00+00:00, run_after=2024-04-04T23:32:00+00:00 2024-04-04T23:30:04.855166675Z [2024-04-04T23:30:04.854+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:30:04.855590574Z [2024-04-04T23:30:04.855+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:29:00+00:00, run_id=scheduled__2024-04-04T23:29:00+00:00, run_start_date=2024-04-04 23:30:00.416228+00:00, run_end_date=2024-04-04 23:30:04.855060+00:00, run_duration=4.438832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:29:00+00:00, data_interval_end=2024-04-04 23:30:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:30:04.867711085Z [2024-04-04T23:30:04.867+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:30:00+00:00, run_after=2024-04-04T23:31:00+00:00 2024-04-04T23:30:04.926719479Z [2024-04-04T23:30:04.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:28:00+00:00 exited with status success for try_number 1 2024-04-04T23:30:04.926963201Z [2024-04-04T23:30:04.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:29:00+00:00 exited with status success for try_number 1 2024-04-04T23:30:04.937586730Z [2024-04-04T23:30:04.937+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:28:00+00:00, map_index=-1, run_start_date=2024-04-04 23:30:03.117906+00:00, run_end_date=2024-04-04 23:30:04.019254+00:00, run_duration=0.901348, state=success, executor_state=success, try_number=1, max_tries=1, job_id=279, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:30:00.513785+00:00, queued_by_job_id=1, pid=4167 2024-04-04T23:30:04.937933496Z [2024-04-04T23:30:04.937+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:29:00+00:00, map_index=-1, run_start_date=2024-04-04 23:30:03.397931+00:00, run_end_date=2024-04-04 23:30:04.325156+00:00, run_duration=0.927225, state=success, executor_state=success, try_number=1, max_tries=1, job_id=280, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:30:00.513785+00:00, queued_by_job_id=1, pid=4168 2024-04-04T23:30:06.048839542Z [2024-04-04T23:30:06.048+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:30:06.048869335Z 2024-04-04T23:30:06.049007833Z [2024-04-04T23:30:06.048+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:30:06.050165779Z [2024-04-04T23:30:06.049+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:30:06.050176494Z 2024-04-04T23:30:06.054359919Z [2024-04-04T23:30:06.053+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-04T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T23:30:06.054756389Z [2024-04-04T23:30:06.054+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-04T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:30:06.111380670Z [2024-04-04T23:30:06.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:25:00+00:00 exited with status queued for try_number 1 2024-04-04T23:30:06.111445089Z [2024-04-04T23:30:06.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:25:00+00:00 exited with status success for try_number 1 2024-04-04T23:30:06.118689426Z [2024-04-04T23:30:06.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62463653-f6bc-461b-85bc-481f6b751930 2024-04-04T23:30:06.119273901Z [2024-04-04T23:30:06.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T23:25:00+00:00, map_index=-1, run_start_date=2024-04-04 23:30:04.962903+00:00, run_end_date=2024-04-04 23:30:05.333086+00:00, run_duration=0.370183, state=success, executor_state=success, try_number=1, max_tries=1, job_id=283, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:30:00.513785+00:00, queued_by_job_id=1, pid=4202 2024-04-04T23:30:07.257480959Z [2024-04-04T23:30:07.256+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:30:07.257610865Z [2024-04-04T23:30:07.257+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:29:00+00:00, run_id=scheduled__2024-04-04T23:29:00+00:00, run_start_date=2024-04-04 23:30:00.419189+00:00, run_end_date=2024-04-04 23:30:07.257315+00:00, run_duration=6.838126, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:29:00+00:00, data_interval_end=2024-04-04 23:30:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:30:07.269948720Z [2024-04-04T23:30:07.269+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:30:00+00:00, run_after=2024-04-04T23:31:00+00:00 2024-04-04T23:30:07.280900436Z [2024-04-04T23:30:07.280+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:30:07.281157125Z [2024-04-04T23:30:07.280+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:29:00+00:00, run_id=scheduled__2024-04-04T23:29:00+00:00, run_start_date=2024-04-04 23:30:00.421617+00:00, run_end_date=2024-04-04 23:30:07.280830+00:00, run_duration=6.859213, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:29:00+00:00, data_interval_end=2024-04-04 23:30:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:30:07.300324392Z [2024-04-04T23:30:07.299+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:30:00+00:00, run_after=2024-04-04T23:31:00+00:00 2024-04-04T23:30:07.351234359Z [2024-04-04T23:30:07.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:29:00+00:00 exited with status success for try_number 1 2024-04-04T23:30:07.351266720Z [2024-04-04T23:30:07.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:29:00+00:00 exited with status success for try_number 1 2024-04-04T23:30:07.365977858Z [2024-04-04T23:30:07.365+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:29:00+00:00, map_index=-1, run_start_date=2024-04-04 23:30:04.411056+00:00, run_end_date=2024-04-04 23:30:06.600729+00:00, run_duration=2.189673, state=success, executor_state=success, try_number=1, max_tries=1, job_id=281, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:30:00.513785+00:00, queued_by_job_id=1, pid=4185 2024-04-04T23:30:07.366052725Z [2024-04-04T23:30:07.365+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:29:00+00:00, map_index=-1, run_start_date=2024-04-04 23:30:04.895599+00:00, run_end_date=2024-04-04 23:30:07.121045+00:00, run_duration=2.225446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=282, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:30:00.513785+00:00, queued_by_job_id=1, pid=4201 2024-04-04T23:30:08.441710305Z [2024-04-04T23:30:08.441+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:30:08.441754648Z 2024-04-04T23:30:08.441761311Z [2024-04-04T23:30:08.441+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:30:08.442369849Z [2024-04-04T23:30:08.442+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:30:08.442384848Z 2024-04-04T23:30:08.445339739Z [2024-04-04T23:30:08.445+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-04T23:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T23:30:08.445411669Z [2024-04-04T23:30:08.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-04T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T23:30:08.493096618Z [2024-04-04T23:30:08.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:25:00+00:00 exited with status queued for try_number 1 2024-04-04T23:30:08.493128348Z [2024-04-04T23:30:08.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:25:00+00:00 exited with status success for try_number 1 2024-04-04T23:30:08.499996220Z [2024-04-04T23:30:08.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76b80f29-312f-4d0b-9188-b10320c854f6 2024-04-04T23:30:08.500160102Z [2024-04-04T23:30:08.499+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-04T23:25:00+00:00, map_index=-1, run_start_date=2024-04-04 23:30:07.887030+00:00, run_end_date=2024-04-04 23:30:08.268724+00:00, run_duration=0.381694, state=success, executor_state=success, try_number=1, max_tries=1, job_id=284, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:30:06.050865+00:00, queued_by_job_id=1, pid=4220 2024-04-04T23:30:10.749383057Z [2024-04-04T23:30:10.748+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:30:10.749410462Z 2024-04-04T23:30:10.749744484Z [2024-04-04T23:30:10.749+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:30:10.750795799Z [2024-04-04T23:30:10.750+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:30:10.750819762Z 2024-04-04T23:30:10.754359860Z [2024-04-04T23:30:10.754+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-04T23:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:30:10.754633418Z [2024-04-04T23:30:10.754+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-04T23:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:30:10.807664120Z [2024-04-04T23:30:10.806+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:25:00+00:00 exited with status queued for try_number 1 2024-04-04T23:30:10.807922791Z [2024-04-04T23:30:10.807+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:25:00+00:00 exited with status success for try_number 1 2024-04-04T23:30:10.816738810Z [2024-04-04T23:30:10.816+0000] {scheduler_job.py:635} INFO - Setting external_id for to e56251e4-9ab9-4ad6-8d41-3aa263a72fbe 2024-04-04T23:30:10.817243092Z [2024-04-04T23:30:10.816+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-04T23:25:00+00:00, map_index=0, run_start_date=2024-04-04 23:30:10.144674+00:00, run_end_date=2024-04-04 23:30:10.462683+00:00, run_duration=0.318009, state=success, executor_state=success, try_number=1, max_tries=1, job_id=285, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:30:08.442697+00:00, queued_by_job_id=1, pid=4238 2024-04-04T23:30:13.509272611Z [2024-04-04T23:30:13.508+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:30:13.509645124Z [2024-04-04T23:30:13.509+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:25:00+00:00, run_id=scheduled__2024-04-04T23:25:00+00:00, run_start_date=2024-04-04 23:30:00.412611+00:00, run_end_date=2024-04-04 23:30:13.509174+00:00, run_duration=13.096563, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:25:00+00:00, data_interval_end=2024-04-04 23:30:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-04T23:30:13.515476917Z [2024-04-04T23:30:13.515+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:30:00+00:00, run_after=2024-04-04T23:35:00+00:00 2024-04-04T23:30:13.546034369Z [2024-04-04T23:30:13.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:25:00+00:00 exited with status success for try_number 1 2024-04-04T23:30:13.553552507Z [2024-04-04T23:30:13.553+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-04T23:25:00+00:00, map_index=-1, run_start_date=2024-04-04 23:30:12.457260+00:00, run_end_date=2024-04-04 23:30:12.899538+00:00, run_duration=0.442278, state=success, executor_state=success, try_number=1, max_tries=1, job_id=286, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:30:10.751521+00:00, queued_by_job_id=1, pid=4249 2024-04-04T23:30:39.730331945Z [2024-04-04T23:30:39.729+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-04T23:31:00.146770370Z [2024-04-04T23:31:00.146+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:31:00.167531798Z [2024-04-04T23:31:00.167+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:31:00+00:00, run_after=2024-04-04T23:32:00+00:00 2024-04-04T23:31:00.195966160Z [2024-04-04T23:31:00.195+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:31:00+00:00, run_after=2024-04-04T23:32:00+00:00 2024-04-04T23:31:00.269893397Z [2024-04-04T23:31:00.269+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:31:00.269921722Z 2024-04-04T23:31:00.269925633Z 2024-04-04T23:31:00.269928902Z 2024-04-04T23:31:00.270179725Z [2024-04-04T23:31:00.269+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:31:00.270354174Z [2024-04-04T23:31:00.270+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:31:00.270411003Z [2024-04-04T23:31:00.270+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:31:00.270967920Z [2024-04-04T23:31:00.270+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:31:00.270980733Z 2024-04-04T23:31:00.270984235Z 2024-04-04T23:31:00.270987610Z 2024-04-04T23:31:00.273956117Z [2024-04-04T23:31:00.273+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:31:00.274115292Z [2024-04-04T23:31:00.273+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:31:00.274418048Z [2024-04-04T23:31:00.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:31:00.274577799Z [2024-04-04T23:31:00.274+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:31:00.274803296Z [2024-04-04T23:31:00.274+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:31:00.274914930Z [2024-04-04T23:31:00.274+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:31:00.845103357Z [2024-04-04T23:31:00.844+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:30:00+00:00 exited with status queued for try_number 1 2024-04-04T23:31:00.845142295Z [2024-04-04T23:31:00.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:30:00+00:00 exited with status queued for try_number 1 2024-04-04T23:31:00.845246672Z [2024-04-04T23:31:00.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:30:00+00:00 exited with status queued for try_number 1 2024-04-04T23:31:00.853233880Z [2024-04-04T23:31:00.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9e13654-e7e3-482d-994f-f25a692cd450 2024-04-04T23:31:00.853319889Z [2024-04-04T23:31:00.853+0000] {scheduler_job.py:635} INFO - Setting external_id for to 479f0b55-9b68-44ed-a230-0d8047f9c7f8 2024-04-04T23:31:00.853567870Z [2024-04-04T23:31:00.853+0000] {scheduler_job.py:635} INFO - Setting external_id for to 905e24c7-d85e-4a73-97ce-517f5953245f 2024-04-04T23:31:03.119961633Z [2024-04-04T23:31:03.119+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:31:03.120826771Z [2024-04-04T23:31:03.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:30:00+00:00, run_id=scheduled__2024-04-04T23:30:00+00:00, run_start_date=2024-04-04 23:31:00.216921+00:00, run_end_date=2024-04-04 23:31:03.120209+00:00, run_duration=2.903288, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:30:00+00:00, data_interval_end=2024-04-04 23:31:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:31:03.134916895Z [2024-04-04T23:31:03.134+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:31:00+00:00, run_after=2024-04-04T23:32:00+00:00 2024-04-04T23:31:03.201092293Z [2024-04-04T23:31:03.200+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:30:00+00:00 exited with status success for try_number 1 2024-04-04T23:31:03.209954370Z [2024-04-04T23:31:03.209+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:30:00+00:00, map_index=-1, run_start_date=2024-04-04 23:31:01.736767+00:00, run_end_date=2024-04-04 23:31:02.245117+00:00, run_duration=0.50835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=287, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:31:00.271675+00:00, queued_by_job_id=1, pid=4258 2024-04-04T23:31:05.361879724Z [2024-04-04T23:31:05.361+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:31:05.361958536Z [2024-04-04T23:31:05.361+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:30:00+00:00, run_id=scheduled__2024-04-04T23:30:00+00:00, run_start_date=2024-04-04 23:31:00.218454+00:00, run_end_date=2024-04-04 23:31:05.361606+00:00, run_duration=5.143152, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:30:00+00:00, data_interval_end=2024-04-04 23:31:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:31:05.371371920Z [2024-04-04T23:31:05.370+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:31:00+00:00, run_after=2024-04-04T23:32:00+00:00 2024-04-04T23:31:05.378788668Z [2024-04-04T23:31:05.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:31:05.378947796Z [2024-04-04T23:31:05.378+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:30:00+00:00, run_id=scheduled__2024-04-04T23:30:00+00:00, run_start_date=2024-04-04 23:31:00.219643+00:00, run_end_date=2024-04-04 23:31:05.378665+00:00, run_duration=5.159022, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:30:00+00:00, data_interval_end=2024-04-04 23:31:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:31:05.389301641Z [2024-04-04T23:31:05.388+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:31:00+00:00, run_after=2024-04-04T23:32:00+00:00 2024-04-04T23:31:05.425340696Z [2024-04-04T23:31:05.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:30:00+00:00 exited with status success for try_number 1 2024-04-04T23:31:05.425397087Z [2024-04-04T23:31:05.425+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:30:00+00:00 exited with status success for try_number 1 2024-04-04T23:31:05.434525887Z [2024-04-04T23:31:05.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:30:00+00:00, map_index=-1, run_start_date=2024-04-04 23:31:02.759835+00:00, run_end_date=2024-04-04 23:31:04.336684+00:00, run_duration=1.576849, state=success, executor_state=success, try_number=1, max_tries=1, job_id=288, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:31:00.271675+00:00, queued_by_job_id=1, pid=4276 2024-04-04T23:31:05.434626968Z [2024-04-04T23:31:05.434+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:30:00+00:00, map_index=-1, run_start_date=2024-04-04 23:31:02.971670+00:00, run_end_date=2024-04-04 23:31:04.948493+00:00, run_duration=1.976823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=289, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:31:00.271675+00:00, queued_by_job_id=1, pid=4277 2024-04-04T23:32:00.997693966Z [2024-04-04T23:32:00.997+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:32:01.024664089Z [2024-04-04T23:32:01.024+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:32:00+00:00, run_after=2024-04-04T23:33:00+00:00 2024-04-04T23:32:01.054855754Z [2024-04-04T23:32:01.054+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:32:00+00:00, run_after=2024-04-04T23:33:00+00:00 2024-04-04T23:32:01.068548520Z [2024-04-04T23:32:01.068+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:32:01.212496193Z [2024-04-04T23:32:01.212+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:32:01.212521615Z 2024-04-04T23:32:01.212525887Z 2024-04-04T23:32:01.212542319Z 2024-04-04T23:32:01.212545715Z 2024-04-04T23:32:01.215698569Z [2024-04-04T23:32:01.212+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:32:01.215732087Z [2024-04-04T23:32:01.212+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:32:01.215736042Z [2024-04-04T23:32:01.213+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:32:01.215739609Z [2024-04-04T23:32:01.213+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:32:01.215743050Z [2024-04-04T23:32:01.214+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:32:01.215747267Z 2024-04-04T23:32:01.215750733Z 2024-04-04T23:32:01.215754036Z 2024-04-04T23:32:01.215757274Z 2024-04-04T23:32:01.224619285Z [2024-04-04T23:32:01.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:32:01.224946635Z [2024-04-04T23:32:01.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:32:01.225253562Z [2024-04-04T23:32:01.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:32:01.225382067Z [2024-04-04T23:32:01.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:32:01.225724176Z [2024-04-04T23:32:01.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:32:01.225874841Z [2024-04-04T23:32:01.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:32:01.226301995Z [2024-04-04T23:32:01.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:32:01.229132865Z [2024-04-04T23:32:01.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:32:01.708799889Z [2024-04-04T23:32:01.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:30:00+00:00 exited with status queued for try_number 1 2024-04-04T23:32:01.709068631Z [2024-04-04T23:32:01.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:31:00+00:00 exited with status queued for try_number 1 2024-04-04T23:32:01.709274352Z [2024-04-04T23:32:01.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:31:00+00:00 exited with status queued for try_number 1 2024-04-04T23:32:01.709641889Z [2024-04-04T23:32:01.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:31:00+00:00 exited with status queued for try_number 1 2024-04-04T23:32:01.719337705Z [2024-04-04T23:32:01.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5700a350-cea8-4f7d-aec2-ddb9a52fdb43 2024-04-04T23:32:01.719679525Z [2024-04-04T23:32:01.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a338eff-a746-4ccc-a6be-29b2c77909bc 2024-04-04T23:32:01.719940548Z [2024-04-04T23:32:01.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0b7feb9-3cee-4afc-b49c-5c58f00ce058 2024-04-04T23:32:01.720191599Z [2024-04-04T23:32:01.720+0000] {scheduler_job.py:635} INFO - Setting external_id for to d9be5148-e5b9-415c-9c16-da5402eeee21 2024-04-04T23:32:03.961329996Z [2024-04-04T23:32:03.960+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:32:03.961871101Z [2024-04-04T23:32:03.961+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:31:00+00:00, run_id=scheduled__2024-04-04T23:31:00+00:00, run_start_date=2024-04-04 23:32:01.089196+00:00, run_end_date=2024-04-04 23:32:03.961464+00:00, run_duration=2.872268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:31:00+00:00, data_interval_end=2024-04-04 23:32:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:32:03.981657131Z [2024-04-04T23:32:03.981+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:32:00+00:00, run_after=2024-04-04T23:33:00+00:00 2024-04-04T23:32:03.990976276Z [2024-04-04T23:32:03.990+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:32:03.991358980Z [2024-04-04T23:32:03.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:30:00+00:00, run_id=scheduled__2024-04-04T23:30:00+00:00, run_start_date=2024-04-04 23:32:01.086459+00:00, run_end_date=2024-04-04 23:32:03.991060+00:00, run_duration=2.904601, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:30:00+00:00, data_interval_end=2024-04-04 23:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:32:04.004281796Z [2024-04-04T23:32:04.000+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:32:00+00:00, run_after=2024-04-04T23:34:00+00:00 2024-04-04T23:32:04.079402246Z [2024-04-04T23:32:04.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:30:00+00:00 exited with status success for try_number 1 2024-04-04T23:32:04.079526887Z [2024-04-04T23:32:04.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:31:00+00:00 exited with status success for try_number 1 2024-04-04T23:32:04.101198941Z [2024-04-04T23:32:04.100+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:30:00+00:00, map_index=-1, run_start_date=2024-04-04 23:32:02.807462+00:00, run_end_date=2024-04-04 23:32:03.658710+00:00, run_duration=0.851248, state=success, executor_state=success, try_number=1, max_tries=1, job_id=290, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:32:01.216331+00:00, queued_by_job_id=1, pid=4311 2024-04-04T23:32:04.101586648Z [2024-04-04T23:32:04.101+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:31:00+00:00, map_index=-1, run_start_date=2024-04-04 23:32:03.123361+00:00, run_end_date=2024-04-04 23:32:03.718341+00:00, run_duration=0.59498, state=success, executor_state=success, try_number=1, max_tries=1, job_id=291, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:32:01.216331+00:00, queued_by_job_id=1, pid=4313 2024-04-04T23:32:06.256883464Z [2024-04-04T23:32:06.255+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:32:06.256906695Z [2024-04-04T23:32:06.255+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:31:00+00:00, run_id=scheduled__2024-04-04T23:31:00+00:00, run_start_date=2024-04-04 23:32:01.091478+00:00, run_end_date=2024-04-04 23:32:06.255829+00:00, run_duration=5.164351, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:31:00+00:00, data_interval_end=2024-04-04 23:32:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:32:06.266219694Z [2024-04-04T23:32:06.265+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:32:00+00:00, run_after=2024-04-04T23:33:00+00:00 2024-04-04T23:32:06.302260157Z [2024-04-04T23:32:06.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:31:00+00:00 exited with status success for try_number 1 2024-04-04T23:32:06.307023271Z [2024-04-04T23:32:06.306+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:31:00+00:00, map_index=-1, run_start_date=2024-04-04 23:32:04.052183+00:00, run_end_date=2024-04-04 23:32:05.763320+00:00, run_duration=1.711137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=292, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:32:01.216331+00:00, queued_by_job_id=1, pid=4334 2024-04-04T23:32:07.355236496Z [2024-04-04T23:32:07.354+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:32:07.355640118Z [2024-04-04T23:32:07.355+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:31:00+00:00, run_id=scheduled__2024-04-04T23:31:00+00:00, run_start_date=2024-04-04 23:32:01.093666+00:00, run_end_date=2024-04-04 23:32:07.355254+00:00, run_duration=6.261588, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:31:00+00:00, data_interval_end=2024-04-04 23:32:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:32:07.365712688Z [2024-04-04T23:32:07.365+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:32:00+00:00, run_after=2024-04-04T23:33:00+00:00 2024-04-04T23:32:07.393052069Z [2024-04-04T23:32:07.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:31:00+00:00 exited with status success for try_number 1 2024-04-04T23:32:07.398317641Z [2024-04-04T23:32:07.397+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:31:00+00:00, map_index=-1, run_start_date=2024-04-04 23:32:04.175438+00:00, run_end_date=2024-04-04 23:32:06.571057+00:00, run_duration=2.395619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=293, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:32:01.216331+00:00, queued_by_job_id=1, pid=4335 2024-04-04T23:33:01.081523468Z [2024-04-04T23:33:01.080+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:33:01.112122366Z [2024-04-04T23:33:01.111+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:33:00+00:00, run_after=2024-04-04T23:34:00+00:00 2024-04-04T23:33:01.148047141Z [2024-04-04T23:33:01.147+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:33:00+00:00, run_after=2024-04-04T23:34:00+00:00 2024-04-04T23:33:01.362130401Z [2024-04-04T23:33:01.361+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:33:01.362157540Z 2024-04-04T23:33:01.362161846Z 2024-04-04T23:33:01.362165583Z 2024-04-04T23:33:01.362241033Z [2024-04-04T23:33:01.362+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:33:01.362623821Z [2024-04-04T23:33:01.362+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:33:01.362982884Z [2024-04-04T23:33:01.362+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:33:01.364652971Z [2024-04-04T23:33:01.364+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:33:01.364674210Z 2024-04-04T23:33:01.364678443Z 2024-04-04T23:33:01.364682394Z 2024-04-04T23:33:01.375841208Z [2024-04-04T23:33:01.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:33:01.376094615Z [2024-04-04T23:33:01.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:33:01.376596089Z [2024-04-04T23:33:01.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:33:01.376774895Z [2024-04-04T23:33:01.376+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:33:01.377082456Z [2024-04-04T23:33:01.376+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:33:01.377225390Z [2024-04-04T23:33:01.377+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:33:02.000016937Z [2024-04-04T23:33:01.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:32:00+00:00 exited with status queued for try_number 1 2024-04-04T23:33:02.005564885Z [2024-04-04T23:33:02.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:32:00+00:00 exited with status queued for try_number 1 2024-04-04T23:33:02.007921611Z [2024-04-04T23:33:02.007+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:32:00+00:00 exited with status queued for try_number 1 2024-04-04T23:33:02.032061394Z [2024-04-04T23:33:02.028+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90f41f4c-7fd1-469e-a7e9-289be2980a84 2024-04-04T23:33:02.033081793Z [2024-04-04T23:33:02.032+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3601af2a-2e0c-4fa7-a9d7-1d495f10e507 2024-04-04T23:33:02.040466815Z [2024-04-04T23:33:02.033+0000] {scheduler_job.py:635} INFO - Setting external_id for to 761b6e5f-4314-404b-80b3-fdc481f486eb 2024-04-04T23:33:04.836558356Z [2024-04-04T23:33:04.834+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:33:04.837001315Z [2024-04-04T23:33:04.836+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:32:00+00:00, run_id=scheduled__2024-04-04T23:32:00+00:00, run_start_date=2024-04-04 23:33:01.250485+00:00, run_end_date=2024-04-04 23:33:04.836596+00:00, run_duration=3.586111, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:32:00+00:00, data_interval_end=2024-04-04 23:33:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:33:04.848090878Z [2024-04-04T23:33:04.847+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:33:00+00:00, run_after=2024-04-04T23:34:00+00:00 2024-04-04T23:33:05.199412032Z [2024-04-04T23:33:05.198+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:32:00+00:00 exited with status success for try_number 1 2024-04-04T23:33:05.214462137Z [2024-04-04T23:33:05.213+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:32:00+00:00, map_index=-1, run_start_date=2024-04-04 23:33:04.394128+00:00, run_end_date=2024-04-04 23:33:04.798428+00:00, run_duration=0.4043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=294, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:33:01.365724+00:00, queued_by_job_id=1, pid=4369 2024-04-04T23:33:08.407362868Z [2024-04-04T23:33:08.406+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:33:08.407736577Z [2024-04-04T23:33:08.407+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:32:00+00:00, run_id=scheduled__2024-04-04T23:32:00+00:00, run_start_date=2024-04-04 23:33:01.253845+00:00, run_end_date=2024-04-04 23:33:08.407261+00:00, run_duration=7.153416, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:32:00+00:00, data_interval_end=2024-04-04 23:33:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:33:08.424835540Z [2024-04-04T23:33:08.424+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:33:00+00:00, run_after=2024-04-04T23:34:00+00:00 2024-04-04T23:33:08.449215579Z [2024-04-04T23:33:08.448+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:33:08.449747510Z [2024-04-04T23:33:08.449+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:32:00+00:00, run_id=scheduled__2024-04-04T23:32:00+00:00, run_start_date=2024-04-04 23:33:01.260050+00:00, run_end_date=2024-04-04 23:33:08.449420+00:00, run_duration=7.18937, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:32:00+00:00, data_interval_end=2024-04-04 23:33:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:33:08.476359102Z [2024-04-04T23:33:08.476+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:33:00+00:00, run_after=2024-04-04T23:34:00+00:00 2024-04-04T23:33:08.557736069Z [2024-04-04T23:33:08.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:32:00+00:00 exited with status success for try_number 1 2024-04-04T23:33:08.557793265Z [2024-04-04T23:33:08.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:32:00+00:00 exited with status success for try_number 1 2024-04-04T23:33:08.565152070Z [2024-04-04T23:33:08.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:32:00+00:00, map_index=-1, run_start_date=2024-04-04 23:33:05.637395+00:00, run_end_date=2024-04-04 23:33:07.609648+00:00, run_duration=1.972253, state=success, executor_state=success, try_number=1, max_tries=1, job_id=296, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:33:01.365724+00:00, queued_by_job_id=1, pid=4386 2024-04-04T23:33:08.568070713Z [2024-04-04T23:33:08.567+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:32:00+00:00, map_index=-1, run_start_date=2024-04-04 23:33:05.565746+00:00, run_end_date=2024-04-04 23:33:08.119370+00:00, run_duration=2.553624, state=success, executor_state=success, try_number=1, max_tries=1, job_id=295, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:33:01.365724+00:00, queued_by_job_id=1, pid=4385 2024-04-04T23:34:00.969708840Z [2024-04-04T23:34:00.969+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:34:01.012930855Z [2024-04-04T23:34:01.012+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:34:00+00:00, run_after=2024-04-04T23:35:00+00:00 2024-04-04T23:34:01.042662283Z [2024-04-04T23:34:01.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:34:00+00:00, run_after=2024-04-04T23:35:00+00:00 2024-04-04T23:34:01.056318911Z [2024-04-04T23:34:01.055+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:34:01.191541828Z [2024-04-04T23:34:01.185+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:34:01.196490173Z 2024-04-04T23:34:01.203615603Z 2024-04-04T23:34:01.203646527Z 2024-04-04T23:34:01.203649945Z 2024-04-04T23:34:01.203653835Z [2024-04-04T23:34:01.185+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:34:01.203656890Z [2024-04-04T23:34:01.185+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:34:01.203660168Z [2024-04-04T23:34:01.185+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:34:01.203663780Z [2024-04-04T23:34:01.185+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:34:01.203666806Z [2024-04-04T23:34:01.186+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:34:01.203670436Z 2024-04-04T23:34:01.203673390Z 2024-04-04T23:34:01.203676705Z 2024-04-04T23:34:01.203679712Z 2024-04-04T23:34:01.203726544Z [2024-04-04T23:34:01.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:34:01.203748455Z [2024-04-04T23:34:01.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:34:01.203754576Z [2024-04-04T23:34:01.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:34:01.203770998Z [2024-04-04T23:34:01.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:34:01.203774527Z [2024-04-04T23:34:01.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:34:01.203789986Z [2024-04-04T23:34:01.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:34:01.203793384Z [2024-04-04T23:34:01.195+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:34:01.203796527Z [2024-04-04T23:34:01.196+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:34:02.037350733Z [2024-04-04T23:34:02.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:32:00+00:00 exited with status queued for try_number 1 2024-04-04T23:34:02.037608250Z [2024-04-04T23:34:02.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:33:00+00:00 exited with status queued for try_number 1 2024-04-04T23:34:02.037862879Z [2024-04-04T23:34:02.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:33:00+00:00 exited with status queued for try_number 1 2024-04-04T23:34:02.038622073Z [2024-04-04T23:34:02.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:33:00+00:00 exited with status queued for try_number 1 2024-04-04T23:34:02.053491138Z [2024-04-04T23:34:02.053+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5176c998-a53b-46e4-9a01-e4fd39de44e5 2024-04-04T23:34:02.053736472Z [2024-04-04T23:34:02.053+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8fc0fb3-ab41-4204-af08-61e48674f258 2024-04-04T23:34:02.054161622Z [2024-04-04T23:34:02.053+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0fb8eda3-361a-4089-9c6d-3f79169bd37d 2024-04-04T23:34:02.054193964Z [2024-04-04T23:34:02.054+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62c7ef55-8a74-4e26-86ab-0c6276bc1768 2024-04-04T23:34:04.493529399Z [2024-04-04T23:34:04.493+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:34:04.493770874Z [2024-04-04T23:34:04.493+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:32:00+00:00, run_id=scheduled__2024-04-04T23:32:00+00:00, run_start_date=2024-04-04 23:34:01.078269+00:00, run_end_date=2024-04-04 23:34:04.493376+00:00, run_duration=3.415107, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:32:00+00:00, data_interval_end=2024-04-04 23:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:34:04.504247475Z [2024-04-04T23:34:04.503+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:34:00+00:00, run_after=2024-04-04T23:36:00+00:00 2024-04-04T23:34:04.519805934Z [2024-04-04T23:34:04.519+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:34:04.519982646Z [2024-04-04T23:34:04.519+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:33:00+00:00, run_id=scheduled__2024-04-04T23:33:00+00:00, run_start_date=2024-04-04 23:34:01.079489+00:00, run_end_date=2024-04-04 23:34:04.519689+00:00, run_duration=3.4402, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:33:00+00:00, data_interval_end=2024-04-04 23:34:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:34:04.537028700Z [2024-04-04T23:34:04.536+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:34:00+00:00, run_after=2024-04-04T23:35:00+00:00 2024-04-04T23:34:04.629130425Z [2024-04-04T23:34:04.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:32:00+00:00 exited with status success for try_number 1 2024-04-04T23:34:04.629869221Z [2024-04-04T23:34:04.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:33:00+00:00 exited with status success for try_number 1 2024-04-04T23:34:04.641497271Z [2024-04-04T23:34:04.640+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:32:00+00:00, map_index=-1, run_start_date=2024-04-04 23:34:02.738379+00:00, run_end_date=2024-04-04 23:34:03.459621+00:00, run_duration=0.721242, state=success, executor_state=success, try_number=1, max_tries=1, job_id=297, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:34:01.187002+00:00, queued_by_job_id=1, pid=4419 2024-04-04T23:34:04.641828016Z [2024-04-04T23:34:04.641+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:33:00+00:00, map_index=-1, run_start_date=2024-04-04 23:34:03.278356+00:00, run_end_date=2024-04-04 23:34:03.838048+00:00, run_duration=0.559692, state=success, executor_state=success, try_number=1, max_tries=1, job_id=298, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:34:01.187002+00:00, queued_by_job_id=1, pid=4427 2024-04-04T23:34:06.762983359Z [2024-04-04T23:34:06.762+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:34:06.763136172Z [2024-04-04T23:34:06.762+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:33:00+00:00, run_id=scheduled__2024-04-04T23:33:00+00:00, run_start_date=2024-04-04 23:34:01.081632+00:00, run_end_date=2024-04-04 23:34:06.762829+00:00, run_duration=5.681197, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:33:00+00:00, data_interval_end=2024-04-04 23:34:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:34:06.774436038Z [2024-04-04T23:34:06.773+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:34:00+00:00, run_after=2024-04-04T23:35:00+00:00 2024-04-04T23:34:06.783615935Z [2024-04-04T23:34:06.783+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:34:06.783648945Z [2024-04-04T23:34:06.783+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:33:00+00:00, run_id=scheduled__2024-04-04T23:33:00+00:00, run_start_date=2024-04-04 23:34:01.080621+00:00, run_end_date=2024-04-04 23:34:06.783355+00:00, run_duration=5.702734, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:33:00+00:00, data_interval_end=2024-04-04 23:34:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:34:06.796965433Z [2024-04-04T23:34:06.796+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:34:00+00:00, run_after=2024-04-04T23:35:00+00:00 2024-04-04T23:34:06.849169048Z [2024-04-04T23:34:06.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:33:00+00:00 exited with status success for try_number 1 2024-04-04T23:34:06.849202933Z [2024-04-04T23:34:06.848+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:33:00+00:00 exited with status success for try_number 1 2024-04-04T23:34:06.856369844Z [2024-04-04T23:34:06.855+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:33:00+00:00, map_index=-1, run_start_date=2024-04-04 23:34:04.535530+00:00, run_end_date=2024-04-04 23:34:06.258239+00:00, run_duration=1.722709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=300, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:34:01.187002+00:00, queued_by_job_id=1, pid=4444 2024-04-04T23:34:06.856441400Z [2024-04-04T23:34:06.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:33:00+00:00, map_index=-1, run_start_date=2024-04-04 23:34:04.211080+00:00, run_end_date=2024-04-04 23:34:06.514359+00:00, run_duration=2.303279, state=success, executor_state=success, try_number=1, max_tries=1, job_id=299, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:34:01.187002+00:00, queued_by_job_id=1, pid=4438 2024-04-04T23:35:00.244180897Z [2024-04-04T23:35:00.243+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:35:00.261181738Z [2024-04-04T23:35:00.260+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:35:00+00:00, run_after=2024-04-04T23:36:00+00:00 2024-04-04T23:35:00.279971617Z [2024-04-04T23:35:00.279+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:35:00+00:00, run_after=2024-04-04T23:36:00+00:00 2024-04-04T23:35:00.297243844Z [2024-04-04T23:35:00.296+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:35:00+00:00, run_after=2024-04-04T23:40:00+00:00 2024-04-04T23:35:00.394936753Z [2024-04-04T23:35:00.394+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:35:00.394964831Z 2024-04-04T23:35:00.394970493Z 2024-04-04T23:35:00.394974918Z 2024-04-04T23:35:00.394979208Z 2024-04-04T23:35:00.395305589Z [2024-04-04T23:35:00.395+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:35:00.395587427Z [2024-04-04T23:35:00.395+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:35:00.395795881Z [2024-04-04T23:35:00.395+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:35:00.396009987Z [2024-04-04T23:35:00.395+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:35:00.396827459Z [2024-04-04T23:35:00.396+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:35:00.396837498Z 2024-04-04T23:35:00.396841927Z 2024-04-04T23:35:00.396845842Z 2024-04-04T23:35:00.396849663Z 2024-04-04T23:35:00.403046902Z [2024-04-04T23:35:00.402+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T23:35:00.403281352Z [2024-04-04T23:35:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:35:00.403924782Z [2024-04-04T23:35:00.403+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:35:00.404072694Z [2024-04-04T23:35:00.403+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:35:00.404356076Z [2024-04-04T23:35:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:35:00.404511527Z [2024-04-04T23:35:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:35:00.404805451Z [2024-04-04T23:35:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:35:00.404988341Z [2024-04-04T23:35:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:35:00.868835751Z [2024-04-04T23:35:00.868+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:30:00+00:00 exited with status queued for try_number 1 2024-04-04T23:35:00.870685892Z [2024-04-04T23:35:00.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:34:00+00:00 exited with status queued for try_number 1 2024-04-04T23:35:00.874097300Z [2024-04-04T23:35:00.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:34:00+00:00 exited with status queued for try_number 1 2024-04-04T23:35:00.874347636Z [2024-04-04T23:35:00.874+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:34:00+00:00 exited with status queued for try_number 1 2024-04-04T23:35:00.898887036Z [2024-04-04T23:35:00.898+0000] {scheduler_job.py:635} INFO - Setting external_id for to 73662e4d-2309-453f-a600-848e77341d7a 2024-04-04T23:35:00.901474994Z [2024-04-04T23:35:00.901+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab93c185-80ad-4127-aeee-e6b5cc5dedd4 2024-04-04T23:35:00.901658912Z [2024-04-04T23:35:00.901+0000] {scheduler_job.py:635} INFO - Setting external_id for to afcea26c-d116-4a38-8d86-fc91fcd03797 2024-04-04T23:35:00.901806347Z [2024-04-04T23:35:00.901+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24e9f7ae-7d57-4086-bcdf-2bc08476e626 2024-04-04T23:35:02.875319459Z [2024-04-04T23:35:02.874+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:35:02.875808184Z [2024-04-04T23:35:02.875+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:34:00+00:00, run_id=scheduled__2024-04-04T23:34:00+00:00, run_start_date=2024-04-04 23:35:00.310716+00:00, run_end_date=2024-04-04 23:35:02.875280+00:00, run_duration=2.564564, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:34:00+00:00, data_interval_end=2024-04-04 23:35:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:35:02.900281301Z [2024-04-04T23:35:02.899+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:35:00+00:00, run_after=2024-04-04T23:36:00+00:00 2024-04-04T23:35:03.053675909Z [2024-04-04T23:35:03.053+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:34:00+00:00 exited with status success for try_number 1 2024-04-04T23:35:03.069135939Z [2024-04-04T23:35:03.068+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:34:00+00:00, map_index=-1, run_start_date=2024-04-04 23:35:02.010511+00:00, run_end_date=2024-04-04 23:35:02.439380+00:00, run_duration=0.428869, state=success, executor_state=success, try_number=1, max_tries=1, job_id=301, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:35:00.398039+00:00, queued_by_job_id=1, pid=4478 2024-04-04T23:35:04.210269866Z [2024-04-04T23:35:04.209+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:35:04.210308014Z 2024-04-04T23:35:04.210490490Z [2024-04-04T23:35:04.210+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:35:04.211439309Z [2024-04-04T23:35:04.211+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:35:04.211459708Z 2024-04-04T23:35:04.215693062Z [2024-04-04T23:35:04.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-04T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T23:35:04.215895062Z [2024-04-04T23:35:04.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-04T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:35:04.271149745Z [2024-04-04T23:35:04.270+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:30:00+00:00 exited with status queued for try_number 1 2024-04-04T23:35:04.271375112Z [2024-04-04T23:35:04.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:30:00+00:00 exited with status success for try_number 1 2024-04-04T23:35:04.277679406Z [2024-04-04T23:35:04.277+0000] {scheduler_job.py:635} INFO - Setting external_id for to f38b1524-3c64-4f4d-8e43-deabd8f2593b 2024-04-04T23:35:04.277991227Z [2024-04-04T23:35:04.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T23:30:00+00:00, map_index=-1, run_start_date=2024-04-04 23:35:03.159631+00:00, run_end_date=2024-04-04 23:35:03.595234+00:00, run_duration=0.435603, state=success, executor_state=success, try_number=1, max_tries=1, job_id=303, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:35:00.398039+00:00, queued_by_job_id=1, pid=4502 2024-04-04T23:35:05.444662535Z [2024-04-04T23:35:05.444+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:35:05.445467082Z [2024-04-04T23:35:05.445+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:34:00+00:00, run_id=scheduled__2024-04-04T23:34:00+00:00, run_start_date=2024-04-04 23:35:00.312153+00:00, run_end_date=2024-04-04 23:35:05.444877+00:00, run_duration=5.132724, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:34:00+00:00, data_interval_end=2024-04-04 23:35:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:35:05.460206325Z [2024-04-04T23:35:05.459+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:35:00+00:00, run_after=2024-04-04T23:36:00+00:00 2024-04-04T23:35:05.469502836Z [2024-04-04T23:35:05.468+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:35:05.470243548Z [2024-04-04T23:35:05.469+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:34:00+00:00, run_id=scheduled__2024-04-04T23:34:00+00:00, run_start_date=2024-04-04 23:35:00.313339+00:00, run_end_date=2024-04-04 23:35:05.469660+00:00, run_duration=5.156321, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:34:00+00:00, data_interval_end=2024-04-04 23:35:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:35:05.487037452Z [2024-04-04T23:35:05.486+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:35:00+00:00, run_after=2024-04-04T23:36:00+00:00 2024-04-04T23:35:05.548063722Z [2024-04-04T23:35:05.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:34:00+00:00 exited with status success for try_number 1 2024-04-04T23:35:05.548103466Z [2024-04-04T23:35:05.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:34:00+00:00 exited with status success for try_number 1 2024-04-04T23:35:05.558176167Z [2024-04-04T23:35:05.557+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:34:00+00:00, map_index=-1, run_start_date=2024-04-04 23:35:03.021148+00:00, run_end_date=2024-04-04 23:35:04.565895+00:00, run_duration=1.544747, state=success, executor_state=success, try_number=1, max_tries=1, job_id=302, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:35:00.398039+00:00, queued_by_job_id=1, pid=4496 2024-04-04T23:35:05.558267944Z [2024-04-04T23:35:05.558+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:34:00+00:00, map_index=-1, run_start_date=2024-04-04 23:35:03.369143+00:00, run_end_date=2024-04-04 23:35:04.959782+00:00, run_duration=1.590639, state=success, executor_state=success, try_number=1, max_tries=1, job_id=304, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:35:00.398039+00:00, queued_by_job_id=1, pid=4503 2024-04-04T23:35:06.674410601Z [2024-04-04T23:35:06.674+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:35:06.674456420Z 2024-04-04T23:35:06.674474832Z [2024-04-04T23:35:06.674+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:35:06.675103942Z [2024-04-04T23:35:06.674+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:35:06.675157154Z 2024-04-04T23:35:06.678470171Z [2024-04-04T23:35:06.678+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-04T23:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T23:35:06.678525404Z [2024-04-04T23:35:06.678+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-04T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T23:35:06.767715464Z [2024-04-04T23:35:06.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:30:00+00:00 exited with status queued for try_number 1 2024-04-04T23:35:06.777904368Z [2024-04-04T23:35:06.777+0000] {scheduler_job.py:635} INFO - Setting external_id for to 205730f6-2ab3-40e6-aa3a-ad6e901a7b36 2024-04-04T23:35:06.871534346Z [2024-04-04T23:35:06.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:30:00+00:00 exited with status success for try_number 1 2024-04-04T23:35:06.877597257Z [2024-04-04T23:35:06.877+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-04T23:30:00+00:00, map_index=-1, run_start_date=2024-04-04 23:35:06.186025+00:00, run_end_date=2024-04-04 23:35:06.586575+00:00, run_duration=0.40055, state=success, executor_state=success, try_number=1, max_tries=1, job_id=305, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:35:04.212128+00:00, queued_by_job_id=1, pid=4526 2024-04-04T23:35:09.301511986Z [2024-04-04T23:35:09.301+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:35:09.301565359Z 2024-04-04T23:35:09.301824015Z [2024-04-04T23:35:09.301+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:35:09.302801564Z [2024-04-04T23:35:09.302+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:35:09.302825482Z 2024-04-04T23:35:09.306413115Z [2024-04-04T23:35:09.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-04T23:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:35:09.306705604Z [2024-04-04T23:35:09.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-04T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:35:09.377477093Z [2024-04-04T23:35:09.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:30:00+00:00 exited with status queued for try_number 1 2024-04-04T23:35:09.377623878Z [2024-04-04T23:35:09.377+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:30:00+00:00 exited with status success for try_number 1 2024-04-04T23:35:09.386936828Z [2024-04-04T23:35:09.386+0000] {scheduler_job.py:635} INFO - Setting external_id for to 10944be4-aa44-43ac-a4e6-076615f76a09 2024-04-04T23:35:09.387162720Z [2024-04-04T23:35:09.386+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-04T23:30:00+00:00, map_index=0, run_start_date=2024-04-04 23:35:08.485486+00:00, run_end_date=2024-04-04 23:35:08.796563+00:00, run_duration=0.311077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=306, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:35:06.675787+00:00, queued_by_job_id=1, pid=4534 2024-04-04T23:35:12.714416528Z [2024-04-04T23:35:12.713+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:35:12.714781587Z [2024-04-04T23:35:12.714+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:30:00+00:00, run_id=scheduled__2024-04-04T23:30:00+00:00, run_start_date=2024-04-04 23:35:00.309284+00:00, run_end_date=2024-04-04 23:35:12.714197+00:00, run_duration=12.404913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:30:00+00:00, data_interval_end=2024-04-04 23:35:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-04T23:35:12.721652444Z [2024-04-04T23:35:12.721+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:35:00+00:00, run_after=2024-04-04T23:40:00+00:00 2024-04-04T23:35:12.756963626Z [2024-04-04T23:35:12.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:30:00+00:00 exited with status success for try_number 1 2024-04-04T23:35:12.762927246Z [2024-04-04T23:35:12.762+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-04T23:30:00+00:00, map_index=-1, run_start_date=2024-04-04 23:35:11.084193+00:00, run_end_date=2024-04-04 23:35:11.578087+00:00, run_duration=0.493894, state=success, executor_state=success, try_number=1, max_tries=1, job_id=307, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:35:09.303399+00:00, queued_by_job_id=1, pid=4552 2024-04-04T23:35:39.781211903Z [2024-04-04T23:35:39.780+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-04T23:36:00.733398946Z [2024-04-04T23:36:00.732+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:36:00.755527367Z [2024-04-04T23:36:00.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:36:00+00:00, run_after=2024-04-04T23:37:00+00:00 2024-04-04T23:36:00.777197170Z [2024-04-04T23:36:00.776+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:36:00+00:00, run_after=2024-04-04T23:37:00+00:00 2024-04-04T23:36:00.785483368Z [2024-04-04T23:36:00.785+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:36:00.880285786Z [2024-04-04T23:36:00.879+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:36:00.880310177Z 2024-04-04T23:36:00.880314640Z 2024-04-04T23:36:00.880318055Z 2024-04-04T23:36:00.880321412Z 2024-04-04T23:36:00.880795935Z [2024-04-04T23:36:00.880+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:36:00.880989923Z [2024-04-04T23:36:00.880+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:36:00.881261388Z [2024-04-04T23:36:00.880+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:36:00.883905092Z [2024-04-04T23:36:00.881+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:36:00.884725998Z [2024-04-04T23:36:00.884+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:36:00.884738957Z 2024-04-04T23:36:00.884742906Z 2024-04-04T23:36:00.884746136Z 2024-04-04T23:36:00.884749479Z 2024-04-04T23:36:00.889880831Z [2024-04-04T23:36:00.889+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:36:00.889930925Z [2024-04-04T23:36:00.889+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:36:00.890228877Z [2024-04-04T23:36:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:36:00.890337562Z [2024-04-04T23:36:00.890+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:36:00.890636155Z [2024-04-04T23:36:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:36:00.890810364Z [2024-04-04T23:36:00.890+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:36:00.891113169Z [2024-04-04T23:36:00.890+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:36:00.891414304Z [2024-04-04T23:36:00.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:36:01.690731123Z [2024-04-04T23:36:01.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:34:00+00:00 exited with status queued for try_number 1 2024-04-04T23:36:01.690753479Z [2024-04-04T23:36:01.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:35:00+00:00 exited with status queued for try_number 1 2024-04-04T23:36:01.690982136Z [2024-04-04T23:36:01.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:35:00+00:00 exited with status queued for try_number 1 2024-04-04T23:36:01.691165293Z [2024-04-04T23:36:01.690+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:35:00+00:00 exited with status queued for try_number 1 2024-04-04T23:36:01.707746732Z [2024-04-04T23:36:01.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a65aadb-83c4-4d4b-a4c1-2f394d500a9b 2024-04-04T23:36:01.710870403Z [2024-04-04T23:36:01.710+0000] {scheduler_job.py:635} INFO - Setting external_id for to a59619a7-e314-401d-a004-7fef362e40f0 2024-04-04T23:36:01.711248951Z [2024-04-04T23:36:01.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8abb6120-8c5a-4bca-bc65-4680e915572c 2024-04-04T23:36:01.711548835Z [2024-04-04T23:36:01.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to c014867f-082c-49fa-be7d-b050ef51d420 2024-04-04T23:36:03.042803746Z [2024-04-04T23:36:03.042+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:36:03.043358129Z [2024-04-04T23:36:03.043+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:35:00+00:00, run_id=scheduled__2024-04-04T23:35:00+00:00, run_start_date=2024-04-04 23:36:00.803477+00:00, run_end_date=2024-04-04 23:36:03.042704+00:00, run_duration=2.239227, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:35:00+00:00, data_interval_end=2024-04-04 23:36:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:36:03.059246965Z [2024-04-04T23:36:03.058+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:36:00+00:00, run_after=2024-04-04T23:37:00+00:00 2024-04-04T23:36:03.069444743Z [2024-04-04T23:36:03.068+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:36:03.069714973Z [2024-04-04T23:36:03.069+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:34:00+00:00, run_id=scheduled__2024-04-04T23:34:00+00:00, run_start_date=2024-04-04 23:36:00.801807+00:00, run_end_date=2024-04-04 23:36:03.069304+00:00, run_duration=2.267497, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:34:00+00:00, data_interval_end=2024-04-04 23:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:36:03.079383014Z [2024-04-04T23:36:03.079+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:36:00+00:00, run_after=2024-04-04T23:38:00+00:00 2024-04-04T23:36:03.139472623Z [2024-04-04T23:36:03.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:35:00+00:00 exited with status success for try_number 1 2024-04-04T23:36:03.145718224Z [2024-04-04T23:36:03.145+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:35:00+00:00, map_index=-1, run_start_date=2024-04-04 23:36:02.122514+00:00, run_end_date=2024-04-04 23:36:02.729565+00:00, run_duration=0.607051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=308, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:36:00.885861+00:00, queued_by_job_id=1, pid=4565 2024-04-04T23:36:04.016802773Z [2024-04-04T23:36:04.016+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:34:00+00:00 exited with status success for try_number 1 2024-04-04T23:36:04.028246140Z [2024-04-04T23:36:04.027+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:34:00+00:00, map_index=-1, run_start_date=2024-04-04 23:36:02.584568+00:00, run_end_date=2024-04-04 23:36:02.980493+00:00, run_duration=0.395925, state=success, executor_state=success, try_number=1, max_tries=1, job_id=309, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:36:00.885861+00:00, queued_by_job_id=1, pid=4570 2024-04-04T23:36:06.210617731Z [2024-04-04T23:36:06.210+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:36:06.211005813Z [2024-04-04T23:36:06.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:35:00+00:00, run_id=scheduled__2024-04-04T23:35:00+00:00, run_start_date=2024-04-04 23:36:00.804993+00:00, run_end_date=2024-04-04 23:36:06.210483+00:00, run_duration=5.40549, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:35:00+00:00, data_interval_end=2024-04-04 23:36:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:36:06.220393513Z [2024-04-04T23:36:06.220+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:36:00+00:00, run_after=2024-04-04T23:37:00+00:00 2024-04-04T23:36:06.230373443Z [2024-04-04T23:36:06.229+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:36:06.230475820Z [2024-04-04T23:36:06.230+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:35:00+00:00, run_id=scheduled__2024-04-04T23:35:00+00:00, run_start_date=2024-04-04 23:36:00.806209+00:00, run_end_date=2024-04-04 23:36:06.230122+00:00, run_duration=5.423913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:35:00+00:00, data_interval_end=2024-04-04 23:36:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:36:06.240634971Z [2024-04-04T23:36:06.240+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:36:00+00:00, run_after=2024-04-04T23:37:00+00:00 2024-04-04T23:36:06.298707147Z [2024-04-04T23:36:06.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:35:00+00:00 exited with status success for try_number 1 2024-04-04T23:36:06.299066145Z [2024-04-04T23:36:06.298+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:35:00+00:00 exited with status success for try_number 1 2024-04-04T23:36:06.311120923Z [2024-04-04T23:36:06.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:35:00+00:00, map_index=-1, run_start_date=2024-04-04 23:36:03.721358+00:00, run_end_date=2024-04-04 23:36:05.621938+00:00, run_duration=1.90058, state=success, executor_state=success, try_number=1, max_tries=1, job_id=310, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:36:00.885861+00:00, queued_by_job_id=1, pid=4589 2024-04-04T23:36:06.311314939Z [2024-04-04T23:36:06.311+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:35:00+00:00, map_index=-1, run_start_date=2024-04-04 23:36:03.769357+00:00, run_end_date=2024-04-04 23:36:05.350726+00:00, run_duration=1.581369, state=success, executor_state=success, try_number=1, max_tries=1, job_id=311, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:36:00.885861+00:00, queued_by_job_id=1, pid=4590 2024-04-04T23:37:00.088724982Z [2024-04-04T23:37:00.088+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:37:00.113765001Z [2024-04-04T23:37:00.111+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:37:00+00:00, run_after=2024-04-04T23:38:00+00:00 2024-04-04T23:37:00.130526831Z [2024-04-04T23:37:00.130+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:37:00+00:00, run_after=2024-04-04T23:38:00+00:00 2024-04-04T23:37:00.224690149Z [2024-04-04T23:37:00.224+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:37:00.224716835Z 2024-04-04T23:37:00.224720982Z 2024-04-04T23:37:00.224750446Z 2024-04-04T23:37:00.225451221Z [2024-04-04T23:37:00.224+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:37:00.225712935Z [2024-04-04T23:37:00.225+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:37:00.225937160Z [2024-04-04T23:37:00.225+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:37:00.226604659Z [2024-04-04T23:37:00.226+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:37:00.226615310Z 2024-04-04T23:37:00.226618930Z 2024-04-04T23:37:00.226622379Z 2024-04-04T23:37:00.229842870Z [2024-04-04T23:37:00.229+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:37:00.230053617Z [2024-04-04T23:37:00.229+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:37:00.230390202Z [2024-04-04T23:37:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:37:00.230584719Z [2024-04-04T23:37:00.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:37:00.230874182Z [2024-04-04T23:37:00.230+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:37:00.231063844Z [2024-04-04T23:37:00.230+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:37:00.672807980Z [2024-04-04T23:37:00.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:36:00+00:00 exited with status queued for try_number 1 2024-04-04T23:37:00.672884843Z [2024-04-04T23:37:00.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:36:00+00:00 exited with status queued for try_number 1 2024-04-04T23:37:00.672902845Z [2024-04-04T23:37:00.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:36:00+00:00 exited with status queued for try_number 1 2024-04-04T23:37:00.696873271Z [2024-04-04T23:37:00.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88c484ba-3e01-4706-804c-7ffbb3c9eb93 2024-04-04T23:37:00.697189246Z [2024-04-04T23:37:00.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a008633-d2ab-404d-8228-2441b1281cb2 2024-04-04T23:37:00.699948814Z [2024-04-04T23:37:00.699+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5d9f115-6c6d-47ad-b6dd-6fc85a698f14 2024-04-04T23:37:03.122962269Z [2024-04-04T23:37:03.122+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:37:03.123231428Z [2024-04-04T23:37:03.123+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:36:00+00:00, run_id=scheduled__2024-04-04T23:36:00+00:00, run_start_date=2024-04-04 23:37:00.143669+00:00, run_end_date=2024-04-04 23:37:03.122858+00:00, run_duration=2.979189, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:36:00+00:00, data_interval_end=2024-04-04 23:37:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:37:03.134803274Z [2024-04-04T23:37:03.134+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:37:00+00:00, run_after=2024-04-04T23:38:00+00:00 2024-04-04T23:37:03.187329373Z [2024-04-04T23:37:03.186+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:36:00+00:00 exited with status success for try_number 1 2024-04-04T23:37:03.196127810Z [2024-04-04T23:37:03.195+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:36:00+00:00, map_index=-1, run_start_date=2024-04-04 23:37:01.685402+00:00, run_end_date=2024-04-04 23:37:02.178392+00:00, run_duration=0.49299, state=success, executor_state=success, try_number=1, max_tries=1, job_id=312, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:37:00.227384+00:00, queued_by_job_id=1, pid=4623 2024-04-04T23:37:04.242144771Z [2024-04-04T23:37:04.241+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:37:04.242452463Z [2024-04-04T23:37:04.242+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:36:00+00:00, run_id=scheduled__2024-04-04T23:36:00+00:00, run_start_date=2024-04-04 23:37:00.144903+00:00, run_end_date=2024-04-04 23:37:04.241925+00:00, run_duration=4.097022, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:36:00+00:00, data_interval_end=2024-04-04 23:37:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:37:04.253965508Z [2024-04-04T23:37:04.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:37:00+00:00, run_after=2024-04-04T23:38:00+00:00 2024-04-04T23:37:04.310981721Z [2024-04-04T23:37:04.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:36:00+00:00 exited with status success for try_number 1 2024-04-04T23:37:04.319393046Z [2024-04-04T23:37:04.318+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:36:00+00:00, map_index=-1, run_start_date=2024-04-04 23:37:02.657070+00:00, run_end_date=2024-04-04 23:37:03.936817+00:00, run_duration=1.279747, state=success, executor_state=success, try_number=1, max_tries=1, job_id=313, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:37:00.227384+00:00, queued_by_job_id=1, pid=4635 2024-04-04T23:37:04.854807636Z [2024-04-04T23:37:04.854+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:37:04.855250983Z [2024-04-04T23:37:04.854+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:36:00+00:00, run_id=scheduled__2024-04-04T23:36:00+00:00, run_start_date=2024-04-04 23:37:00.146442+00:00, run_end_date=2024-04-04 23:37:04.854654+00:00, run_duration=4.708212, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:36:00+00:00, data_interval_end=2024-04-04 23:37:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:37:04.865704612Z [2024-04-04T23:37:04.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:37:00+00:00, run_after=2024-04-04T23:38:00+00:00 2024-04-04T23:37:06.031348490Z [2024-04-04T23:37:06.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:36:00+00:00 exited with status success for try_number 1 2024-04-04T23:37:06.036971584Z [2024-04-04T23:37:06.036+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:36:00+00:00, map_index=-1, run_start_date=2024-04-04 23:37:03.034818+00:00, run_end_date=2024-04-04 23:37:04.830401+00:00, run_duration=1.795583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=314, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:37:00.227384+00:00, queued_by_job_id=1, pid=4646 2024-04-04T23:38:00.519318131Z [2024-04-04T23:38:00.518+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:38:00+00:00, run_after=2024-04-04T23:39:00+00:00 2024-04-04T23:38:00.526479017Z [2024-04-04T23:38:00.526+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:38:00.539709101Z [2024-04-04T23:38:00.539+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:38:00+00:00, run_after=2024-04-04T23:39:00+00:00 2024-04-04T23:38:00.549049747Z [2024-04-04T23:38:00.548+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:38:00.629407985Z [2024-04-04T23:38:00.628+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:38:00.629440546Z 2024-04-04T23:38:00.629447269Z 2024-04-04T23:38:00.629452492Z 2024-04-04T23:38:00.629457659Z 2024-04-04T23:38:00.629750273Z [2024-04-04T23:38:00.629+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:38:00.630031378Z [2024-04-04T23:38:00.629+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:38:00.630279595Z [2024-04-04T23:38:00.630+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:38:00.630513395Z [2024-04-04T23:38:00.630+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:38:00.631272648Z [2024-04-04T23:38:00.631+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:38:00.631305751Z 2024-04-04T23:38:00.631312077Z 2024-04-04T23:38:00.631316959Z 2024-04-04T23:38:00.631321725Z 2024-04-04T23:38:00.636135280Z [2024-04-04T23:38:00.635+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:38:00.636498670Z [2024-04-04T23:38:00.636+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:38:00.636940524Z [2024-04-04T23:38:00.636+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:38:00.637198524Z [2024-04-04T23:38:00.636+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:38:00.637665799Z [2024-04-04T23:38:00.637+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:38:00.637909897Z [2024-04-04T23:38:00.637+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:38:00.638387657Z [2024-04-04T23:38:00.638+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:38:00.639159862Z [2024-04-04T23:38:00.638+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:38:01.108097781Z [2024-04-04T23:38:01.107+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:36:00+00:00 exited with status queued for try_number 1 2024-04-04T23:38:01.108268636Z [2024-04-04T23:38:01.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:37:00+00:00 exited with status queued for try_number 1 2024-04-04T23:38:01.108447835Z [2024-04-04T23:38:01.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:37:00+00:00 exited with status queued for try_number 1 2024-04-04T23:38:01.108619793Z [2024-04-04T23:38:01.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:37:00+00:00 exited with status queued for try_number 1 2024-04-04T23:38:01.125120467Z [2024-04-04T23:38:01.124+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8931618-fbc0-4774-9c1a-5dba73c63350 2024-04-04T23:38:01.125617765Z [2024-04-04T23:38:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0868633-9904-4d70-acdb-c68a15f179bc 2024-04-04T23:38:01.125847933Z [2024-04-04T23:38:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62664178-2097-4ddc-a6a6-10e6c24d6643 2024-04-04T23:38:01.126042402Z [2024-04-04T23:38:01.125+0000] {scheduler_job.py:635} INFO - Setting external_id for to ebc48b4d-840e-4cca-bfaa-c4c89609e99e 2024-04-04T23:38:03.797567316Z [2024-04-04T23:38:03.796+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:38:03.798285036Z [2024-04-04T23:38:03.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:36:00+00:00, run_id=scheduled__2024-04-04T23:36:00+00:00, run_start_date=2024-04-04 23:38:00.564724+00:00, run_end_date=2024-04-04 23:38:03.797824+00:00, run_duration=3.2331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:36:00+00:00, data_interval_end=2024-04-04 23:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:38:03.839443445Z [2024-04-04T23:38:03.839+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:38:00+00:00, run_after=2024-04-04T23:40:00+00:00 2024-04-04T23:38:03.852614928Z [2024-04-04T23:38:03.849+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:38:03.852895031Z [2024-04-04T23:38:03.852+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:37:00+00:00, run_id=scheduled__2024-04-04T23:37:00+00:00, run_start_date=2024-04-04 23:38:00.566366+00:00, run_end_date=2024-04-04 23:38:03.852436+00:00, run_duration=3.28607, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:37:00+00:00, data_interval_end=2024-04-04 23:38:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:38:03.865693344Z [2024-04-04T23:38:03.865+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:38:00+00:00, run_after=2024-04-04T23:39:00+00:00 2024-04-04T23:38:03.943825900Z [2024-04-04T23:38:03.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:36:00+00:00 exited with status success for try_number 1 2024-04-04T23:38:03.944094050Z [2024-04-04T23:38:03.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:37:00+00:00 exited with status success for try_number 1 2024-04-04T23:38:03.952505082Z [2024-04-04T23:38:03.952+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:36:00+00:00, map_index=-1, run_start_date=2024-04-04 23:38:02.171374+00:00, run_end_date=2024-04-04 23:38:02.752545+00:00, run_duration=0.581171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=315, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:38:00.632715+00:00, queued_by_job_id=1, pid=4674 2024-04-04T23:38:03.952951792Z [2024-04-04T23:38:03.952+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:37:00+00:00, map_index=-1, run_start_date=2024-04-04 23:38:02.272358+00:00, run_end_date=2024-04-04 23:38:02.893622+00:00, run_duration=0.621264, state=success, executor_state=success, try_number=1, max_tries=1, job_id=316, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:38:00.632715+00:00, queued_by_job_id=1, pid=4675 2024-04-04T23:38:04.996399342Z [2024-04-04T23:38:04.996+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:38:04.996621801Z [2024-04-04T23:38:04.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:37:00+00:00, run_id=scheduled__2024-04-04T23:37:00+00:00, run_start_date=2024-04-04 23:38:00.568707+00:00, run_end_date=2024-04-04 23:38:04.996304+00:00, run_duration=4.427597, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:37:00+00:00, data_interval_end=2024-04-04 23:38:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:38:05.005893985Z [2024-04-04T23:38:05.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:38:00+00:00, run_after=2024-04-04T23:39:00+00:00 2024-04-04T23:38:06.091392921Z [2024-04-04T23:38:06.091+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:38:06.091758598Z [2024-04-04T23:38:06.091+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:37:00+00:00, run_id=scheduled__2024-04-04T23:37:00+00:00, run_start_date=2024-04-04 23:38:00.567577+00:00, run_end_date=2024-04-04 23:38:06.091315+00:00, run_duration=5.523738, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:37:00+00:00, data_interval_end=2024-04-04 23:38:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:38:06.100980965Z [2024-04-04T23:38:06.100+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:38:00+00:00, run_after=2024-04-04T23:39:00+00:00 2024-04-04T23:38:06.126889851Z [2024-04-04T23:38:06.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:37:00+00:00 exited with status success for try_number 1 2024-04-04T23:38:06.127063778Z [2024-04-04T23:38:06.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:37:00+00:00 exited with status success for try_number 1 2024-04-04T23:38:06.132998900Z [2024-04-04T23:38:06.132+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:37:00+00:00, map_index=-1, run_start_date=2024-04-04 23:38:03.206243+00:00, run_end_date=2024-04-04 23:38:04.956330+00:00, run_duration=1.750087, state=success, executor_state=success, try_number=1, max_tries=1, job_id=317, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:38:00.632715+00:00, queued_by_job_id=1, pid=4693 2024-04-04T23:38:06.133281679Z [2024-04-04T23:38:06.133+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:37:00+00:00, map_index=-1, run_start_date=2024-04-04 23:38:03.809924+00:00, run_end_date=2024-04-04 23:38:05.495765+00:00, run_duration=1.685841, state=success, executor_state=success, try_number=1, max_tries=1, job_id=318, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:38:00.632715+00:00, queued_by_job_id=1, pid=4704 2024-04-04T23:39:00.749459987Z [2024-04-04T23:39:00.749+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:39:00+00:00, run_after=2024-04-04T23:40:00+00:00 2024-04-04T23:39:00.768622513Z [2024-04-04T23:39:00.767+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:39:00+00:00, run_after=2024-04-04T23:40:00+00:00 2024-04-04T23:39:00.778448113Z [2024-04-04T23:39:00.778+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:39:00.861623286Z [2024-04-04T23:39:00.861+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:39:00.861654577Z 2024-04-04T23:39:00.861660319Z 2024-04-04T23:39:00.861665249Z 2024-04-04T23:39:00.861797528Z [2024-04-04T23:39:00.861+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:39:00.862101153Z [2024-04-04T23:39:00.861+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:39:00.862239328Z [2024-04-04T23:39:00.862+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:39:00.862873637Z [2024-04-04T23:39:00.862+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:39:00.862886456Z 2024-04-04T23:39:00.862891516Z 2024-04-04T23:39:00.862941675Z 2024-04-04T23:39:00.867667257Z [2024-04-04T23:39:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:39:00.867723064Z [2024-04-04T23:39:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:39:00.867922332Z [2024-04-04T23:39:00.867+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:39:00.867986276Z [2024-04-04T23:39:00.867+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:39:00.868219597Z [2024-04-04T23:39:00.868+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:39:00.868296894Z [2024-04-04T23:39:00.868+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:39:01.290018755Z [2024-04-04T23:39:01.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:38:00+00:00 exited with status queued for try_number 1 2024-04-04T23:39:01.290114925Z [2024-04-04T23:39:01.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:38:00+00:00 exited with status queued for try_number 1 2024-04-04T23:39:01.290242485Z [2024-04-04T23:39:01.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:38:00+00:00 exited with status queued for try_number 1 2024-04-04T23:39:01.310857511Z [2024-04-04T23:39:01.310+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45998dab-625b-473f-a72b-c1f8c4010135 2024-04-04T23:39:01.312763933Z [2024-04-04T23:39:01.312+0000] {scheduler_job.py:635} INFO - Setting external_id for to fdb877c7-a43b-4194-aa63-0eced39fb985 2024-04-04T23:39:01.312938651Z [2024-04-04T23:39:01.312+0000] {scheduler_job.py:635} INFO - Setting external_id for to 38a57d55-19b8-4ad0-b7a5-0c31d06259e0 2024-04-04T23:39:02.819125382Z [2024-04-04T23:39:02.818+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:39:02.819869422Z [2024-04-04T23:39:02.819+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:38:00+00:00, run_id=scheduled__2024-04-04T23:38:00+00:00, run_start_date=2024-04-04 23:39:00.793988+00:00, run_end_date=2024-04-04 23:39:02.819265+00:00, run_duration=2.025277, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:38:00+00:00, data_interval_end=2024-04-04 23:39:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:39:02.841411680Z [2024-04-04T23:39:02.840+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:39:00+00:00, run_after=2024-04-04T23:40:00+00:00 2024-04-04T23:39:02.892221341Z [2024-04-04T23:39:02.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:38:00+00:00 exited with status success for try_number 1 2024-04-04T23:39:02.900267874Z [2024-04-04T23:39:02.899+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:38:00+00:00, map_index=-1, run_start_date=2024-04-04 23:39:02.082142+00:00, run_end_date=2024-04-04 23:39:02.521516+00:00, run_duration=0.439374, state=success, executor_state=success, try_number=1, max_tries=1, job_id=319, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:39:00.863978+00:00, queued_by_job_id=1, pid=4732 2024-04-04T23:39:05.056694508Z [2024-04-04T23:39:05.056+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:39:05.057125863Z [2024-04-04T23:39:05.056+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:38:00+00:00, run_id=scheduled__2024-04-04T23:38:00+00:00, run_start_date=2024-04-04 23:39:00.795436+00:00, run_end_date=2024-04-04 23:39:05.056570+00:00, run_duration=4.261134, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:38:00+00:00, data_interval_end=2024-04-04 23:39:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:39:05.067208778Z [2024-04-04T23:39:05.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:39:00+00:00, run_after=2024-04-04T23:40:00+00:00 2024-04-04T23:39:05.075991588Z [2024-04-04T23:39:05.075+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:39:05.076493631Z [2024-04-04T23:39:05.076+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:38:00+00:00, run_id=scheduled__2024-04-04T23:38:00+00:00, run_start_date=2024-04-04 23:39:00.796849+00:00, run_end_date=2024-04-04 23:39:05.075946+00:00, run_duration=4.279097, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:38:00+00:00, data_interval_end=2024-04-04 23:39:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:39:05.094865471Z [2024-04-04T23:39:05.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:39:00+00:00, run_after=2024-04-04T23:40:00+00:00 2024-04-04T23:39:05.138063231Z [2024-04-04T23:39:05.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:38:00+00:00 exited with status success for try_number 1 2024-04-04T23:39:05.138116632Z [2024-04-04T23:39:05.137+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:38:00+00:00 exited with status success for try_number 1 2024-04-04T23:39:05.144353921Z [2024-04-04T23:39:05.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:38:00+00:00, map_index=-1, run_start_date=2024-04-04 23:39:03.197643+00:00, run_end_date=2024-04-04 23:39:04.433965+00:00, run_duration=1.236322, state=success, executor_state=success, try_number=1, max_tries=1, job_id=320, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:39:00.863978+00:00, queued_by_job_id=1, pid=4750 2024-04-04T23:39:05.144523022Z [2024-04-04T23:39:05.144+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:38:00+00:00, map_index=-1, run_start_date=2024-04-04 23:39:03.288539+00:00, run_end_date=2024-04-04 23:39:04.859355+00:00, run_duration=1.570816, state=success, executor_state=success, try_number=1, max_tries=1, job_id=321, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:39:00.863978+00:00, queued_by_job_id=1, pid=4751 2024-04-04T23:40:00.974106253Z [2024-04-04T23:40:00.973+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:40:00+00:00, run_after=2024-04-04T23:41:00+00:00 2024-04-04T23:40:00.983362546Z [2024-04-04T23:40:00.982+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:40:01.006240905Z [2024-04-04T23:40:01.000+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:40:00+00:00, run_after=2024-04-04T23:45:00+00:00 2024-04-04T23:40:01.015688663Z [2024-04-04T23:40:01.015+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:40:01.029919533Z [2024-04-04T23:40:01.029+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:40:00+00:00, run_after=2024-04-04T23:41:00+00:00 2024-04-04T23:40:01.142889747Z [2024-04-04T23:40:01.142+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-04T23:40:01.142913477Z 2024-04-04T23:40:01.142917566Z 2024-04-04T23:40:01.142921573Z 2024-04-04T23:40:01.142924803Z 2024-04-04T23:40:01.142944439Z 2024-04-04T23:40:01.143167045Z [2024-04-04T23:40:01.142+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:40:01.143442804Z [2024-04-04T23:40:01.143+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:40:01.143694238Z [2024-04-04T23:40:01.143+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:40:01.144016609Z [2024-04-04T23:40:01.143+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:40:01.144225016Z [2024-04-04T23:40:01.144+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:40:01.148491160Z [2024-04-04T23:40:01.147+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:40:01.148507175Z 2024-04-04T23:40:01.148510953Z 2024-04-04T23:40:01.148514519Z 2024-04-04T23:40:01.148517793Z 2024-04-04T23:40:01.148529520Z 2024-04-04T23:40:01.153321493Z [2024-04-04T23:40:01.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T23:40:01.153395251Z [2024-04-04T23:40:01.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:40:01.155655559Z [2024-04-04T23:40:01.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:40:01.155673778Z [2024-04-04T23:40:01.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:40:01.155678060Z [2024-04-04T23:40:01.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:40:01.155681632Z [2024-04-04T23:40:01.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:40:01.155696585Z [2024-04-04T23:40:01.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:40:01.155699823Z [2024-04-04T23:40:01.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:40:01.155702835Z [2024-04-04T23:40:01.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:40:01.155705905Z [2024-04-04T23:40:01.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:40:02.031119159Z [2024-04-04T23:40:02.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:35:00+00:00 exited with status queued for try_number 1 2024-04-04T23:40:02.031180688Z [2024-04-04T23:40:02.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:38:00+00:00 exited with status queued for try_number 1 2024-04-04T23:40:02.031190998Z [2024-04-04T23:40:02.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:39:00+00:00 exited with status queued for try_number 1 2024-04-04T23:40:02.031196000Z [2024-04-04T23:40:02.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:39:00+00:00 exited with status queued for try_number 1 2024-04-04T23:40:02.031201227Z [2024-04-04T23:40:02.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:39:00+00:00 exited with status queued for try_number 1 2024-04-04T23:40:02.061853163Z [2024-04-04T23:40:02.059+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5be2b17d-7d32-4ccb-9926-491960db689e 2024-04-04T23:40:02.061884334Z [2024-04-04T23:40:02.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9209721b-039e-411d-b1b5-ecaf67a57d3c 2024-04-04T23:40:02.062092785Z [2024-04-04T23:40:02.061+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f71d42c-8c76-4077-9b4e-86c95af1a606 2024-04-04T23:40:02.064398887Z [2024-04-04T23:40:02.064+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f371d90-c7d5-420f-b6fb-01f509a31e94 2024-04-04T23:40:02.064575898Z [2024-04-04T23:40:02.064+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d27d579-80f5-42dc-ae01-64ccc8a8466e 2024-04-04T23:40:03.667473375Z [2024-04-04T23:40:03.666+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:40:03.669917030Z [2024-04-04T23:40:03.669+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:38:00+00:00, run_id=scheduled__2024-04-04T23:38:00+00:00, run_start_date=2024-04-04 23:40:01.045648+00:00, run_end_date=2024-04-04 23:40:03.669070+00:00, run_duration=2.623422, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:38:00+00:00, data_interval_end=2024-04-04 23:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:40:03.692053107Z [2024-04-04T23:40:03.691+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:40:00+00:00, run_after=2024-04-04T23:42:00+00:00 2024-04-04T23:40:03.706122928Z [2024-04-04T23:40:03.705+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:40:03.706850369Z [2024-04-04T23:40:03.706+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:39:00+00:00, run_id=scheduled__2024-04-04T23:39:00+00:00, run_start_date=2024-04-04 23:40:01.047539+00:00, run_end_date=2024-04-04 23:40:03.706029+00:00, run_duration=2.65849, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:39:00+00:00, data_interval_end=2024-04-04 23:40:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:40:03.735141625Z [2024-04-04T23:40:03.734+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:40:00+00:00, run_after=2024-04-04T23:41:00+00:00 2024-04-04T23:40:03.884860974Z [2024-04-04T23:40:03.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:38:00+00:00 exited with status success for try_number 1 2024-04-04T23:40:03.884955601Z [2024-04-04T23:40:03.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:39:00+00:00 exited with status success for try_number 1 2024-04-04T23:40:03.895215388Z [2024-04-04T23:40:03.894+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:39:00+00:00, map_index=-1, run_start_date=2024-04-04 23:40:02.905823+00:00, run_end_date=2024-04-04 23:40:03.418870+00:00, run_duration=0.513047, state=success, executor_state=success, try_number=1, max_tries=1, job_id=322, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:40:01.149681+00:00, queued_by_job_id=1, pid=4786 2024-04-04T23:40:03.895466163Z [2024-04-04T23:40:03.895+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:38:00+00:00, map_index=-1, run_start_date=2024-04-04 23:40:03.029992+00:00, run_end_date=2024-04-04 23:40:03.634444+00:00, run_duration=0.604452, state=success, executor_state=success, try_number=1, max_tries=1, job_id=323, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:40:01.149681+00:00, queued_by_job_id=1, pid=4787 2024-04-04T23:40:05.005189500Z [2024-04-04T23:40:05.004+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:40:05.005214359Z 2024-04-04T23:40:05.005446702Z [2024-04-04T23:40:05.005+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:40:05.008354815Z [2024-04-04T23:40:05.008+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:40:05.008374982Z 2024-04-04T23:40:05.011463682Z [2024-04-04T23:40:05.011+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-04T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T23:40:05.011834310Z [2024-04-04T23:40:05.011+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-04T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:40:05.093859125Z [2024-04-04T23:40:05.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:35:00+00:00 exited with status queued for try_number 1 2024-04-04T23:40:05.094459681Z [2024-04-04T23:40:05.093+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:35:00+00:00 exited with status success for try_number 1 2024-04-04T23:40:05.106190842Z [2024-04-04T23:40:05.105+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f240f49-496b-40f0-a581-90aa632d1337 2024-04-04T23:40:05.106580324Z [2024-04-04T23:40:05.106+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T23:35:00+00:00, map_index=-1, run_start_date=2024-04-04 23:40:04.424649+00:00, run_end_date=2024-04-04 23:40:04.839583+00:00, run_duration=0.414934, state=success, executor_state=success, try_number=1, max_tries=1, job_id=324, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:40:01.149681+00:00, queued_by_job_id=1, pid=4806 2024-04-04T23:40:06.333610121Z [2024-04-04T23:40:06.333+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:40:06.333801765Z [2024-04-04T23:40:06.333+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:39:00+00:00, run_id=scheduled__2024-04-04T23:39:00+00:00, run_start_date=2024-04-04 23:40:01.048807+00:00, run_end_date=2024-04-04 23:40:06.333558+00:00, run_duration=5.284751, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:39:00+00:00, data_interval_end=2024-04-04 23:40:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:40:06.343023076Z [2024-04-04T23:40:06.342+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:40:00+00:00, run_after=2024-04-04T23:41:00+00:00 2024-04-04T23:40:06.404450885Z [2024-04-04T23:40:06.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:39:00+00:00 exited with status success for try_number 1 2024-04-04T23:40:06.411766740Z [2024-04-04T23:40:06.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:39:00+00:00, map_index=-1, run_start_date=2024-04-04 23:40:04.905070+00:00, run_end_date=2024-04-04 23:40:06.195504+00:00, run_duration=1.290434, state=success, executor_state=success, try_number=1, max_tries=1, job_id=326, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:40:01.149681+00:00, queued_by_job_id=1, pid=4823 2024-04-04T23:40:07.461890021Z [2024-04-04T23:40:07.459+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:40:07.461948802Z [2024-04-04T23:40:07.460+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:39:00+00:00, run_id=scheduled__2024-04-04T23:39:00+00:00, run_start_date=2024-04-04 23:40:01.049945+00:00, run_end_date=2024-04-04 23:40:07.459803+00:00, run_duration=6.409858, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:39:00+00:00, data_interval_end=2024-04-04 23:40:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:40:07.478228375Z [2024-04-04T23:40:07.477+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:40:00+00:00, run_after=2024-04-04T23:41:00+00:00 2024-04-04T23:40:07.518056279Z [2024-04-04T23:40:07.517+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:40:07.518090170Z 2024-04-04T23:40:07.518389705Z [2024-04-04T23:40:07.518+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:40:07.519405307Z [2024-04-04T23:40:07.519+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:40:07.519419932Z 2024-04-04T23:40:07.522486560Z [2024-04-04T23:40:07.522+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-04T23:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T23:40:07.522907592Z [2024-04-04T23:40:07.522+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-04T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T23:40:07.577262452Z [2024-04-04T23:40:07.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:35:00+00:00 exited with status queued for try_number 1 2024-04-04T23:40:07.577561056Z [2024-04-04T23:40:07.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:39:00+00:00 exited with status success for try_number 1 2024-04-04T23:40:07.578204267Z [2024-04-04T23:40:07.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:35:00+00:00 exited with status success for try_number 1 2024-04-04T23:40:07.589845143Z [2024-04-04T23:40:07.589+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:39:00+00:00, map_index=-1, run_start_date=2024-04-04 23:40:04.810665+00:00, run_end_date=2024-04-04 23:40:06.508836+00:00, run_duration=1.698171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=325, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:40:01.149681+00:00, queued_by_job_id=1, pid=4822 2024-04-04T23:40:07.590166576Z [2024-04-04T23:40:07.589+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-04T23:35:00+00:00, map_index=-1, run_start_date=2024-04-04 23:40:06.866588+00:00, run_end_date=2024-04-04 23:40:07.228842+00:00, run_duration=0.362254, state=success, executor_state=success, try_number=1, max_tries=1, job_id=327, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:40:05.008870+00:00, queued_by_job_id=1, pid=4841 2024-04-04T23:40:07.590430395Z [2024-04-04T23:40:07.590+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1e34e0a-9b09-472a-9ed8-82c79281a0c6 2024-04-04T23:40:09.860707556Z [2024-04-04T23:40:09.860+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:40:09.860734377Z 2024-04-04T23:40:09.861235241Z [2024-04-04T23:40:09.860+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:40:09.861977317Z [2024-04-04T23:40:09.861+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:40:09.861989092Z 2024-04-04T23:40:09.864722321Z [2024-04-04T23:40:09.864+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-04T23:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:40:09.865064736Z [2024-04-04T23:40:09.864+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-04T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:40:09.933594527Z [2024-04-04T23:40:09.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:35:00+00:00 exited with status queued for try_number 1 2024-04-04T23:40:09.933696244Z [2024-04-04T23:40:09.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:35:00+00:00 exited with status success for try_number 1 2024-04-04T23:40:09.943113080Z [2024-04-04T23:40:09.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to bdd32276-be53-4833-b6e5-8ac981c16d7f 2024-04-04T23:40:09.943216761Z [2024-04-04T23:40:09.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-04T23:35:00+00:00, map_index=0, run_start_date=2024-04-04 23:40:09.073377+00:00, run_end_date=2024-04-04 23:40:09.447965+00:00, run_duration=0.374588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=328, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:40:07.519938+00:00, queued_by_job_id=1, pid=4849 2024-04-04T23:40:12.151218967Z [2024-04-04T23:40:12.149+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:40:12.151250686Z [2024-04-04T23:40:12.150+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:35:00+00:00, run_id=scheduled__2024-04-04T23:35:00+00:00, run_start_date=2024-04-04 23:40:01.042551+00:00, run_end_date=2024-04-04 23:40:12.150202+00:00, run_duration=11.107651, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:35:00+00:00, data_interval_end=2024-04-04 23:40:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-04T23:40:12.158306288Z [2024-04-04T23:40:12.157+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:40:00+00:00, run_after=2024-04-04T23:45:00+00:00 2024-04-04T23:40:12.682620995Z [2024-04-04T23:40:12.682+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:35:00+00:00 exited with status success for try_number 1 2024-04-04T23:40:12.688904318Z [2024-04-04T23:40:12.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-04T23:35:00+00:00, map_index=-1, run_start_date=2024-04-04 23:40:11.693782+00:00, run_end_date=2024-04-04 23:40:12.095367+00:00, run_duration=0.401585, state=success, executor_state=success, try_number=1, max_tries=1, job_id=329, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:40:09.862675+00:00, queued_by_job_id=1, pid=4870 2024-04-04T23:40:39.853969647Z [2024-04-04T23:40:39.853+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-04T23:41:00.121264730Z [2024-04-04T23:41:00.120+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:41:00.135438339Z [2024-04-04T23:41:00.135+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:41:00+00:00, run_after=2024-04-04T23:42:00+00:00 2024-04-04T23:41:00.148047519Z [2024-04-04T23:41:00.147+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:41:00+00:00, run_after=2024-04-04T23:42:00+00:00 2024-04-04T23:41:00.212513895Z [2024-04-04T23:41:00.212+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:41:00.212564226Z 2024-04-04T23:41:00.212568325Z 2024-04-04T23:41:00.212571598Z 2024-04-04T23:41:00.213132071Z [2024-04-04T23:41:00.212+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:41:00.214011255Z [2024-04-04T23:41:00.213+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:41:00.214285109Z [2024-04-04T23:41:00.214+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:41:00.214918084Z [2024-04-04T23:41:00.214+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:41:00.214928652Z 2024-04-04T23:41:00.214932127Z 2024-04-04T23:41:00.214935197Z 2024-04-04T23:41:00.218477711Z [2024-04-04T23:41:00.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:41:00.219712600Z [2024-04-04T23:41:00.219+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:41:00.220308751Z [2024-04-04T23:41:00.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:41:00.220514493Z [2024-04-04T23:41:00.220+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:41:00.220899324Z [2024-04-04T23:41:00.220+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:41:00.221913583Z [2024-04-04T23:41:00.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:41:00.667120276Z [2024-04-04T23:41:00.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:40:00+00:00 exited with status queued for try_number 1 2024-04-04T23:41:00.669351396Z [2024-04-04T23:41:00.666+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:40:00+00:00 exited with status queued for try_number 1 2024-04-04T23:41:00.669459512Z [2024-04-04T23:41:00.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:40:00+00:00 exited with status queued for try_number 1 2024-04-04T23:41:00.679543735Z [2024-04-04T23:41:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to fde20d92-5188-4a0a-8f09-37afffff98ca 2024-04-04T23:41:00.680363426Z [2024-04-04T23:41:00.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2eb77e2c-d6a7-49ec-91e9-eef3f781cf44 2024-04-04T23:41:00.680629770Z [2024-04-04T23:41:00.680+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d36ea32-d7b3-49b3-a500-4ddea78fb24a 2024-04-04T23:41:02.505880670Z [2024-04-04T23:41:02.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:41:02.506426981Z [2024-04-04T23:41:02.506+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:40:00+00:00, run_id=scheduled__2024-04-04T23:40:00+00:00, run_start_date=2024-04-04 23:41:00.158267+00:00, run_end_date=2024-04-04 23:41:02.505831+00:00, run_duration=2.347564, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:40:00+00:00, data_interval_end=2024-04-04 23:41:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:41:02.524574598Z [2024-04-04T23:41:02.524+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:41:00+00:00, run_after=2024-04-04T23:42:00+00:00 2024-04-04T23:41:02.597880094Z [2024-04-04T23:41:02.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:40:00+00:00 exited with status success for try_number 1 2024-04-04T23:41:02.618519770Z [2024-04-04T23:41:02.618+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:40:00+00:00, map_index=-1, run_start_date=2024-04-04 23:41:01.552490+00:00, run_end_date=2024-04-04 23:41:02.263203+00:00, run_duration=0.710713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=330, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:41:00.216148+00:00, queued_by_job_id=1, pid=4879 2024-04-04T23:41:05.516250022Z [2024-04-04T23:41:05.515+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:41:05.516675136Z [2024-04-04T23:41:05.516+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:40:00+00:00, run_id=scheduled__2024-04-04T23:40:00+00:00, run_start_date=2024-04-04 23:41:00.159487+00:00, run_end_date=2024-04-04 23:41:05.516147+00:00, run_duration=5.35666, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:40:00+00:00, data_interval_end=2024-04-04 23:41:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:41:05.526660514Z [2024-04-04T23:41:05.526+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:41:00+00:00, run_after=2024-04-04T23:42:00+00:00 2024-04-04T23:41:05.534613890Z [2024-04-04T23:41:05.534+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:41:05.534934840Z [2024-04-04T23:41:05.534+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:40:00+00:00, run_id=scheduled__2024-04-04T23:40:00+00:00, run_start_date=2024-04-04 23:41:00.160564+00:00, run_end_date=2024-04-04 23:41:05.534508+00:00, run_duration=5.373944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:40:00+00:00, data_interval_end=2024-04-04 23:41:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:41:05.544356841Z [2024-04-04T23:41:05.544+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:41:00+00:00, run_after=2024-04-04T23:42:00+00:00 2024-04-04T23:41:05.576718958Z [2024-04-04T23:41:05.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:40:00+00:00 exited with status success for try_number 1 2024-04-04T23:41:05.576988876Z [2024-04-04T23:41:05.576+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:40:00+00:00 exited with status success for try_number 1 2024-04-04T23:41:05.584299825Z [2024-04-04T23:41:05.583+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:40:00+00:00, map_index=-1, run_start_date=2024-04-04 23:41:03.472072+00:00, run_end_date=2024-04-04 23:41:05.171811+00:00, run_duration=1.699739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=332, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:41:00.216148+00:00, queued_by_job_id=1, pid=4903 2024-04-04T23:41:05.584621109Z [2024-04-04T23:41:05.584+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:40:00+00:00, map_index=-1, run_start_date=2024-04-04 23:41:03.025884+00:00, run_end_date=2024-04-04 23:41:05.290803+00:00, run_duration=2.264919, state=success, executor_state=success, try_number=1, max_tries=1, job_id=331, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:41:00.216148+00:00, queued_by_job_id=1, pid=4892 2024-04-04T23:42:00.360887840Z [2024-04-04T23:42:00.360+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:42:00.375699259Z [2024-04-04T23:42:00.375+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:42:00+00:00, run_after=2024-04-04T23:43:00+00:00 2024-04-04T23:42:00.383139491Z [2024-04-04T23:42:00.382+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:42:00.408557768Z [2024-04-04T23:42:00.408+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:42:00+00:00, run_after=2024-04-04T23:43:00+00:00 2024-04-04T23:42:00.509605200Z [2024-04-04T23:42:00.509+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:42:00.509633790Z 2024-04-04T23:42:00.509641657Z 2024-04-04T23:42:00.509645191Z 2024-04-04T23:42:00.509648492Z 2024-04-04T23:42:00.509789214Z [2024-04-04T23:42:00.509+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:42:00.509953165Z [2024-04-04T23:42:00.509+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:42:00.510107433Z [2024-04-04T23:42:00.509+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:42:00.510272773Z [2024-04-04T23:42:00.510+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:42:00.511097269Z [2024-04-04T23:42:00.510+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:42:00.511113203Z 2024-04-04T23:42:00.511119033Z 2024-04-04T23:42:00.511124351Z 2024-04-04T23:42:00.511129318Z 2024-04-04T23:42:00.515698519Z [2024-04-04T23:42:00.515+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:42:00.515803936Z [2024-04-04T23:42:00.515+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:42:00.516096595Z [2024-04-04T23:42:00.515+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:42:00.516202438Z [2024-04-04T23:42:00.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:42:00.516413304Z [2024-04-04T23:42:00.516+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:42:00.516633245Z [2024-04-04T23:42:00.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:42:00.516968233Z [2024-04-04T23:42:00.516+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:42:00.517163905Z [2024-04-04T23:42:00.516+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:42:01.037900366Z [2024-04-04T23:42:01.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:40:00+00:00 exited with status queued for try_number 1 2024-04-04T23:42:01.038219046Z [2024-04-04T23:42:01.037+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:41:00+00:00 exited with status queued for try_number 1 2024-04-04T23:42:01.038585705Z [2024-04-04T23:42:01.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:41:00+00:00 exited with status queued for try_number 1 2024-04-04T23:42:01.038922346Z [2024-04-04T23:42:01.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:41:00+00:00 exited with status queued for try_number 1 2024-04-04T23:42:01.058046146Z [2024-04-04T23:42:01.057+0000] {scheduler_job.py:635} INFO - Setting external_id for to e373a8fc-e59b-4936-8c52-80b5c50bf975 2024-04-04T23:42:01.058511864Z [2024-04-04T23:42:01.058+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51c820c6-f71b-41c1-a2c0-8ae49b78b391 2024-04-04T23:42:01.058822697Z [2024-04-04T23:42:01.058+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62395a3d-c733-4e40-9ea0-9a3b394f871c 2024-04-04T23:42:01.059206010Z [2024-04-04T23:42:01.058+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e1db117-cccd-4bed-90c9-618ffdd2e3ee 2024-04-04T23:42:02.987051128Z [2024-04-04T23:42:02.986+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:42:02.989122577Z [2024-04-04T23:42:02.987+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:41:00+00:00, run_id=scheduled__2024-04-04T23:41:00+00:00, run_start_date=2024-04-04 23:42:00.423351+00:00, run_end_date=2024-04-04 23:42:02.987162+00:00, run_duration=2.563811, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:41:00+00:00, data_interval_end=2024-04-04 23:42:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:42:03.015983539Z [2024-04-04T23:42:03.015+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:42:00+00:00, run_after=2024-04-04T23:43:00+00:00 2024-04-04T23:42:03.105804121Z [2024-04-04T23:42:03.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:41:00+00:00 exited with status success for try_number 1 2024-04-04T23:42:03.114746788Z [2024-04-04T23:42:03.114+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:41:00+00:00, map_index=-1, run_start_date=2024-04-04 23:42:02.218426+00:00, run_end_date=2024-04-04 23:42:02.782734+00:00, run_duration=0.564308, state=success, executor_state=success, try_number=1, max_tries=1, job_id=333, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:42:00.512491+00:00, queued_by_job_id=1, pid=4931 2024-04-04T23:42:04.107363901Z [2024-04-04T23:42:04.106+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:42:04.107693841Z [2024-04-04T23:42:04.107+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:40:00+00:00, run_id=scheduled__2024-04-04T23:40:00+00:00, run_start_date=2024-04-04 23:42:00.419134+00:00, run_end_date=2024-04-04 23:42:04.107314+00:00, run_duration=3.68818, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:40:00+00:00, data_interval_end=2024-04-04 23:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:42:04.118733484Z [2024-04-04T23:42:04.117+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:42:00+00:00, run_after=2024-04-04T23:44:00+00:00 2024-04-04T23:42:04.194609344Z [2024-04-04T23:42:04.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:40:00+00:00 exited with status success for try_number 1 2024-04-04T23:42:04.200533277Z [2024-04-04T23:42:04.200+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:40:00+00:00, map_index=-1, run_start_date=2024-04-04 23:42:02.530039+00:00, run_end_date=2024-04-04 23:42:03.145188+00:00, run_duration=0.615149, state=success, executor_state=success, try_number=1, max_tries=1, job_id=334, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:42:00.512491+00:00, queued_by_job_id=1, pid=4932 2024-04-04T23:42:05.258062449Z [2024-04-04T23:42:05.257+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:42:05.258263980Z [2024-04-04T23:42:05.258+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:41:00+00:00, run_id=scheduled__2024-04-04T23:41:00+00:00, run_start_date=2024-04-04 23:42:00.426572+00:00, run_end_date=2024-04-04 23:42:05.257925+00:00, run_duration=4.831353, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:41:00+00:00, data_interval_end=2024-04-04 23:42:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:42:05.269570338Z [2024-04-04T23:42:05.269+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:42:00+00:00, run_after=2024-04-04T23:43:00+00:00 2024-04-04T23:42:05.310875593Z [2024-04-04T23:42:05.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:41:00+00:00 exited with status success for try_number 1 2024-04-04T23:42:05.316627071Z [2024-04-04T23:42:05.316+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:41:00+00:00, map_index=-1, run_start_date=2024-04-04 23:42:03.209220+00:00, run_end_date=2024-04-04 23:42:05.130250+00:00, run_duration=1.92103, state=success, executor_state=success, try_number=1, max_tries=1, job_id=335, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:42:00.512491+00:00, queued_by_job_id=1, pid=4949 2024-04-04T23:42:06.368652081Z [2024-04-04T23:42:06.368+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:42:06.369057101Z [2024-04-04T23:42:06.368+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:41:00+00:00, run_id=scheduled__2024-04-04T23:41:00+00:00, run_start_date=2024-04-04 23:42:00.425157+00:00, run_end_date=2024-04-04 23:42:06.368582+00:00, run_duration=5.943425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:41:00+00:00, data_interval_end=2024-04-04 23:42:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:42:06.383044056Z [2024-04-04T23:42:06.382+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:42:00+00:00, run_after=2024-04-04T23:43:00+00:00 2024-04-04T23:42:06.414433729Z [2024-04-04T23:42:06.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:41:00+00:00 exited with status success for try_number 1 2024-04-04T23:42:06.419676880Z [2024-04-04T23:42:06.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:41:00+00:00, map_index=-1, run_start_date=2024-04-04 23:42:03.719997+00:00, run_end_date=2024-04-04 23:42:06.213034+00:00, run_duration=2.493037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=336, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:42:00.512491+00:00, queued_by_job_id=1, pid=4960 2024-04-04T23:43:01.068477073Z [2024-04-04T23:43:01.067+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:43:01.094636087Z [2024-04-04T23:43:01.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:43:00+00:00, run_after=2024-04-04T23:44:00+00:00 2024-04-04T23:43:01.110393601Z [2024-04-04T23:43:01.110+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:43:00+00:00, run_after=2024-04-04T23:44:00+00:00 2024-04-04T23:43:01.187708167Z [2024-04-04T23:43:01.184+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:43:01.187733240Z 2024-04-04T23:43:01.187737389Z 2024-04-04T23:43:01.187740669Z 2024-04-04T23:43:01.187743914Z [2024-04-04T23:43:01.184+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:43:01.187746995Z [2024-04-04T23:43:01.184+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:43:01.187749998Z [2024-04-04T23:43:01.184+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:43:01.187753884Z [2024-04-04T23:43:01.185+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:43:01.187756981Z 2024-04-04T23:43:01.187759927Z 2024-04-04T23:43:01.187762990Z 2024-04-04T23:43:01.188553302Z [2024-04-04T23:43:01.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:43:01.188792215Z [2024-04-04T23:43:01.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:43:01.188851542Z [2024-04-04T23:43:01.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:43:01.188914005Z [2024-04-04T23:43:01.188+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:43:01.189059136Z [2024-04-04T23:43:01.188+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:43:01.189141520Z [2024-04-04T23:43:01.189+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:43:01.683414945Z [2024-04-04T23:43:01.680+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:42:00+00:00 exited with status queued for try_number 1 2024-04-04T23:43:01.683843054Z [2024-04-04T23:43:01.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:42:00+00:00 exited with status queued for try_number 1 2024-04-04T23:43:01.684098268Z [2024-04-04T23:43:01.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:42:00+00:00 exited with status queued for try_number 1 2024-04-04T23:43:01.703597018Z [2024-04-04T23:43:01.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to d309088f-75d3-4073-bd61-5128583a6659 2024-04-04T23:43:01.704032468Z [2024-04-04T23:43:01.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2797c70b-57d0-475f-83f7-54d35c7ce55c 2024-04-04T23:43:01.704298544Z [2024-04-04T23:43:01.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to a230ff47-b57d-4b35-8dca-792fdce96364 2024-04-04T23:43:03.045493413Z [2024-04-04T23:43:03.044+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:43:03.045962655Z [2024-04-04T23:43:03.045+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:42:00+00:00, run_id=scheduled__2024-04-04T23:42:00+00:00, run_start_date=2024-04-04 23:43:01.126463+00:00, run_end_date=2024-04-04 23:43:03.045394+00:00, run_duration=1.918931, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:42:00+00:00, data_interval_end=2024-04-04 23:43:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:43:03.064445380Z [2024-04-04T23:43:03.063+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:43:00+00:00, run_after=2024-04-04T23:44:00+00:00 2024-04-04T23:43:03.139225656Z [2024-04-04T23:43:03.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:42:00+00:00 exited with status success for try_number 1 2024-04-04T23:43:03.155745252Z [2024-04-04T23:43:03.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:42:00+00:00, map_index=-1, run_start_date=2024-04-04 23:43:02.283513+00:00, run_end_date=2024-04-04 23:43:02.723009+00:00, run_duration=0.439496, state=success, executor_state=success, try_number=1, max_tries=1, job_id=337, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:43:01.186110+00:00, queued_by_job_id=1, pid=4987 2024-04-04T23:43:06.210312025Z [2024-04-04T23:43:06.209+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:43:06.210538962Z [2024-04-04T23:43:06.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:42:00+00:00, run_id=scheduled__2024-04-04T23:42:00+00:00, run_start_date=2024-04-04 23:43:01.128468+00:00, run_end_date=2024-04-04 23:43:06.210232+00:00, run_duration=5.081764, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:42:00+00:00, data_interval_end=2024-04-04 23:43:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:43:06.222618659Z [2024-04-04T23:43:06.222+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:43:00+00:00, run_after=2024-04-04T23:44:00+00:00 2024-04-04T23:43:06.232751332Z [2024-04-04T23:43:06.232+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:43:06.233051393Z [2024-04-04T23:43:06.232+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:42:00+00:00, run_id=scheduled__2024-04-04T23:42:00+00:00, run_start_date=2024-04-04 23:43:01.130230+00:00, run_end_date=2024-04-04 23:43:06.232539+00:00, run_duration=5.102309, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:42:00+00:00, data_interval_end=2024-04-04 23:43:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:43:06.244782086Z [2024-04-04T23:43:06.244+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:43:00+00:00, run_after=2024-04-04T23:44:00+00:00 2024-04-04T23:43:06.284949800Z [2024-04-04T23:43:06.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:42:00+00:00 exited with status success for try_number 1 2024-04-04T23:43:06.284988419Z [2024-04-04T23:43:06.284+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:42:00+00:00 exited with status success for try_number 1 2024-04-04T23:43:06.298207982Z [2024-04-04T23:43:06.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:42:00+00:00, map_index=-1, run_start_date=2024-04-04 23:43:03.376759+00:00, run_end_date=2024-04-04 23:43:05.764623+00:00, run_duration=2.387864, state=success, executor_state=success, try_number=1, max_tries=1, job_id=339, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:43:01.186110+00:00, queued_by_job_id=1, pid=5006 2024-04-04T23:43:06.298336192Z [2024-04-04T23:43:06.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:42:00+00:00, map_index=-1, run_start_date=2024-04-04 23:43:03.350573+00:00, run_end_date=2024-04-04 23:43:05.500079+00:00, run_duration=2.149506, state=success, executor_state=success, try_number=1, max_tries=1, job_id=338, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:43:01.186110+00:00, queued_by_job_id=1, pid=5005 2024-04-04T23:44:00.787390376Z [2024-04-04T23:44:00.786+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:44:00.794598053Z [2024-04-04T23:44:00.794+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:44:00.819834824Z [2024-04-04T23:44:00.819+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:44:00+00:00, run_after=2024-04-04T23:45:00+00:00 2024-04-04T23:44:00.841868864Z [2024-04-04T23:44:00.841+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:44:00+00:00, run_after=2024-04-04T23:45:00+00:00 2024-04-04T23:44:00.986563001Z [2024-04-04T23:44:00.986+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:44:00.986622384Z 2024-04-04T23:44:00.986646337Z 2024-04-04T23:44:00.986652463Z 2024-04-04T23:44:00.986657002Z 2024-04-04T23:44:00.986663519Z [2024-04-04T23:44:00.986+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:44:00.988177441Z [2024-04-04T23:44:00.987+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:44:00.988369818Z [2024-04-04T23:44:00.988+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:44:00.988525557Z [2024-04-04T23:44:00.988+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:44:00.989330625Z [2024-04-04T23:44:00.989+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:44:00.989343232Z 2024-04-04T23:44:00.989367093Z 2024-04-04T23:44:00.989370505Z 2024-04-04T23:44:00.989376822Z 2024-04-04T23:44:00.994326624Z [2024-04-04T23:44:00.993+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:44:00.994610961Z [2024-04-04T23:44:00.994+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:44:00.994926124Z [2024-04-04T23:44:00.994+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:44:00.995080511Z [2024-04-04T23:44:00.994+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:44:00.995357084Z [2024-04-04T23:44:00.995+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:44:00.995527001Z [2024-04-04T23:44:00.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:44:00.995957054Z [2024-04-04T23:44:00.995+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:44:00.996139649Z [2024-04-04T23:44:00.995+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:44:01.446781674Z [2024-04-04T23:44:01.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:42:00+00:00 exited with status queued for try_number 1 2024-04-04T23:44:01.446946810Z [2024-04-04T23:44:01.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:43:00+00:00 exited with status queued for try_number 1 2024-04-04T23:44:01.447078186Z [2024-04-04T23:44:01.446+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:43:00+00:00 exited with status queued for try_number 1 2024-04-04T23:44:01.447228369Z [2024-04-04T23:44:01.447+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:43:00+00:00 exited with status queued for try_number 1 2024-04-04T23:44:01.460497287Z [2024-04-04T23:44:01.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06328253-a3ef-4fc6-b6bf-1716f00c2255 2024-04-04T23:44:01.460724516Z [2024-04-04T23:44:01.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed4365c4-c845-4313-b273-dea1cee85cbe 2024-04-04T23:44:01.460929904Z [2024-04-04T23:44:01.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to 754efe0c-5504-43ff-8cf2-c1660a83de39 2024-04-04T23:44:01.461174249Z [2024-04-04T23:44:01.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e0d2177-4591-423b-8e1c-222b6d8e0f0b 2024-04-04T23:44:02.848891155Z [2024-04-04T23:44:02.848+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:44:02.855115585Z [2024-04-04T23:44:02.852+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:42:00+00:00, run_id=scheduled__2024-04-04T23:42:00+00:00, run_start_date=2024-04-04 23:44:00.854738+00:00, run_end_date=2024-04-04 23:44:02.848976+00:00, run_duration=1.994238, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:42:00+00:00, data_interval_end=2024-04-04 23:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:44:02.871499527Z [2024-04-04T23:44:02.871+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:44:00+00:00, run_after=2024-04-04T23:46:00+00:00 2024-04-04T23:44:02.881942310Z [2024-04-04T23:44:02.881+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:44:02.882585037Z [2024-04-04T23:44:02.882+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:43:00+00:00, run_id=scheduled__2024-04-04T23:43:00+00:00, run_start_date=2024-04-04 23:44:00.858322+00:00, run_end_date=2024-04-04 23:44:02.881795+00:00, run_duration=2.023473, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:43:00+00:00, data_interval_end=2024-04-04 23:44:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:44:02.908962565Z [2024-04-04T23:44:02.908+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:44:00+00:00, run_after=2024-04-04T23:45:00+00:00 2024-04-04T23:44:03.014957066Z [2024-04-04T23:44:03.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:42:00+00:00 exited with status success for try_number 1 2024-04-04T23:44:03.015179062Z [2024-04-04T23:44:03.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:43:00+00:00 exited with status success for try_number 1 2024-04-04T23:44:03.035746321Z [2024-04-04T23:44:03.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:43:00+00:00, map_index=-1, run_start_date=2024-04-04 23:44:02.103505+00:00, run_end_date=2024-04-04 23:44:02.480614+00:00, run_duration=0.377109, state=success, executor_state=success, try_number=1, max_tries=1, job_id=340, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:44:00.990572+00:00, queued_by_job_id=1, pid=5040 2024-04-04T23:44:03.038217092Z [2024-04-04T23:44:03.035+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:42:00+00:00, map_index=-1, run_start_date=2024-04-04 23:44:02.100344+00:00, run_end_date=2024-04-04 23:44:02.444209+00:00, run_duration=0.343865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=341, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:44:00.990572+00:00, queued_by_job_id=1, pid=5039 2024-04-04T23:44:05.093394112Z [2024-04-04T23:44:05.092+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:44:05.093684520Z [2024-04-04T23:44:05.093+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:43:00+00:00, run_id=scheduled__2024-04-04T23:43:00+00:00, run_start_date=2024-04-04 23:44:00.860002+00:00, run_end_date=2024-04-04 23:44:05.093239+00:00, run_duration=4.233237, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:43:00+00:00, data_interval_end=2024-04-04 23:44:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:44:05.107168650Z [2024-04-04T23:44:05.106+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:44:00+00:00, run_after=2024-04-04T23:45:00+00:00 2024-04-04T23:44:05.157181068Z [2024-04-04T23:44:05.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:43:00+00:00 exited with status success for try_number 1 2024-04-04T23:44:05.163179778Z [2024-04-04T23:44:05.162+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:43:00+00:00, map_index=-1, run_start_date=2024-04-04 23:44:03.090163+00:00, run_end_date=2024-04-04 23:44:04.426077+00:00, run_duration=1.335914, state=success, executor_state=success, try_number=1, max_tries=1, job_id=342, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:44:00.990572+00:00, queued_by_job_id=1, pid=5058 2024-04-04T23:44:06.211713305Z [2024-04-04T23:44:06.210+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:44:06.211778637Z [2024-04-04T23:44:06.210+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:43:00+00:00, run_id=scheduled__2024-04-04T23:43:00+00:00, run_start_date=2024-04-04 23:44:00.861457+00:00, run_end_date=2024-04-04 23:44:06.210493+00:00, run_duration=5.349036, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:43:00+00:00, data_interval_end=2024-04-04 23:44:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:44:06.221569743Z [2024-04-04T23:44:06.219+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:44:00+00:00, run_after=2024-04-04T23:45:00+00:00 2024-04-04T23:44:06.256479798Z [2024-04-04T23:44:06.255+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:43:00+00:00 exited with status success for try_number 1 2024-04-04T23:44:06.261499856Z [2024-04-04T23:44:06.261+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:43:00+00:00, map_index=-1, run_start_date=2024-04-04 23:44:03.326360+00:00, run_end_date=2024-04-04 23:44:05.449170+00:00, run_duration=2.12281, state=success, executor_state=success, try_number=1, max_tries=1, job_id=343, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:44:00.990572+00:00, queued_by_job_id=1, pid=5064 2024-04-04T23:45:01.071597473Z [2024-04-04T23:45:01.071+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:45:00+00:00, run_after=2024-04-04T23:46:00+00:00 2024-04-04T23:45:01.086658348Z [2024-04-04T23:45:01.086+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:45:00+00:00, run_after=2024-04-04T23:46:00+00:00 2024-04-04T23:45:01.094868862Z [2024-04-04T23:45:01.094+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:45:01.111237341Z [2024-04-04T23:45:01.110+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:45:00+00:00, run_after=2024-04-04T23:50:00+00:00 2024-04-04T23:45:01.345876935Z [2024-04-04T23:45:01.345+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:45:01.345913863Z 2024-04-04T23:45:01.345920101Z 2024-04-04T23:45:01.345924488Z 2024-04-04T23:45:01.345929782Z 2024-04-04T23:45:01.346217988Z [2024-04-04T23:45:01.346+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:45:01.346454739Z [2024-04-04T23:45:01.346+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:45:01.346671685Z [2024-04-04T23:45:01.346+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:45:01.346905542Z [2024-04-04T23:45:01.346+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:45:01.347635901Z [2024-04-04T23:45:01.347+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:45:01.347647960Z 2024-04-04T23:45:01.347651836Z 2024-04-04T23:45:01.347656120Z 2024-04-04T23:45:01.347661611Z 2024-04-04T23:45:01.360173216Z [2024-04-04T23:45:01.359+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T23:45:01.360643530Z [2024-04-04T23:45:01.360+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:45:01.361548262Z [2024-04-04T23:45:01.361+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:45:01.363837538Z [2024-04-04T23:45:01.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:45:01.364954776Z [2024-04-04T23:45:01.364+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:45:01.365276615Z [2024-04-04T23:45:01.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:45:01.366078749Z [2024-04-04T23:45:01.365+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:45:01.366089413Z [2024-04-04T23:45:01.365+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:45:01.684152224Z [2024-04-04T23:45:01.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:40:00+00:00 exited with status queued for try_number 1 2024-04-04T23:45:01.684271808Z [2024-04-04T23:45:01.683+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:44:00+00:00 exited with status queued for try_number 1 2024-04-04T23:45:01.684281160Z [2024-04-04T23:45:01.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:44:00+00:00 exited with status queued for try_number 1 2024-04-04T23:45:01.684286173Z [2024-04-04T23:45:01.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:44:00+00:00 exited with status queued for try_number 1 2024-04-04T23:45:01.693525732Z [2024-04-04T23:45:01.693+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89a57e22-4e1e-461f-9637-a04d2e890788 2024-04-04T23:45:01.693651523Z [2024-04-04T23:45:01.693+0000] {scheduler_job.py:635} INFO - Setting external_id for to 993603d6-67a0-4a7e-9968-c6bc7c1af88f 2024-04-04T23:45:01.693659554Z [2024-04-04T23:45:01.693+0000] {scheduler_job.py:635} INFO - Setting external_id for to f633250d-f17c-4ccf-9178-6b3dba60f5e4 2024-04-04T23:45:01.693763847Z [2024-04-04T23:45:01.693+0000] {scheduler_job.py:635} INFO - Setting external_id for to 163d5907-8c31-45e5-bf56-5623345cf0bc 2024-04-04T23:45:03.740387500Z [2024-04-04T23:45:03.739+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:45:03.741277759Z [2024-04-04T23:45:03.740+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:44:00+00:00, run_id=scheduled__2024-04-04T23:44:00+00:00, run_start_date=2024-04-04 23:45:01.126657+00:00, run_end_date=2024-04-04 23:45:03.740729+00:00, run_duration=2.614072, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:44:00+00:00, data_interval_end=2024-04-04 23:45:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:45:03.753928828Z [2024-04-04T23:45:03.753+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:45:00+00:00, run_after=2024-04-04T23:46:00+00:00 2024-04-04T23:45:03.851297641Z [2024-04-04T23:45:03.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:44:00+00:00 exited with status success for try_number 1 2024-04-04T23:45:03.860104455Z [2024-04-04T23:45:03.859+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:44:00+00:00, map_index=-1, run_start_date=2024-04-04 23:45:02.442021+00:00, run_end_date=2024-04-04 23:45:02.916701+00:00, run_duration=0.47468, state=success, executor_state=success, try_number=1, max_tries=1, job_id=344, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:45:01.348829+00:00, queued_by_job_id=1, pid=5097 2024-04-04T23:45:04.435403892Z [2024-04-04T23:45:04.434+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:45:04.435432073Z 2024-04-04T23:45:04.435516036Z [2024-04-04T23:45:04.435+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:45:04.437093561Z [2024-04-04T23:45:04.436+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:45:04.437127532Z 2024-04-04T23:45:04.441565528Z [2024-04-04T23:45:04.441+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-04T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T23:45:04.441686707Z [2024-04-04T23:45:04.441+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-04T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:45:04.530062882Z [2024-04-04T23:45:04.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:40:00+00:00 exited with status queued for try_number 1 2024-04-04T23:45:04.530096937Z [2024-04-04T23:45:04.529+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:40:00+00:00 exited with status success for try_number 1 2024-04-04T23:45:04.538019235Z [2024-04-04T23:45:04.537+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba3685d2-2176-41a7-99d5-14186ae4476e 2024-04-04T23:45:04.538313089Z [2024-04-04T23:45:04.537+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T23:40:00+00:00, map_index=-1, run_start_date=2024-04-04 23:45:03.710525+00:00, run_end_date=2024-04-04 23:45:04.197340+00:00, run_duration=0.486815, state=success, executor_state=success, try_number=1, max_tries=1, job_id=347, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:45:01.348829+00:00, queued_by_job_id=1, pid=5123 2024-04-04T23:45:05.715503092Z [2024-04-04T23:45:05.714+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:45:05.715874495Z [2024-04-04T23:45:05.715+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:44:00+00:00, run_id=scheduled__2024-04-04T23:44:00+00:00, run_start_date=2024-04-04 23:45:01.128759+00:00, run_end_date=2024-04-04 23:45:05.715313+00:00, run_duration=4.586554, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:44:00+00:00, data_interval_end=2024-04-04 23:45:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:45:05.730184834Z [2024-04-04T23:45:05.729+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:45:00+00:00, run_after=2024-04-04T23:46:00+00:00 2024-04-04T23:45:05.737790317Z [2024-04-04T23:45:05.737+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:45:05.737885407Z [2024-04-04T23:45:05.737+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:44:00+00:00, run_id=scheduled__2024-04-04T23:44:00+00:00, run_start_date=2024-04-04 23:45:01.130577+00:00, run_end_date=2024-04-04 23:45:05.737628+00:00, run_duration=4.607051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:44:00+00:00, data_interval_end=2024-04-04 23:45:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:45:05.747232392Z [2024-04-04T23:45:05.746+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:45:00+00:00, run_after=2024-04-04T23:46:00+00:00 2024-04-04T23:45:05.798787676Z [2024-04-04T23:45:05.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:44:00+00:00 exited with status success for try_number 1 2024-04-04T23:45:05.798833768Z [2024-04-04T23:45:05.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:44:00+00:00 exited with status success for try_number 1 2024-04-04T23:45:05.808843730Z [2024-04-04T23:45:05.808+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:44:00+00:00, map_index=-1, run_start_date=2024-04-04 23:45:03.630029+00:00, run_end_date=2024-04-04 23:45:05.150231+00:00, run_duration=1.520202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=346, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:45:01.348829+00:00, queued_by_job_id=1, pid=5122 2024-04-04T23:45:05.808933212Z [2024-04-04T23:45:05.808+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:44:00+00:00, map_index=-1, run_start_date=2024-04-04 23:45:03.493960+00:00, run_end_date=2024-04-04 23:45:05.305282+00:00, run_duration=1.811322, state=success, executor_state=success, try_number=1, max_tries=1, job_id=345, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:45:01.348829+00:00, queued_by_job_id=1, pid=5121 2024-04-04T23:45:06.875504571Z [2024-04-04T23:45:06.875+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:45:06.875536896Z 2024-04-04T23:45:06.875793831Z [2024-04-04T23:45:06.875+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:45:06.877103344Z [2024-04-04T23:45:06.876+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:45:06.877124947Z 2024-04-04T23:45:06.881185933Z [2024-04-04T23:45:06.880+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-04T23:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T23:45:06.881443722Z [2024-04-04T23:45:06.881+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-04T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T23:45:06.928241241Z [2024-04-04T23:45:06.927+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:40:00+00:00 exited with status queued for try_number 1 2024-04-04T23:45:06.928622791Z [2024-04-04T23:45:06.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:40:00+00:00 exited with status success for try_number 1 2024-04-04T23:45:06.935976833Z [2024-04-04T23:45:06.935+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1bacad0e-3455-4a52-a9f2-498374f02ac0 2024-04-04T23:45:06.936375403Z [2024-04-04T23:45:06.936+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-04T23:40:00+00:00, map_index=-1, run_start_date=2024-04-04 23:45:06.258901+00:00, run_end_date=2024-04-04 23:45:06.609575+00:00, run_duration=0.350674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=348, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:45:04.437714+00:00, queued_by_job_id=1, pid=5146 2024-04-04T23:45:08.878131899Z [2024-04-04T23:45:08.877+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:45:08.878164548Z 2024-04-04T23:45:08.878171389Z [2024-04-04T23:45:08.877+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:45:08.878665810Z [2024-04-04T23:45:08.878+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:45:08.878695833Z 2024-04-04T23:45:08.881426258Z [2024-04-04T23:45:08.881+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-04T23:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:45:08.881456127Z [2024-04-04T23:45:08.881+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-04T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:45:08.942418256Z [2024-04-04T23:45:08.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:40:00+00:00 exited with status queued for try_number 1 2024-04-04T23:45:08.942443694Z [2024-04-04T23:45:08.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:40:00+00:00 exited with status success for try_number 1 2024-04-04T23:45:08.950085551Z [2024-04-04T23:45:08.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e97bc91-1040-422a-9352-d28c2fbb6c29 2024-04-04T23:45:08.950160715Z [2024-04-04T23:45:08.949+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-04T23:40:00+00:00, map_index=0, run_start_date=2024-04-04 23:45:08.509585+00:00, run_end_date=2024-04-04 23:45:08.791449+00:00, run_duration=0.281864, state=success, executor_state=success, try_number=1, max_tries=1, job_id=349, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:45:06.877747+00:00, queued_by_job_id=1, pid=5154 2024-04-04T23:45:11.191777934Z [2024-04-04T23:45:11.189+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:45:11.191825013Z [2024-04-04T23:45:11.189+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:40:00+00:00, run_id=scheduled__2024-04-04T23:40:00+00:00, run_start_date=2024-04-04 23:45:01.124448+00:00, run_end_date=2024-04-04 23:45:11.189865+00:00, run_duration=10.065417, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:40:00+00:00, data_interval_end=2024-04-04 23:45:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-04T23:45:11.212303537Z [2024-04-04T23:45:11.212+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:45:00+00:00, run_after=2024-04-04T23:50:00+00:00 2024-04-04T23:45:11.243874452Z [2024-04-04T23:45:11.243+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:40:00+00:00 exited with status success for try_number 1 2024-04-04T23:45:11.248900720Z [2024-04-04T23:45:11.248+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-04T23:40:00+00:00, map_index=-1, run_start_date=2024-04-04 23:45:10.660612+00:00, run_end_date=2024-04-04 23:45:11.027747+00:00, run_duration=0.367135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=350, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:45:08.878956+00:00, queued_by_job_id=1, pid=5172 2024-04-04T23:45:39.922829261Z [2024-04-04T23:45:39.921+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-04T23:46:00.199943482Z [2024-04-04T23:46:00.199+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:46:00.213270955Z [2024-04-04T23:46:00.212+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:46:00+00:00, run_after=2024-04-04T23:47:00+00:00 2024-04-04T23:46:00.240093862Z [2024-04-04T23:46:00.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:46:00+00:00, run_after=2024-04-04T23:47:00+00:00 2024-04-04T23:46:00.249528710Z [2024-04-04T23:46:00.249+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:46:00.341725049Z [2024-04-04T23:46:00.341+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:46:00.341748013Z 2024-04-04T23:46:00.341752095Z 2024-04-04T23:46:00.341755310Z 2024-04-04T23:46:00.341758583Z 2024-04-04T23:46:00.342182955Z [2024-04-04T23:46:00.341+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:46:00.342700758Z [2024-04-04T23:46:00.342+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:46:00.343181754Z [2024-04-04T23:46:00.342+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:46:00.343718198Z [2024-04-04T23:46:00.343+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:46:00.345766614Z [2024-04-04T23:46:00.345+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:46:00.345778230Z 2024-04-04T23:46:00.345782073Z 2024-04-04T23:46:00.345785485Z 2024-04-04T23:46:00.345788531Z 2024-04-04T23:46:00.363551413Z [2024-04-04T23:46:00.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:46:00.363751554Z [2024-04-04T23:46:00.363+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:46:00.364101271Z [2024-04-04T23:46:00.363+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:46:00.364262295Z [2024-04-04T23:46:00.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:46:00.364572344Z [2024-04-04T23:46:00.364+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:46:00.364731030Z [2024-04-04T23:46:00.364+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:46:00.365269728Z [2024-04-04T23:46:00.365+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:46:00.365502390Z [2024-04-04T23:46:00.365+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:46:00.964469358Z [2024-04-04T23:46:00.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:44:00+00:00 exited with status queued for try_number 1 2024-04-04T23:46:00.964784278Z [2024-04-04T23:46:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:45:00+00:00 exited with status queued for try_number 1 2024-04-04T23:46:00.965002631Z [2024-04-04T23:46:00.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:45:00+00:00 exited with status queued for try_number 1 2024-04-04T23:46:00.965901466Z [2024-04-04T23:46:00.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:45:00+00:00 exited with status queued for try_number 1 2024-04-04T23:46:00.983652122Z [2024-04-04T23:46:00.983+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1830c9e7-6b67-49d6-abc5-710d93a7c0d5 2024-04-04T23:46:00.984887701Z [2024-04-04T23:46:00.984+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d4953c1-6788-43dc-83c1-95b0eb3216fa 2024-04-04T23:46:00.985131906Z [2024-04-04T23:46:00.984+0000] {scheduler_job.py:635} INFO - Setting external_id for to 61b23b81-7f53-4527-a40e-c10d6cc78438 2024-04-04T23:46:00.985390526Z [2024-04-04T23:46:00.985+0000] {scheduler_job.py:635} INFO - Setting external_id for to e8de1a20-db8c-439b-8307-ffe1da673129 2024-04-04T23:46:02.480390812Z [2024-04-04T23:46:02.479+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:46:02.480421719Z [2024-04-04T23:46:02.479+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:44:00+00:00, run_id=scheduled__2024-04-04T23:44:00+00:00, run_start_date=2024-04-04 23:46:00.264530+00:00, run_end_date=2024-04-04 23:46:02.479633+00:00, run_duration=2.215103, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:44:00+00:00, data_interval_end=2024-04-04 23:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:46:02.490608625Z [2024-04-04T23:46:02.488+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:46:00+00:00, run_after=2024-04-04T23:48:00+00:00 2024-04-04T23:46:02.542924441Z [2024-04-04T23:46:02.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:44:00+00:00 exited with status success for try_number 1 2024-04-04T23:46:02.542946924Z [2024-04-04T23:46:02.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:45:00+00:00 exited with status success for try_number 1 2024-04-04T23:46:02.549639351Z [2024-04-04T23:46:02.549+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:45:00+00:00, map_index=-1, run_start_date=2024-04-04 23:46:01.737866+00:00, run_end_date=2024-04-04 23:46:02.341981+00:00, run_duration=0.604115, state=success, executor_state=success, try_number=1, max_tries=1, job_id=352, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:46:00.350718+00:00, queued_by_job_id=1, pid=5186 2024-04-04T23:46:02.549710670Z [2024-04-04T23:46:02.549+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:44:00+00:00, map_index=-1, run_start_date=2024-04-04 23:46:01.435331+00:00, run_end_date=2024-04-04 23:46:02.070065+00:00, run_duration=0.634734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=351, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:46:00.350718+00:00, queued_by_job_id=1, pid=5185 2024-04-04T23:46:03.544696216Z [2024-04-04T23:46:03.544+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:46:03.544893370Z [2024-04-04T23:46:03.544+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:45:00+00:00, run_id=scheduled__2024-04-04T23:45:00+00:00, run_start_date=2024-04-04 23:46:00.265934+00:00, run_end_date=2024-04-04 23:46:03.544547+00:00, run_duration=3.278613, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:45:00+00:00, data_interval_end=2024-04-04 23:46:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:46:03.556670281Z [2024-04-04T23:46:03.556+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:46:00+00:00, run_after=2024-04-04T23:47:00+00:00 2024-04-04T23:46:05.994705115Z [2024-04-04T23:46:05.994+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:46:05.995214869Z [2024-04-04T23:46:05.994+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:45:00+00:00, run_id=scheduled__2024-04-04T23:45:00+00:00, run_start_date=2024-04-04 23:46:00.267251+00:00, run_end_date=2024-04-04 23:46:05.994879+00:00, run_duration=5.727628, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:45:00+00:00, data_interval_end=2024-04-04 23:46:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:46:06.006043178Z [2024-04-04T23:46:06.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:46:00+00:00, run_after=2024-04-04T23:47:00+00:00 2024-04-04T23:46:06.014618222Z [2024-04-04T23:46:06.014+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:46:06.015078222Z [2024-04-04T23:46:06.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:45:00+00:00, run_id=scheduled__2024-04-04T23:45:00+00:00, run_start_date=2024-04-04 23:46:00.268562+00:00, run_end_date=2024-04-04 23:46:06.014775+00:00, run_duration=5.746213, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:45:00+00:00, data_interval_end=2024-04-04 23:46:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:46:06.024827669Z [2024-04-04T23:46:06.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:46:00+00:00, run_after=2024-04-04T23:47:00+00:00 2024-04-04T23:46:06.066113653Z [2024-04-04T23:46:06.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:45:00+00:00 exited with status success for try_number 1 2024-04-04T23:46:06.066345993Z [2024-04-04T23:46:06.066+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:45:00+00:00 exited with status success for try_number 1 2024-04-04T23:46:06.076125847Z [2024-04-04T23:46:06.075+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:45:00+00:00, map_index=-1, run_start_date=2024-04-04 23:46:03.565919+00:00, run_end_date=2024-04-04 23:46:05.285844+00:00, run_duration=1.719925, state=success, executor_state=success, try_number=1, max_tries=1, job_id=354, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:46:00.350718+00:00, queued_by_job_id=1, pid=5210 2024-04-04T23:46:06.076475550Z [2024-04-04T23:46:06.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:45:00+00:00, map_index=-1, run_start_date=2024-04-04 23:46:03.461865+00:00, run_end_date=2024-04-04 23:46:05.566627+00:00, run_duration=2.104762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=353, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:46:00.350718+00:00, queued_by_job_id=1, pid=5209 2024-04-04T23:47:00.437510724Z [2024-04-04T23:47:00.437+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:47:00+00:00, run_after=2024-04-04T23:48:00+00:00 2024-04-04T23:47:00.448132602Z [2024-04-04T23:47:00.447+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:47:00.468141213Z [2024-04-04T23:47:00.467+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:47:00+00:00, run_after=2024-04-04T23:48:00+00:00 2024-04-04T23:47:00.561524467Z [2024-04-04T23:47:00.561+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:47:00.561554137Z 2024-04-04T23:47:00.561557753Z 2024-04-04T23:47:00.561561051Z 2024-04-04T23:47:00.561727065Z [2024-04-04T23:47:00.561+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:47:00.561899376Z [2024-04-04T23:47:00.561+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:47:00.562006557Z [2024-04-04T23:47:00.561+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:47:00.562636937Z [2024-04-04T23:47:00.562+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:47:00.562645013Z 2024-04-04T23:47:00.562648606Z 2024-04-04T23:47:00.562651866Z 2024-04-04T23:47:00.566309372Z [2024-04-04T23:47:00.566+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:47:00.566528266Z [2024-04-04T23:47:00.566+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:47:00.566841967Z [2024-04-04T23:47:00.566+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:47:00.567036414Z [2024-04-04T23:47:00.566+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:47:00.567360537Z [2024-04-04T23:47:00.567+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:47:00.567617682Z [2024-04-04T23:47:00.567+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:47:01.045061308Z [2024-04-04T23:47:01.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:46:00+00:00 exited with status queued for try_number 1 2024-04-04T23:47:01.047931405Z [2024-04-04T23:47:01.044+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:46:00+00:00 exited with status queued for try_number 1 2024-04-04T23:47:01.053002258Z [2024-04-04T23:47:01.047+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:46:00+00:00 exited with status queued for try_number 1 2024-04-04T23:47:01.088705992Z [2024-04-04T23:47:01.088+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62eb55f5-6e01-4d12-bd7c-7dc2ff1b52ae 2024-04-04T23:47:01.092085168Z [2024-04-04T23:47:01.091+0000] {scheduler_job.py:635} INFO - Setting external_id for to 449225e4-ca71-4ee0-8c0b-4e153bdd749e 2024-04-04T23:47:01.096267992Z [2024-04-04T23:47:01.095+0000] {scheduler_job.py:635} INFO - Setting external_id for to a668799f-7882-4092-a1f4-9a747f665e7c 2024-04-04T23:47:02.451161442Z [2024-04-04T23:47:02.450+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:47:02.451545295Z [2024-04-04T23:47:02.451+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:46:00+00:00, run_id=scheduled__2024-04-04T23:46:00+00:00, run_start_date=2024-04-04 23:47:00.484821+00:00, run_end_date=2024-04-04 23:47:02.451077+00:00, run_duration=1.966256, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:46:00+00:00, data_interval_end=2024-04-04 23:47:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:47:02.469236051Z [2024-04-04T23:47:02.468+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:47:00+00:00, run_after=2024-04-04T23:48:00+00:00 2024-04-04T23:47:02.541180902Z [2024-04-04T23:47:02.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:46:00+00:00 exited with status success for try_number 1 2024-04-04T23:47:02.551067917Z [2024-04-04T23:47:02.550+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:46:00+00:00, map_index=-1, run_start_date=2024-04-04 23:47:01.507202+00:00, run_end_date=2024-04-04 23:47:02.001817+00:00, run_duration=0.494615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=355, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:47:00.563395+00:00, queued_by_job_id=1, pid=5241 2024-04-04T23:47:04.436809728Z [2024-04-04T23:47:04.436+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:47:04.437127258Z [2024-04-04T23:47:04.436+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:46:00+00:00, run_id=scheduled__2024-04-04T23:46:00+00:00, run_start_date=2024-04-04 23:47:00.486612+00:00, run_end_date=2024-04-04 23:47:04.436699+00:00, run_duration=3.950087, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:46:00+00:00, data_interval_end=2024-04-04 23:47:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:47:04.448974082Z [2024-04-04T23:47:04.448+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:47:00+00:00, run_after=2024-04-04T23:48:00+00:00 2024-04-04T23:47:04.515663077Z [2024-04-04T23:47:04.512+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:46:00+00:00 exited with status success for try_number 1 2024-04-04T23:47:04.520080384Z [2024-04-04T23:47:04.519+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:46:00+00:00, map_index=-1, run_start_date=2024-04-04 23:47:03.050792+00:00, run_end_date=2024-04-04 23:47:04.309160+00:00, run_duration=1.258368, state=success, executor_state=success, try_number=1, max_tries=1, job_id=356, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:47:00.563395+00:00, queued_by_job_id=1, pid=5259 2024-04-04T23:47:05.239636967Z [2024-04-04T23:47:05.239+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:47:05.240081383Z [2024-04-04T23:47:05.239+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:46:00+00:00, run_id=scheduled__2024-04-04T23:46:00+00:00, run_start_date=2024-04-04 23:47:00.488925+00:00, run_end_date=2024-04-04 23:47:05.239622+00:00, run_duration=4.750697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:46:00+00:00, data_interval_end=2024-04-04 23:47:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:47:05.253903930Z [2024-04-04T23:47:05.253+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:47:00+00:00, run_after=2024-04-04T23:48:00+00:00 2024-04-04T23:47:05.294204986Z [2024-04-04T23:47:05.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:46:00+00:00 exited with status success for try_number 1 2024-04-04T23:47:05.301389637Z [2024-04-04T23:47:05.300+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:46:00+00:00, map_index=-1, run_start_date=2024-04-04 23:47:03.208257+00:00, run_end_date=2024-04-04 23:47:04.986953+00:00, run_duration=1.778696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=357, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:47:00.563395+00:00, queued_by_job_id=1, pid=5260 2024-04-04T23:48:00.219793971Z [2024-04-04T23:48:00.219+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:48:00.278067283Z [2024-04-04T23:48:00.277+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:48:00+00:00, run_after=2024-04-04T23:49:00+00:00 2024-04-04T23:48:00.368773917Z [2024-04-04T23:48:00.368+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:48:00.382983949Z [2024-04-04T23:48:00.382+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:48:00+00:00, run_after=2024-04-04T23:49:00+00:00 2024-04-04T23:48:00.553772475Z [2024-04-04T23:48:00.553+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:48:00.553796864Z 2024-04-04T23:48:00.553801712Z 2024-04-04T23:48:00.553822074Z 2024-04-04T23:48:00.553825258Z 2024-04-04T23:48:00.554385867Z [2024-04-04T23:48:00.553+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:48:00.554652007Z [2024-04-04T23:48:00.554+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:48:00.555145506Z [2024-04-04T23:48:00.554+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:48:00.556115718Z [2024-04-04T23:48:00.555+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:48:00.557361844Z [2024-04-04T23:48:00.557+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:48:00.557379250Z 2024-04-04T23:48:00.557393890Z 2024-04-04T23:48:00.557398598Z 2024-04-04T23:48:00.557403107Z 2024-04-04T23:48:00.563431176Z [2024-04-04T23:48:00.563+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:48:00.564388863Z [2024-04-04T23:48:00.563+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:48:00.564800970Z [2024-04-04T23:48:00.564+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:48:00.565647490Z [2024-04-04T23:48:00.565+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:48:00.565959304Z [2024-04-04T23:48:00.565+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:48:00.566255189Z [2024-04-04T23:48:00.566+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:48:00.566567547Z [2024-04-04T23:48:00.566+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:48:00.567340821Z [2024-04-04T23:48:00.567+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:48:01.102825656Z [2024-04-04T23:48:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:46:00+00:00 exited with status queued for try_number 1 2024-04-04T23:48:01.102906829Z [2024-04-04T23:48:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:47:00+00:00 exited with status queued for try_number 1 2024-04-04T23:48:01.103075190Z [2024-04-04T23:48:01.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:47:00+00:00 exited with status queued for try_number 1 2024-04-04T23:48:01.103138246Z [2024-04-04T23:48:01.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:47:00+00:00 exited with status queued for try_number 1 2024-04-04T23:48:01.117955291Z [2024-04-04T23:48:01.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to cdd48ee2-4088-45a5-9671-999ac0d107c9 2024-04-04T23:48:01.118160891Z [2024-04-04T23:48:01.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to c85b8a08-da71-4510-b31e-26beac7e914a 2024-04-04T23:48:01.118380940Z [2024-04-04T23:48:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to 391e432f-0fb5-4f58-88bc-7626a7872ab6 2024-04-04T23:48:01.123417877Z [2024-04-04T23:48:01.123+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d508001-61a8-4541-97f6-12a0582ba52a 2024-04-04T23:48:04.567327098Z [2024-04-04T23:48:04.566+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:48:04.572729656Z [2024-04-04T23:48:04.572+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:46:00+00:00, run_id=scheduled__2024-04-04T23:46:00+00:00, run_start_date=2024-04-04 23:48:00.401625+00:00, run_end_date=2024-04-04 23:48:04.571886+00:00, run_duration=4.170261, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:46:00+00:00, data_interval_end=2024-04-04 23:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:48:04.597039286Z [2024-04-04T23:48:04.596+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:48:00+00:00, run_after=2024-04-04T23:50:00+00:00 2024-04-04T23:48:04.790589833Z [2024-04-04T23:48:04.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:46:00+00:00 exited with status success for try_number 1 2024-04-04T23:48:04.809972822Z [2024-04-04T23:48:04.809+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:46:00+00:00, map_index=-1, run_start_date=2024-04-04 23:48:03.254067+00:00, run_end_date=2024-04-04 23:48:04.102197+00:00, run_duration=0.84813, state=success, executor_state=success, try_number=1, max_tries=1, job_id=358, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:48:00.559396+00:00, queued_by_job_id=1, pid=5288 2024-04-04T23:48:05.651409972Z [2024-04-04T23:48:05.651+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:48:05.651803384Z [2024-04-04T23:48:05.651+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:47:00+00:00, run_id=scheduled__2024-04-04T23:47:00+00:00, run_start_date=2024-04-04 23:48:00.403743+00:00, run_end_date=2024-04-04 23:48:05.651430+00:00, run_duration=5.247687, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:47:00+00:00, data_interval_end=2024-04-04 23:48:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:48:05.661642933Z [2024-04-04T23:48:05.661+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:48:00+00:00, run_after=2024-04-04T23:49:00+00:00 2024-04-04T23:48:05.725705511Z [2024-04-04T23:48:05.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:47:00+00:00 exited with status success for try_number 1 2024-04-04T23:48:05.738824784Z [2024-04-04T23:48:05.738+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:47:00+00:00, map_index=-1, run_start_date=2024-04-04 23:48:04.145949+00:00, run_end_date=2024-04-04 23:48:04.901628+00:00, run_duration=0.755679, state=success, executor_state=success, try_number=1, max_tries=1, job_id=359, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:48:00.559396+00:00, queued_by_job_id=1, pid=5300 2024-04-04T23:48:08.766238884Z [2024-04-04T23:48:08.765+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:48:08.766681603Z [2024-04-04T23:48:08.766+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:47:00+00:00, run_id=scheduled__2024-04-04T23:47:00+00:00, run_start_date=2024-04-04 23:48:00.405825+00:00, run_end_date=2024-04-04 23:48:08.765991+00:00, run_duration=8.360166, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:47:00+00:00, data_interval_end=2024-04-04 23:48:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:48:08.775243774Z [2024-04-04T23:48:08.774+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:48:00+00:00, run_after=2024-04-04T23:49:00+00:00 2024-04-04T23:48:09.883501182Z [2024-04-04T23:48:09.883+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:48:09.883922500Z [2024-04-04T23:48:09.883+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:47:00+00:00, run_id=scheduled__2024-04-04T23:47:00+00:00, run_start_date=2024-04-04 23:48:00.408191+00:00, run_end_date=2024-04-04 23:48:09.883373+00:00, run_duration=9.475182, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:47:00+00:00, data_interval_end=2024-04-04 23:48:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:48:09.893872110Z [2024-04-04T23:48:09.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:48:00+00:00, run_after=2024-04-04T23:49:00+00:00 2024-04-04T23:48:09.934665776Z [2024-04-04T23:48:09.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:47:00+00:00 exited with status success for try_number 1 2024-04-04T23:48:09.934814869Z [2024-04-04T23:48:09.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:47:00+00:00 exited with status success for try_number 1 2024-04-04T23:48:09.953598440Z [2024-04-04T23:48:09.952+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:47:00+00:00, map_index=-1, run_start_date=2024-04-04 23:48:06.062145+00:00, run_end_date=2024-04-04 23:48:08.738365+00:00, run_duration=2.67622, state=success, executor_state=success, try_number=1, max_tries=1, job_id=361, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:48:00.559396+00:00, queued_by_job_id=1, pid=5323 2024-04-04T23:48:09.954523543Z [2024-04-04T23:48:09.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:47:00+00:00, map_index=-1, run_start_date=2024-04-04 23:48:05.063341+00:00, run_end_date=2024-04-04 23:48:08.857395+00:00, run_duration=3.794054, state=success, executor_state=success, try_number=1, max_tries=1, job_id=360, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:48:00.559396+00:00, queued_by_job_id=1, pid=5312 2024-04-04T23:49:00.398148771Z [2024-04-04T23:49:00.397+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:49:00+00:00, run_after=2024-04-04T23:50:00+00:00 2024-04-04T23:49:00.406485666Z [2024-04-04T23:49:00.406+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:49:00.424760308Z [2024-04-04T23:49:00.424+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:49:00+00:00, run_after=2024-04-04T23:50:00+00:00 2024-04-04T23:49:00.492658084Z [2024-04-04T23:49:00.492+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:49:00.492684004Z 2024-04-04T23:49:00.492687610Z 2024-04-04T23:49:00.492690866Z 2024-04-04T23:49:00.492806604Z [2024-04-04T23:49:00.492+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:49:00.492982911Z [2024-04-04T23:49:00.492+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:49:00.493131913Z [2024-04-04T23:49:00.493+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:49:00.493780730Z [2024-04-04T23:49:00.493+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:49:00.493788402Z 2024-04-04T23:49:00.493791768Z 2024-04-04T23:49:00.493795156Z 2024-04-04T23:49:00.501980992Z [2024-04-04T23:49:00.501+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:49:00.502237834Z [2024-04-04T23:49:00.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:49:00.502509670Z [2024-04-04T23:49:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:49:00.502673685Z [2024-04-04T23:49:00.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:49:00.502924296Z [2024-04-04T23:49:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:49:00.503119754Z [2024-04-04T23:49:00.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:49:01.019023577Z [2024-04-04T23:49:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:48:00+00:00 exited with status queued for try_number 1 2024-04-04T23:49:01.019125252Z [2024-04-04T23:49:01.018+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:48:00+00:00 exited with status queued for try_number 1 2024-04-04T23:49:01.019242621Z [2024-04-04T23:49:01.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:48:00+00:00 exited with status queued for try_number 1 2024-04-04T23:49:01.028037976Z [2024-04-04T23:49:01.027+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83f4006b-223d-43c2-869e-594eb2f07d75 2024-04-04T23:49:01.028227858Z [2024-04-04T23:49:01.028+0000] {scheduler_job.py:635} INFO - Setting external_id for to 97806a8f-6cca-425e-9748-a73baf95312f 2024-04-04T23:49:01.028395277Z [2024-04-04T23:49:01.028+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65dc8c92-03b4-48b2-b62f-1f56212a4687 2024-04-04T23:49:03.456581701Z [2024-04-04T23:49:03.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:49:03.457257297Z [2024-04-04T23:49:03.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:48:00+00:00, run_id=scheduled__2024-04-04T23:48:00+00:00, run_start_date=2024-04-04 23:49:00.437211+00:00, run_end_date=2024-04-04 23:49:03.456447+00:00, run_duration=3.019236, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:48:00+00:00, data_interval_end=2024-04-04 23:49:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:49:03.469902734Z [2024-04-04T23:49:03.469+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:49:00+00:00, run_after=2024-04-04T23:50:00+00:00 2024-04-04T23:49:03.530984290Z [2024-04-04T23:49:03.528+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:48:00+00:00 exited with status success for try_number 1 2024-04-04T23:49:03.537354171Z [2024-04-04T23:49:03.536+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:48:00+00:00, map_index=-1, run_start_date=2024-04-04 23:49:02.414233+00:00, run_end_date=2024-04-04 23:49:03.073714+00:00, run_duration=0.659481, state=success, executor_state=success, try_number=1, max_tries=1, job_id=362, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:49:00.494558+00:00, queued_by_job_id=1, pid=5352 2024-04-04T23:49:05.661628048Z [2024-04-04T23:49:05.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:49:05.662209697Z [2024-04-04T23:49:05.661+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:48:00+00:00, run_id=scheduled__2024-04-04T23:48:00+00:00, run_start_date=2024-04-04 23:49:00.440058+00:00, run_end_date=2024-04-04 23:49:05.661774+00:00, run_duration=5.221716, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:48:00+00:00, data_interval_end=2024-04-04 23:49:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:49:05.671490079Z [2024-04-04T23:49:05.671+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:49:00+00:00, run_after=2024-04-04T23:50:00+00:00 2024-04-04T23:49:05.681509209Z [2024-04-04T23:49:05.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:49:05.681962868Z [2024-04-04T23:49:05.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:48:00+00:00, run_id=scheduled__2024-04-04T23:48:00+00:00, run_start_date=2024-04-04 23:49:00.438758+00:00, run_end_date=2024-04-04 23:49:05.681443+00:00, run_duration=5.242685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:48:00+00:00, data_interval_end=2024-04-04 23:49:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:49:05.693771618Z [2024-04-04T23:49:05.693+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:49:00+00:00, run_after=2024-04-04T23:50:00+00:00 2024-04-04T23:49:05.729043500Z [2024-04-04T23:49:05.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:48:00+00:00 exited with status success for try_number 1 2024-04-04T23:49:05.729263015Z [2024-04-04T23:49:05.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:48:00+00:00 exited with status success for try_number 1 2024-04-04T23:49:05.740935471Z [2024-04-04T23:49:05.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:48:00+00:00, map_index=-1, run_start_date=2024-04-04 23:49:03.350715+00:00, run_end_date=2024-04-04 23:49:05.370569+00:00, run_duration=2.019854, state=success, executor_state=success, try_number=1, max_tries=1, job_id=363, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:49:00.494558+00:00, queued_by_job_id=1, pid=5364 2024-04-04T23:49:05.741009915Z [2024-04-04T23:49:05.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:48:00+00:00, map_index=-1, run_start_date=2024-04-04 23:49:03.819757+00:00, run_end_date=2024-04-04 23:49:05.397067+00:00, run_duration=1.57731, state=success, executor_state=success, try_number=1, max_tries=1, job_id=364, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:49:00.494558+00:00, queued_by_job_id=1, pid=5375 2024-04-04T23:50:00.299693462Z [2024-04-04T23:50:00.299+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:50:00+00:00, run_after=2024-04-04T23:51:00+00:00 2024-04-04T23:50:00.310592809Z [2024-04-04T23:50:00.310+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:50:00.324597842Z [2024-04-04T23:50:00.324+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:50:00+00:00, run_after=2024-04-04T23:51:00+00:00 2024-04-04T23:50:00.331425719Z [2024-04-04T23:50:00.331+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:50:00.342024852Z [2024-04-04T23:50:00.341+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:50:00+00:00, run_after=2024-04-04T23:55:00+00:00 2024-04-04T23:50:00.424190831Z [2024-04-04T23:50:00.423+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-04T23:50:00.424214350Z 2024-04-04T23:50:00.424231882Z 2024-04-04T23:50:00.424238589Z 2024-04-04T23:50:00.424242113Z 2024-04-04T23:50:00.424245312Z 2024-04-04T23:50:00.424260233Z [2024-04-04T23:50:00.424+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:50:00.424398872Z [2024-04-04T23:50:00.424+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:50:00.424461403Z [2024-04-04T23:50:00.424+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:50:00.424589199Z [2024-04-04T23:50:00.424+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:50:00.424649293Z [2024-04-04T23:50:00.424+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:50:00.425183343Z [2024-04-04T23:50:00.425+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:50:00.425194341Z 2024-04-04T23:50:00.425198708Z 2024-04-04T23:50:00.425202551Z 2024-04-04T23:50:00.425205651Z 2024-04-04T23:50:00.425208856Z 2024-04-04T23:50:00.428979059Z [2024-04-04T23:50:00.428+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T23:50:00.429046105Z [2024-04-04T23:50:00.428+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:50:00.429223200Z [2024-04-04T23:50:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:50:00.429295921Z [2024-04-04T23:50:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:50:00.429552193Z [2024-04-04T23:50:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:50:00.429617761Z [2024-04-04T23:50:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:50:00.429784502Z [2024-04-04T23:50:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:50:00.429851940Z [2024-04-04T23:50:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:50:00.430030863Z [2024-04-04T23:50:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:50:00.430103235Z [2024-04-04T23:50:00.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:50:01.162133538Z [2024-04-04T23:50:01.161+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:45:00+00:00 exited with status queued for try_number 1 2024-04-04T23:50:01.179937227Z [2024-04-04T23:50:01.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:48:00+00:00 exited with status queued for try_number 1 2024-04-04T23:50:01.180479740Z [2024-04-04T23:50:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:49:00+00:00 exited with status queued for try_number 1 2024-04-04T23:50:01.180776863Z [2024-04-04T23:50:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:49:00+00:00 exited with status queued for try_number 1 2024-04-04T23:50:01.181018474Z [2024-04-04T23:50:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:49:00+00:00 exited with status queued for try_number 1 2024-04-04T23:50:01.241166561Z [2024-04-04T23:50:01.237+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d9ba40b-77f5-425f-911b-06cfa513b1df 2024-04-04T23:50:01.244233144Z [2024-04-04T23:50:01.243+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99f9982c-6313-4a3d-a141-79179325e8a5 2024-04-04T23:50:01.246764762Z [2024-04-04T23:50:01.246+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f018df7-3d24-4298-a56d-1180584c4898 2024-04-04T23:50:01.258095596Z [2024-04-04T23:50:01.257+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9df25df-25bb-4c01-93d7-f87518462f46 2024-04-04T23:50:01.302891825Z [2024-04-04T23:50:01.302+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc7d69cb-ffb4-4382-8a66-3294f92e7758 2024-04-04T23:50:03.283434774Z [2024-04-04T23:50:03.282+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:50:03.284026770Z [2024-04-04T23:50:03.283+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:49:00+00:00, run_id=scheduled__2024-04-04T23:49:00+00:00, run_start_date=2024-04-04 23:50:00.354617+00:00, run_end_date=2024-04-04 23:50:03.283430+00:00, run_duration=2.928813, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:49:00+00:00, data_interval_end=2024-04-04 23:50:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:50:03.297790423Z [2024-04-04T23:50:03.297+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:50:00+00:00, run_after=2024-04-04T23:51:00+00:00 2024-04-04T23:50:04.549549460Z [2024-04-04T23:50:04.549+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:50:04.550054278Z [2024-04-04T23:50:04.549+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:48:00+00:00, run_id=scheduled__2024-04-04T23:48:00+00:00, run_start_date=2024-04-04 23:50:00.353634+00:00, run_end_date=2024-04-04 23:50:04.549468+00:00, run_duration=4.195834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:48:00+00:00, data_interval_end=2024-04-04 23:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:50:04.559634984Z [2024-04-04T23:50:04.559+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:50:00+00:00, run_after=2024-04-04T23:52:00+00:00 2024-04-04T23:50:04.730199236Z [2024-04-04T23:50:04.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:48:00+00:00 exited with status success for try_number 1 2024-04-04T23:50:04.730231988Z [2024-04-04T23:50:04.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:49:00+00:00 exited with status success for try_number 1 2024-04-04T23:50:04.737289074Z [2024-04-04T23:50:04.735+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:49:00+00:00, map_index=-1, run_start_date=2024-04-04 23:50:02.642150+00:00, run_end_date=2024-04-04 23:50:03.216131+00:00, run_duration=0.573981, state=success, executor_state=success, try_number=1, max_tries=1, job_id=365, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:50:00.426071+00:00, queued_by_job_id=1, pid=5405 2024-04-04T23:50:04.737308342Z [2024-04-04T23:50:04.735+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:48:00+00:00, map_index=-1, run_start_date=2024-04-04 23:50:02.879723+00:00, run_end_date=2024-04-04 23:50:03.564056+00:00, run_duration=0.684333, state=success, executor_state=success, try_number=1, max_tries=1, job_id=366, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:50:00.426071+00:00, queued_by_job_id=1, pid=5406 2024-04-04T23:50:05.789419419Z [2024-04-04T23:50:05.788+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:50:05.789850785Z [2024-04-04T23:50:05.789+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:49:00+00:00, run_id=scheduled__2024-04-04T23:49:00+00:00, run_start_date=2024-04-04 23:50:00.355620+00:00, run_end_date=2024-04-04 23:50:05.789375+00:00, run_duration=5.433755, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:49:00+00:00, data_interval_end=2024-04-04 23:50:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:50:05.808185995Z [2024-04-04T23:50:05.807+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:50:00+00:00, run_after=2024-04-04T23:51:00+00:00 2024-04-04T23:50:05.818688023Z [2024-04-04T23:50:05.818+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:50:05.818886257Z [2024-04-04T23:50:05.818+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:49:00+00:00, run_id=scheduled__2024-04-04T23:49:00+00:00, run_start_date=2024-04-04 23:50:00.357275+00:00, run_end_date=2024-04-04 23:50:05.818488+00:00, run_duration=5.461213, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:49:00+00:00, data_interval_end=2024-04-04 23:50:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:50:05.830036868Z [2024-04-04T23:50:05.829+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:50:00+00:00, run_after=2024-04-04T23:51:00+00:00 2024-04-04T23:50:05.878842234Z [2024-04-04T23:50:05.878+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:50:05.878856552Z 2024-04-04T23:50:05.879062020Z [2024-04-04T23:50:05.878+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:50:05.879871049Z [2024-04-04T23:50:05.879+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:50:05.879884221Z 2024-04-04T23:50:05.882667771Z [2024-04-04T23:50:05.882+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-04T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T23:50:05.882917244Z [2024-04-04T23:50:05.882+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-04T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:50:05.964978068Z [2024-04-04T23:50:05.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:45:00+00:00 exited with status queued for try_number 1 2024-04-04T23:50:05.965064311Z [2024-04-04T23:50:05.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:45:00+00:00 exited with status success for try_number 1 2024-04-04T23:50:05.965213268Z [2024-04-04T23:50:05.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:49:00+00:00 exited with status success for try_number 1 2024-04-04T23:50:05.977129186Z [2024-04-04T23:50:05.976+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:49:00+00:00, map_index=-1, run_start_date=2024-04-04 23:50:03.842589+00:00, run_end_date=2024-04-04 23:50:05.443475+00:00, run_duration=1.600886, state=success, executor_state=success, try_number=1, max_tries=1, job_id=367, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:50:00.426071+00:00, queued_by_job_id=1, pid=5429 2024-04-04T23:50:05.977440286Z [2024-04-04T23:50:05.977+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T23:45:00+00:00, map_index=-1, run_start_date=2024-04-04 23:50:04.081828+00:00, run_end_date=2024-04-04 23:50:04.579493+00:00, run_duration=0.497665, state=success, executor_state=success, try_number=1, max_tries=1, job_id=368, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:50:00.426071+00:00, queued_by_job_id=1, pid=5430 2024-04-04T23:50:05.977735225Z [2024-04-04T23:50:05.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17294a24-b112-4628-b14d-52d06ec1c11d 2024-04-04T23:50:06.118719011Z [2024-04-04T23:50:06.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:49:00+00:00 exited with status success for try_number 1 2024-04-04T23:50:06.124159208Z [2024-04-04T23:50:06.123+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:49:00+00:00, map_index=-1, run_start_date=2024-04-04 23:50:04.432069+00:00, run_end_date=2024-04-04 23:50:05.747881+00:00, run_duration=1.315812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=369, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:50:00.426071+00:00, queued_by_job_id=1, pid=5441 2024-04-04T23:50:08.540594808Z [2024-04-04T23:50:08.540+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:50:08.540646526Z 2024-04-04T23:50:08.540671039Z [2024-04-04T23:50:08.540+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:50:08.541266052Z [2024-04-04T23:50:08.541+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:50:08.541275924Z 2024-04-04T23:50:08.544285551Z [2024-04-04T23:50:08.543+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-04T23:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T23:50:08.544401842Z [2024-04-04T23:50:08.544+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-04T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T23:50:08.596942436Z [2024-04-04T23:50:08.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:45:00+00:00 exited with status queued for try_number 1 2024-04-04T23:50:08.597072195Z [2024-04-04T23:50:08.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:45:00+00:00 exited with status success for try_number 1 2024-04-04T23:50:08.602570829Z [2024-04-04T23:50:08.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a4e6566-599a-4b96-a5ae-55148f1b895b 2024-04-04T23:50:08.602901152Z [2024-04-04T23:50:08.602+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-04T23:45:00+00:00, map_index=-1, run_start_date=2024-04-04 23:50:07.696324+00:00, run_end_date=2024-04-04 23:50:08.094728+00:00, run_duration=0.398404, state=success, executor_state=success, try_number=1, max_tries=1, job_id=370, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:50:05.880311+00:00, queued_by_job_id=1, pid=5459 2024-04-04T23:50:10.874670451Z [2024-04-04T23:50:10.874+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:50:10.874717236Z 2024-04-04T23:50:10.874733119Z [2024-04-04T23:50:10.874+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:50:10.875758971Z [2024-04-04T23:50:10.875+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:50:10.875776455Z 2024-04-04T23:50:10.879475007Z [2024-04-04T23:50:10.879+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-04T23:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:50:10.879707776Z [2024-04-04T23:50:10.879+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-04T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:50:10.948912521Z [2024-04-04T23:50:10.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:45:00+00:00 exited with status queued for try_number 1 2024-04-04T23:50:10.949116177Z [2024-04-04T23:50:10.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:45:00+00:00 exited with status success for try_number 1 2024-04-04T23:50:10.960619831Z [2024-04-04T23:50:10.959+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b95722c-befd-49a7-88e4-95b575905331 2024-04-04T23:50:10.961393957Z [2024-04-04T23:50:10.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-04T23:45:00+00:00, map_index=0, run_start_date=2024-04-04 23:50:10.170637+00:00, run_end_date=2024-04-04 23:50:10.543901+00:00, run_duration=0.373264, state=success, executor_state=success, try_number=1, max_tries=1, job_id=371, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:50:08.541622+00:00, queued_by_job_id=1, pid=5477 2024-04-04T23:50:13.671854710Z [2024-04-04T23:50:13.670+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:50:13.672199923Z [2024-04-04T23:50:13.671+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:45:00+00:00, run_id=scheduled__2024-04-04T23:45:00+00:00, run_start_date=2024-04-04 23:50:00.352298+00:00, run_end_date=2024-04-04 23:50:13.671747+00:00, run_duration=13.319449, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:45:00+00:00, data_interval_end=2024-04-04 23:50:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-04T23:50:13.679901343Z [2024-04-04T23:50:13.679+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:50:00+00:00, run_after=2024-04-04T23:55:00+00:00 2024-04-04T23:50:13.722801369Z [2024-04-04T23:50:13.722+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:45:00+00:00 exited with status success for try_number 1 2024-04-04T23:50:13.732109648Z [2024-04-04T23:50:13.730+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-04T23:45:00+00:00, map_index=-1, run_start_date=2024-04-04 23:50:12.876210+00:00, run_end_date=2024-04-04 23:50:13.278013+00:00, run_duration=0.401803, state=success, executor_state=success, try_number=1, max_tries=1, job_id=372, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:50:10.876236+00:00, queued_by_job_id=1, pid=5488 2024-04-04T23:50:39.977278938Z [2024-04-04T23:50:39.976+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-04T23:51:00.375658142Z [2024-04-04T23:51:00.375+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:51:00+00:00, run_after=2024-04-04T23:52:00+00:00 2024-04-04T23:51:00.383508980Z [2024-04-04T23:51:00.383+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:51:00.403066304Z [2024-04-04T23:51:00.402+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:51:00+00:00, run_after=2024-04-04T23:52:00+00:00 2024-04-04T23:51:00.478985174Z [2024-04-04T23:51:00.478+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:51:00.479014626Z 2024-04-04T23:51:00.479019864Z 2024-04-04T23:51:00.479025235Z 2024-04-04T23:51:00.479038627Z [2024-04-04T23:51:00.478+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:51:00.479135331Z [2024-04-04T23:51:00.478+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:51:00.479202424Z [2024-04-04T23:51:00.479+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:51:00.479933273Z [2024-04-04T23:51:00.479+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:51:00.479950161Z 2024-04-04T23:51:00.479955470Z 2024-04-04T23:51:00.479960354Z 2024-04-04T23:51:00.483817225Z [2024-04-04T23:51:00.483+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:51:00.483893125Z [2024-04-04T23:51:00.483+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:51:00.484080040Z [2024-04-04T23:51:00.483+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:51:00.484131025Z [2024-04-04T23:51:00.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:51:00.484317433Z [2024-04-04T23:51:00.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:51:00.484383283Z [2024-04-04T23:51:00.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:51:00.788845706Z [2024-04-04T23:51:00.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:50:00+00:00 exited with status queued for try_number 1 2024-04-04T23:51:00.788876274Z [2024-04-04T23:51:00.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:50:00+00:00 exited with status queued for try_number 1 2024-04-04T23:51:00.788937123Z [2024-04-04T23:51:00.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:50:00+00:00 exited with status queued for try_number 1 2024-04-04T23:51:00.837112789Z [2024-04-04T23:51:00.836+0000] {scheduler_job.py:635} INFO - Setting external_id for to 210f0534-562c-45ac-bd73-18a985a16537 2024-04-04T23:51:00.840002039Z [2024-04-04T23:51:00.839+0000] {scheduler_job.py:635} INFO - Setting external_id for to 620ed740-bb2b-408c-87c1-d4bbc5b80865 2024-04-04T23:51:00.840159092Z [2024-04-04T23:51:00.839+0000] {scheduler_job.py:635} INFO - Setting external_id for to c72bb618-e466-4890-905a-4259df1f56b3 2024-04-04T23:51:02.782490189Z [2024-04-04T23:51:02.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:51:02.782937045Z [2024-04-04T23:51:02.782+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:50:00+00:00, run_id=scheduled__2024-04-04T23:50:00+00:00, run_start_date=2024-04-04 23:51:00.417737+00:00, run_end_date=2024-04-04 23:51:02.782485+00:00, run_duration=2.364748, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:50:00+00:00, data_interval_end=2024-04-04 23:51:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:51:02.797074751Z [2024-04-04T23:51:02.796+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:51:00+00:00, run_after=2024-04-04T23:52:00+00:00 2024-04-04T23:51:02.848017693Z [2024-04-04T23:51:02.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:50:00+00:00 exited with status success for try_number 1 2024-04-04T23:51:02.853432348Z [2024-04-04T23:51:02.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:50:00+00:00, map_index=-1, run_start_date=2024-04-04 23:51:01.886797+00:00, run_end_date=2024-04-04 23:51:02.332631+00:00, run_duration=0.445834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=373, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:51:00.480629+00:00, queued_by_job_id=1, pid=5497 2024-04-04T23:51:05.486493657Z [2024-04-04T23:51:05.486+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:51:05.486634703Z [2024-04-04T23:51:05.486+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:50:00+00:00, run_id=scheduled__2024-04-04T23:50:00+00:00, run_start_date=2024-04-04 23:51:00.419366+00:00, run_end_date=2024-04-04 23:51:05.486405+00:00, run_duration=5.067039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:50:00+00:00, data_interval_end=2024-04-04 23:51:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:51:05.496452070Z [2024-04-04T23:51:05.496+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:51:00+00:00, run_after=2024-04-04T23:52:00+00:00 2024-04-04T23:51:05.503141003Z [2024-04-04T23:51:05.502+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:51:05.503259282Z [2024-04-04T23:51:05.503+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:50:00+00:00, run_id=scheduled__2024-04-04T23:50:00+00:00, run_start_date=2024-04-04 23:51:00.420714+00:00, run_end_date=2024-04-04 23:51:05.503005+00:00, run_duration=5.082291, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:50:00+00:00, data_interval_end=2024-04-04 23:51:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:51:05.512276914Z [2024-04-04T23:51:05.511+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:51:00+00:00, run_after=2024-04-04T23:52:00+00:00 2024-04-04T23:51:05.553126957Z [2024-04-04T23:51:05.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:50:00+00:00 exited with status success for try_number 1 2024-04-04T23:51:05.553193455Z [2024-04-04T23:51:05.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:50:00+00:00 exited with status success for try_number 1 2024-04-04T23:51:05.562055322Z [2024-04-04T23:51:05.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:50:00+00:00, map_index=-1, run_start_date=2024-04-04 23:51:03.040049+00:00, run_end_date=2024-04-04 23:51:05.019420+00:00, run_duration=1.979371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=375, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:51:00.480629+00:00, queued_by_job_id=1, pid=5516 2024-04-04T23:51:05.562222872Z [2024-04-04T23:51:05.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:50:00+00:00, map_index=-1, run_start_date=2024-04-04 23:51:02.985184+00:00, run_end_date=2024-04-04 23:51:05.332505+00:00, run_duration=2.347321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=374, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:51:00.480629+00:00, queued_by_job_id=1, pid=5515 2024-04-04T23:52:00.114281822Z [2024-04-04T23:52:00.113+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:52:00+00:00, run_after=2024-04-04T23:53:00+00:00 2024-04-04T23:52:00.122017807Z [2024-04-04T23:52:00.121+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:52:00.129805217Z [2024-04-04T23:52:00.129+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:52:00.143324178Z [2024-04-04T23:52:00.143+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:52:00+00:00, run_after=2024-04-04T23:53:00+00:00 2024-04-04T23:52:00.255404829Z [2024-04-04T23:52:00.254+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:52:00.255431089Z 2024-04-04T23:52:00.255443002Z 2024-04-04T23:52:00.255447806Z 2024-04-04T23:52:00.255452177Z 2024-04-04T23:52:00.255901832Z [2024-04-04T23:52:00.255+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:52:00.256223707Z [2024-04-04T23:52:00.256+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:52:00.256495466Z [2024-04-04T23:52:00.256+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:52:00.256770875Z [2024-04-04T23:52:00.256+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:52:00.257726194Z [2024-04-04T23:52:00.257+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:52:00.257740585Z 2024-04-04T23:52:00.257745264Z 2024-04-04T23:52:00.257749347Z 2024-04-04T23:52:00.257753923Z 2024-04-04T23:52:00.262094593Z [2024-04-04T23:52:00.261+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:52:00.262363044Z [2024-04-04T23:52:00.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:52:00.262786531Z [2024-04-04T23:52:00.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:52:00.263040195Z [2024-04-04T23:52:00.262+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:52:00.263370263Z [2024-04-04T23:52:00.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:52:00.263601787Z [2024-04-04T23:52:00.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:52:00.263896858Z [2024-04-04T23:52:00.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:52:00.264090886Z [2024-04-04T23:52:00.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:52:00.790638348Z [2024-04-04T23:52:00.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:50:00+00:00 exited with status queued for try_number 1 2024-04-04T23:52:00.796024622Z [2024-04-04T23:52:00.795+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:51:00+00:00 exited with status queued for try_number 1 2024-04-04T23:52:00.796121261Z [2024-04-04T23:52:00.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:51:00+00:00 exited with status queued for try_number 1 2024-04-04T23:52:00.796235053Z [2024-04-04T23:52:00.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:51:00+00:00 exited with status queued for try_number 1 2024-04-04T23:52:00.814639751Z [2024-04-04T23:52:00.814+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54ee4e17-17b8-411b-b59f-e9deef4c4557 2024-04-04T23:52:00.815696616Z [2024-04-04T23:52:00.815+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62fdb12e-46d2-4f67-8f61-effd4178ede3 2024-04-04T23:52:00.820009414Z [2024-04-04T23:52:00.819+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c0827a4-7ee7-46d4-bab2-931b7205976f 2024-04-04T23:52:00.820149954Z [2024-04-04T23:52:00.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 038403f5-9f9b-4e4d-b73a-99f77dfaa5a4 2024-04-04T23:52:02.282035960Z [2024-04-04T23:52:02.281+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:52:02.282205280Z [2024-04-04T23:52:02.282+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:51:00+00:00, run_id=scheduled__2024-04-04T23:51:00+00:00, run_start_date=2024-04-04 23:52:00.157093+00:00, run_end_date=2024-04-04 23:52:02.281910+00:00, run_duration=2.124817, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:51:00+00:00, data_interval_end=2024-04-04 23:52:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:52:02.295693215Z [2024-04-04T23:52:02.295+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:52:00+00:00, run_after=2024-04-04T23:53:00+00:00 2024-04-04T23:52:03.120906870Z [2024-04-04T23:52:03.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:52:03.121627324Z [2024-04-04T23:52:03.121+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:50:00+00:00, run_id=scheduled__2024-04-04T23:50:00+00:00, run_start_date=2024-04-04 23:52:00.155839+00:00, run_end_date=2024-04-04 23:52:03.120806+00:00, run_duration=2.964967, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:50:00+00:00, data_interval_end=2024-04-04 23:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:52:03.135720849Z [2024-04-04T23:52:03.135+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:52:00+00:00, run_after=2024-04-04T23:54:00+00:00 2024-04-04T23:52:03.224073936Z [2024-04-04T23:52:03.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:50:00+00:00 exited with status success for try_number 1 2024-04-04T23:52:03.224352506Z [2024-04-04T23:52:03.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:51:00+00:00 exited with status success for try_number 1 2024-04-04T23:52:03.237489448Z [2024-04-04T23:52:03.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:50:00+00:00, map_index=-1, run_start_date=2024-04-04 23:52:02.099463+00:00, run_end_date=2024-04-04 23:52:02.557508+00:00, run_duration=0.458045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=377, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:52:00.259238+00:00, queued_by_job_id=1, pid=5556 2024-04-04T23:52:03.237879028Z [2024-04-04T23:52:03.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:51:00+00:00, map_index=-1, run_start_date=2024-04-04 23:52:01.738672+00:00, run_end_date=2024-04-04 23:52:02.197627+00:00, run_duration=0.458955, state=success, executor_state=success, try_number=1, max_tries=1, job_id=376, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:52:00.259238+00:00, queued_by_job_id=1, pid=5549 2024-04-04T23:52:04.296052147Z [2024-04-04T23:52:04.295+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:52:04.296457937Z [2024-04-04T23:52:04.296+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:51:00+00:00, run_id=scheduled__2024-04-04T23:51:00+00:00, run_start_date=2024-04-04 23:52:00.158096+00:00, run_end_date=2024-04-04 23:52:04.295899+00:00, run_duration=4.137803, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:51:00+00:00, data_interval_end=2024-04-04 23:52:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:52:04.315213223Z [2024-04-04T23:52:04.314+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:52:00+00:00, run_after=2024-04-04T23:53:00+00:00 2024-04-04T23:52:05.409457739Z [2024-04-04T23:52:05.408+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:52:05.409567627Z [2024-04-04T23:52:05.409+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:51:00+00:00, run_id=scheduled__2024-04-04T23:51:00+00:00, run_start_date=2024-04-04 23:52:00.159049+00:00, run_end_date=2024-04-04 23:52:05.409166+00:00, run_duration=5.250117, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:51:00+00:00, data_interval_end=2024-04-04 23:52:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:52:05.421666380Z [2024-04-04T23:52:05.421+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:52:00+00:00, run_after=2024-04-04T23:53:00+00:00 2024-04-04T23:52:05.453199953Z [2024-04-04T23:52:05.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:51:00+00:00 exited with status success for try_number 1 2024-04-04T23:52:05.453383853Z [2024-04-04T23:52:05.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:51:00+00:00 exited with status success for try_number 1 2024-04-04T23:52:05.459872641Z [2024-04-04T23:52:05.459+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:51:00+00:00, map_index=-1, run_start_date=2024-04-04 23:52:02.906444+00:00, run_end_date=2024-04-04 23:52:04.227359+00:00, run_duration=1.320915, state=success, executor_state=success, try_number=1, max_tries=1, job_id=378, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:52:00.259238+00:00, queued_by_job_id=1, pid=5573 2024-04-04T23:52:05.460288865Z [2024-04-04T23:52:05.460+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:51:00+00:00, map_index=-1, run_start_date=2024-04-04 23:52:03.133491+00:00, run_end_date=2024-04-04 23:52:04.736984+00:00, run_duration=1.603493, state=success, executor_state=success, try_number=1, max_tries=1, job_id=379, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:52:00.259238+00:00, queued_by_job_id=1, pid=5574 2024-04-04T23:53:00.786473944Z [2024-04-04T23:53:00.785+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:53:00.811199978Z [2024-04-04T23:53:00.810+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:53:00+00:00, run_after=2024-04-04T23:54:00+00:00 2024-04-04T23:53:00.827466482Z [2024-04-04T23:53:00.826+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:53:00+00:00, run_after=2024-04-04T23:54:00+00:00 2024-04-04T23:53:00.909079808Z [2024-04-04T23:53:00.908+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:53:00.909114236Z 2024-04-04T23:53:00.909118111Z 2024-04-04T23:53:00.909121513Z 2024-04-04T23:53:00.909473962Z [2024-04-04T23:53:00.909+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:53:00.909686929Z [2024-04-04T23:53:00.909+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:53:00.909860428Z [2024-04-04T23:53:00.909+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:53:00.910517786Z [2024-04-04T23:53:00.910+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:53:00.910526350Z 2024-04-04T23:53:00.910530004Z 2024-04-04T23:53:00.910533807Z 2024-04-04T23:53:00.924607178Z [2024-04-04T23:53:00.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:53:00.924856633Z [2024-04-04T23:53:00.924+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:53:00.925165649Z [2024-04-04T23:53:00.925+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:53:00.925348705Z [2024-04-04T23:53:00.925+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:53:00.925622784Z [2024-04-04T23:53:00.925+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:53:00.925802509Z [2024-04-04T23:53:00.925+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:53:01.745738851Z [2024-04-04T23:53:01.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:52:00+00:00 exited with status queued for try_number 1 2024-04-04T23:53:01.745942384Z [2024-04-04T23:53:01.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:52:00+00:00 exited with status queued for try_number 1 2024-04-04T23:53:01.746120375Z [2024-04-04T23:53:01.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:52:00+00:00 exited with status queued for try_number 1 2024-04-04T23:53:01.763073353Z [2024-04-04T23:53:01.762+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb18b809-d8fa-4f2d-bf5f-a1d9b0d26950 2024-04-04T23:53:01.763186336Z [2024-04-04T23:53:01.763+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b9b6bfd-503f-4aa3-81d2-0336d6b4e72a 2024-04-04T23:53:01.763332802Z [2024-04-04T23:53:01.763+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88ba7ae1-9b77-43a9-97c7-737aa85fc20a 2024-04-04T23:53:04.591953031Z [2024-04-04T23:53:04.591+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:53:04.592673048Z [2024-04-04T23:53:04.592+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:52:00+00:00, run_id=scheduled__2024-04-04T23:52:00+00:00, run_start_date=2024-04-04 23:53:00.838410+00:00, run_end_date=2024-04-04 23:53:04.592137+00:00, run_duration=3.753727, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:52:00+00:00, data_interval_end=2024-04-04 23:53:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:53:04.614807818Z [2024-04-04T23:53:04.614+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:53:00+00:00, run_after=2024-04-04T23:54:00+00:00 2024-04-04T23:53:04.748433610Z [2024-04-04T23:53:04.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:52:00+00:00 exited with status success for try_number 1 2024-04-04T23:53:04.763201288Z [2024-04-04T23:53:04.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:52:00+00:00, map_index=-1, run_start_date=2024-04-04 23:53:03.258044+00:00, run_end_date=2024-04-04 23:53:03.895581+00:00, run_duration=0.637537, state=success, executor_state=success, try_number=1, max_tries=1, job_id=380, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:53:00.916563+00:00, queued_by_job_id=1, pid=5605 2024-04-04T23:53:06.897765798Z [2024-04-04T23:53:06.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:53:06.898410265Z [2024-04-04T23:53:06.898+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:52:00+00:00, run_id=scheduled__2024-04-04T23:52:00+00:00, run_start_date=2024-04-04 23:53:00.839758+00:00, run_end_date=2024-04-04 23:53:06.897834+00:00, run_duration=6.058076, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:52:00+00:00, data_interval_end=2024-04-04 23:53:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:53:06.919924983Z [2024-04-04T23:53:06.919+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:53:00+00:00, run_after=2024-04-04T23:54:00+00:00 2024-04-04T23:53:07.125527974Z [2024-04-04T23:53:07.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:52:00+00:00 exited with status success for try_number 1 2024-04-04T23:53:07.136778643Z [2024-04-04T23:53:07.136+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:52:00+00:00, map_index=-1, run_start_date=2024-04-04 23:53:05.158154+00:00, run_end_date=2024-04-04 23:53:06.692617+00:00, run_duration=1.534463, state=success, executor_state=success, try_number=1, max_tries=1, job_id=382, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:53:00.916563+00:00, queued_by_job_id=1, pid=5629 2024-04-04T23:53:07.587688705Z [2024-04-04T23:53:07.587+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:53:07.588050202Z [2024-04-04T23:53:07.587+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:52:00+00:00, run_id=scheduled__2024-04-04T23:52:00+00:00, run_start_date=2024-04-04 23:53:00.840937+00:00, run_end_date=2024-04-04 23:53:07.587586+00:00, run_duration=6.746649, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:52:00+00:00, data_interval_end=2024-04-04 23:53:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:53:07.597551352Z [2024-04-04T23:53:07.597+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:53:00+00:00, run_after=2024-04-04T23:54:00+00:00 2024-04-04T23:53:07.652185498Z [2024-04-04T23:53:07.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:52:00+00:00 exited with status success for try_number 1 2024-04-04T23:53:07.657362161Z [2024-04-04T23:53:07.657+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:52:00+00:00, map_index=-1, run_start_date=2024-04-04 23:53:04.650297+00:00, run_end_date=2024-04-04 23:53:07.378713+00:00, run_duration=2.728416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=381, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:53:00.916563+00:00, queued_by_job_id=1, pid=5618 2024-04-04T23:54:00.051524878Z [2024-04-04T23:54:00.051+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:54:00+00:00, run_after=2024-04-04T23:55:00+00:00 2024-04-04T23:54:00.090993218Z [2024-04-04T23:54:00.090+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:54:00+00:00, run_after=2024-04-04T23:55:00+00:00 2024-04-04T23:54:00.120113770Z [2024-04-04T23:54:00.119+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:54:00.137988250Z [2024-04-04T23:54:00.137+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:54:00.211443600Z [2024-04-04T23:54:00.211+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:54:00.211468593Z 2024-04-04T23:54:00.211475602Z 2024-04-04T23:54:00.211478895Z 2024-04-04T23:54:00.211482197Z 2024-04-04T23:54:00.211681861Z [2024-04-04T23:54:00.211+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:54:00.211876965Z [2024-04-04T23:54:00.211+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:54:00.212037451Z [2024-04-04T23:54:00.211+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:54:00.212185194Z [2024-04-04T23:54:00.212+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:54:00.212973807Z [2024-04-04T23:54:00.212+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:54:00.212997545Z 2024-04-04T23:54:00.213001086Z 2024-04-04T23:54:00.213004202Z 2024-04-04T23:54:00.213007288Z 2024-04-04T23:54:00.216280307Z [2024-04-04T23:54:00.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:54:00.216530013Z [2024-04-04T23:54:00.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:54:00.216886576Z [2024-04-04T23:54:00.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:54:00.217097707Z [2024-04-04T23:54:00.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:54:00.217389845Z [2024-04-04T23:54:00.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:54:00.217580368Z [2024-04-04T23:54:00.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:54:00.217925858Z [2024-04-04T23:54:00.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:54:00.218084300Z [2024-04-04T23:54:00.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:54:00.712628839Z [2024-04-04T23:54:00.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:52:00+00:00 exited with status queued for try_number 1 2024-04-04T23:54:00.712675855Z [2024-04-04T23:54:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:53:00+00:00 exited with status queued for try_number 1 2024-04-04T23:54:00.712714400Z [2024-04-04T23:54:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:53:00+00:00 exited with status queued for try_number 1 2024-04-04T23:54:00.712789693Z [2024-04-04T23:54:00.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:53:00+00:00 exited with status queued for try_number 1 2024-04-04T23:54:00.726162375Z [2024-04-04T23:54:00.725+0000] {scheduler_job.py:635} INFO - Setting external_id for to 740a2a38-593b-4ea3-b17c-75d70204b8c0 2024-04-04T23:54:00.726190413Z [2024-04-04T23:54:00.726+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3034f6bc-6ba3-4c77-8b78-a03def1bbbfc 2024-04-04T23:54:00.726314843Z [2024-04-04T23:54:00.726+0000] {scheduler_job.py:635} INFO - Setting external_id for to 245adb9f-f2ca-4cbd-aa65-2174b01a7b6e 2024-04-04T23:54:00.726407780Z [2024-04-04T23:54:00.726+0000] {scheduler_job.py:635} INFO - Setting external_id for to 295fb01f-bbe1-458c-ab5e-6d8b106d142a 2024-04-04T23:54:02.140033083Z [2024-04-04T23:54:02.139+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:54:02.140977491Z [2024-04-04T23:54:02.140+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:53:00+00:00, run_id=scheduled__2024-04-04T23:53:00+00:00, run_start_date=2024-04-04 23:54:00.149777+00:00, run_end_date=2024-04-04 23:54:02.140130+00:00, run_duration=1.990353, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:53:00+00:00, data_interval_end=2024-04-04 23:54:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:54:02.178683129Z [2024-04-04T23:54:02.178+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:54:00+00:00, run_after=2024-04-04T23:55:00+00:00 2024-04-04T23:54:03.014451964Z [2024-04-04T23:54:03.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:54:03.014829183Z [2024-04-04T23:54:03.014+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:52:00+00:00, run_id=scheduled__2024-04-04T23:52:00+00:00, run_start_date=2024-04-04 23:54:00.148397+00:00, run_end_date=2024-04-04 23:54:03.014353+00:00, run_duration=2.865956, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:52:00+00:00, data_interval_end=2024-04-04 23:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:54:03.035154908Z [2024-04-04T23:54:03.034+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:54:00+00:00, run_after=2024-04-04T23:56:00+00:00 2024-04-04T23:54:03.128129286Z [2024-04-04T23:54:03.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:52:00+00:00 exited with status success for try_number 1 2024-04-04T23:54:03.128735814Z [2024-04-04T23:54:03.128+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:53:00+00:00 exited with status success for try_number 1 2024-04-04T23:54:03.138500381Z [2024-04-04T23:54:03.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:53:00+00:00, map_index=-1, run_start_date=2024-04-04 23:54:01.197546+00:00, run_end_date=2024-04-04 23:54:01.971304+00:00, run_duration=0.773758, state=success, executor_state=success, try_number=1, max_tries=1, job_id=383, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:54:00.213862+00:00, queued_by_job_id=1, pid=5657 2024-04-04T23:54:03.138775570Z [2024-04-04T23:54:03.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:52:00+00:00, map_index=-1, run_start_date=2024-04-04 23:54:01.529576+00:00, run_end_date=2024-04-04 23:54:02.412443+00:00, run_duration=0.882867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=384, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:54:00.213862+00:00, queued_by_job_id=1, pid=5663 2024-04-04T23:54:04.847174753Z [2024-04-04T23:54:04.846+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:54:04.847839168Z [2024-04-04T23:54:04.847+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:53:00+00:00, run_id=scheduled__2024-04-04T23:53:00+00:00, run_start_date=2024-04-04 23:54:00.151064+00:00, run_end_date=2024-04-04 23:54:04.847039+00:00, run_duration=4.695975, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:53:00+00:00, data_interval_end=2024-04-04 23:54:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:54:04.866210107Z [2024-04-04T23:54:04.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:54:00+00:00, run_after=2024-04-04T23:55:00+00:00 2024-04-04T23:54:04.915779453Z [2024-04-04T23:54:04.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:53:00+00:00 exited with status success for try_number 1 2024-04-04T23:54:04.921241612Z [2024-04-04T23:54:04.920+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:53:00+00:00, map_index=-1, run_start_date=2024-04-04 23:54:03.154459+00:00, run_end_date=2024-04-04 23:54:04.411743+00:00, run_duration=1.257284, state=success, executor_state=success, try_number=1, max_tries=1, job_id=385, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:54:00.213862+00:00, queued_by_job_id=1, pid=5681 2024-04-04T23:54:05.972505414Z [2024-04-04T23:54:05.971+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:54:05.973457663Z [2024-04-04T23:54:05.972+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:53:00+00:00, run_id=scheduled__2024-04-04T23:53:00+00:00, run_start_date=2024-04-04 23:54:00.152260+00:00, run_end_date=2024-04-04 23:54:05.972362+00:00, run_duration=5.820102, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:53:00+00:00, data_interval_end=2024-04-04 23:54:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:54:05.983179975Z [2024-04-04T23:54:05.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:54:00+00:00, run_after=2024-04-04T23:55:00+00:00 2024-04-04T23:54:06.020331209Z [2024-04-04T23:54:06.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:53:00+00:00 exited with status success for try_number 1 2024-04-04T23:54:06.026059391Z [2024-04-04T23:54:06.025+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:53:00+00:00, map_index=-1, run_start_date=2024-04-04 23:54:03.396521+00:00, run_end_date=2024-04-04 23:54:04.980039+00:00, run_duration=1.583518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=386, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:54:00.213862+00:00, queued_by_job_id=1, pid=5682 2024-04-04T23:55:01.037387331Z [2024-04-04T23:55:01.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:55:00+00:00, run_after=2024-04-05T00:00:00+00:00 2024-04-04T23:55:01.089417314Z [2024-04-04T23:55:01.088+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:55:00+00:00, run_after=2024-04-04T23:56:00+00:00 2024-04-04T23:55:01.105866614Z [2024-04-04T23:55:01.105+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:55:01.127849976Z [2024-04-04T23:55:01.127+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:55:00+00:00, run_after=2024-04-04T23:56:00+00:00 2024-04-04T23:55:01.293948746Z [2024-04-04T23:55:01.293+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:55:01.293985123Z 2024-04-04T23:55:01.293992971Z 2024-04-04T23:55:01.293996668Z 2024-04-04T23:55:01.294000095Z 2024-04-04T23:55:01.294010883Z [2024-04-04T23:55:01.293+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:55:01.294093725Z [2024-04-04T23:55:01.293+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:55:01.294149200Z [2024-04-04T23:55:01.294+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:55:01.294237231Z [2024-04-04T23:55:01.294+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:55:01.294822779Z [2024-04-04T23:55:01.294+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:55:01.294830948Z 2024-04-04T23:55:01.294845858Z 2024-04-04T23:55:01.294850199Z 2024-04-04T23:55:01.294854169Z 2024-04-04T23:55:01.300004215Z [2024-04-04T23:55:01.299+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-04T23:55:01.300062492Z [2024-04-04T23:55:01.299+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:55:01.300243174Z [2024-04-04T23:55:01.300+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:55:01.300315671Z [2024-04-04T23:55:01.300+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:55:01.300502381Z [2024-04-04T23:55:01.300+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:55:01.300587888Z [2024-04-04T23:55:01.300+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:55:01.300746511Z [2024-04-04T23:55:01.300+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:55:01.300813044Z [2024-04-04T23:55:01.300+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:55:01.961329818Z [2024-04-04T23:55:01.960+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:50:00+00:00 exited with status queued for try_number 1 2024-04-04T23:55:01.961695914Z [2024-04-04T23:55:01.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:54:00+00:00 exited with status queued for try_number 1 2024-04-04T23:55:01.961888312Z [2024-04-04T23:55:01.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:54:00+00:00 exited with status queued for try_number 1 2024-04-04T23:55:01.962056206Z [2024-04-04T23:55:01.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:54:00+00:00 exited with status queued for try_number 1 2024-04-04T23:55:01.975869787Z [2024-04-04T23:55:01.975+0000] {scheduler_job.py:635} INFO - Setting external_id for to 270ced56-8a2d-427a-ae8b-29d7c71aa4e4 2024-04-04T23:55:01.976233190Z [2024-04-04T23:55:01.976+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e2199af-6886-433e-8ef3-dc019568b0b2 2024-04-04T23:55:01.976473901Z [2024-04-04T23:55:01.976+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3f7e887-e626-4683-b5ae-5126510348cb 2024-04-04T23:55:01.976794208Z [2024-04-04T23:55:01.976+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90d6a1c0-64c9-4ea9-a829-10d394e476bd 2024-04-04T23:55:03.224100390Z [2024-04-04T23:55:03.223+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:55:03.224640237Z [2024-04-04T23:55:03.224+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:54:00+00:00, run_id=scheduled__2024-04-04T23:54:00+00:00, run_start_date=2024-04-04 23:55:01.145209+00:00, run_end_date=2024-04-04 23:55:03.224036+00:00, run_duration=2.078827, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:54:00+00:00, data_interval_end=2024-04-04 23:55:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:55:03.237782633Z [2024-04-04T23:55:03.237+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:55:00+00:00, run_after=2024-04-04T23:56:00+00:00 2024-04-04T23:55:04.109924516Z [2024-04-04T23:55:04.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:54:00+00:00 exited with status success for try_number 1 2024-04-04T23:55:04.122121794Z [2024-04-04T23:55:04.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:54:00+00:00, map_index=-1, run_start_date=2024-04-04 23:55:02.628523+00:00, run_end_date=2024-04-04 23:55:03.166366+00:00, run_duration=0.537843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=387, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:55:01.296093+00:00, queued_by_job_id=1, pid=5716 2024-04-04T23:55:05.292404683Z [2024-04-04T23:55:05.291+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:55:05.292514584Z 2024-04-04T23:55:05.292591083Z [2024-04-04T23:55:05.292+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:55:05.293536595Z [2024-04-04T23:55:05.293+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:55:05.293590898Z 2024-04-04T23:55:05.298133934Z [2024-04-04T23:55:05.297+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-04T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-04T23:55:05.298285811Z [2024-04-04T23:55:05.298+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-04T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:55:05.371734967Z [2024-04-04T23:55:05.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:50:00+00:00 exited with status queued for try_number 1 2024-04-04T23:55:05.371774030Z [2024-04-04T23:55:05.371+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:50:00+00:00 exited with status success for try_number 1 2024-04-04T23:55:05.381200090Z [2024-04-04T23:55:05.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to b097aeab-eebd-4704-a9f0-8aa5644555a1 2024-04-04T23:55:05.381635128Z [2024-04-04T23:55:05.381+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T23:50:00+00:00, map_index=-1, run_start_date=2024-04-04 23:55:04.117387+00:00, run_end_date=2024-04-04 23:55:04.667235+00:00, run_duration=0.549848, state=success, executor_state=success, try_number=1, max_tries=1, job_id=388, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:55:01.296093+00:00, queued_by_job_id=1, pid=5741 2024-04-04T23:55:06.570689445Z [2024-04-04T23:55:06.570+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:55:06.571118914Z [2024-04-04T23:55:06.570+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:54:00+00:00, run_id=scheduled__2024-04-04T23:54:00+00:00, run_start_date=2024-04-04 23:55:01.148997+00:00, run_end_date=2024-04-04 23:55:06.570448+00:00, run_duration=5.421451, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:54:00+00:00, data_interval_end=2024-04-04 23:55:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:55:06.587064816Z [2024-04-04T23:55:06.586+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:55:00+00:00, run_after=2024-04-04T23:56:00+00:00 2024-04-04T23:55:06.606063112Z [2024-04-04T23:55:06.605+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:55:06.606265643Z [2024-04-04T23:55:06.606+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:54:00+00:00, run_id=scheduled__2024-04-04T23:54:00+00:00, run_start_date=2024-04-04 23:55:01.150753+00:00, run_end_date=2024-04-04 23:55:06.605890+00:00, run_duration=5.455137, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:54:00+00:00, data_interval_end=2024-04-04 23:55:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:55:06.617230167Z [2024-04-04T23:55:06.616+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:55:00+00:00, run_after=2024-04-04T23:56:00+00:00 2024-04-04T23:55:06.688180001Z [2024-04-04T23:55:06.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:54:00+00:00 exited with status success for try_number 1 2024-04-04T23:55:06.688266739Z [2024-04-04T23:55:06.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:54:00+00:00 exited with status success for try_number 1 2024-04-04T23:55:06.705216441Z [2024-04-04T23:55:06.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:54:00+00:00, map_index=-1, run_start_date=2024-04-04 23:55:04.111998+00:00, run_end_date=2024-04-04 23:55:05.648673+00:00, run_duration=1.536675, state=success, executor_state=success, try_number=1, max_tries=1, job_id=390, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:55:01.296093+00:00, queued_by_job_id=1, pid=5740 2024-04-04T23:55:06.705492120Z [2024-04-04T23:55:06.705+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:54:00+00:00, map_index=-1, run_start_date=2024-04-04 23:55:04.133727+00:00, run_end_date=2024-04-04 23:55:06.143302+00:00, run_duration=2.009575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=389, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:55:01.296093+00:00, queued_by_job_id=1, pid=5742 2024-04-04T23:55:07.834650630Z [2024-04-04T23:55:07.834+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:55:07.834683958Z 2024-04-04T23:55:07.834705758Z [2024-04-04T23:55:07.834+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:55:07.835838513Z [2024-04-04T23:55:07.835+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:55:07.835855043Z 2024-04-04T23:55:07.840771494Z [2024-04-04T23:55:07.840+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-04T23:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-04T23:55:07.840907514Z [2024-04-04T23:55:07.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-04T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-04T23:55:07.920595852Z [2024-04-04T23:55:07.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:50:00+00:00 exited with status queued for try_number 1 2024-04-04T23:55:07.931460934Z [2024-04-04T23:55:07.930+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca79d701-0081-499b-9abf-9c89d9cd92d5 2024-04-04T23:55:08.063659142Z [2024-04-04T23:55:08.063+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:50:00+00:00 exited with status success for try_number 1 2024-04-04T23:55:08.072579660Z [2024-04-04T23:55:08.072+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-04T23:50:00+00:00, map_index=-1, run_start_date=2024-04-04 23:55:07.289677+00:00, run_end_date=2024-04-04 23:55:07.746496+00:00, run_duration=0.456819, state=success, executor_state=success, try_number=1, max_tries=1, job_id=391, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:55:05.294206+00:00, queued_by_job_id=1, pid=5765 2024-04-04T23:55:10.398186247Z [2024-04-04T23:55:10.397+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-04T23:55:10.398229245Z 2024-04-04T23:55:10.398476808Z [2024-04-04T23:55:10.398+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:55:10.399222012Z [2024-04-04T23:55:10.399+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:55:10.399232818Z 2024-04-04T23:55:10.402218911Z [2024-04-04T23:55:10.401+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-04T23:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:55:10.402385234Z [2024-04-04T23:55:10.402+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-04T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-04T23:55:10.519685748Z [2024-04-04T23:55:10.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:50:00+00:00 exited with status queued for try_number 1 2024-04-04T23:55:10.519916409Z [2024-04-04T23:55:10.519+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:50:00+00:00 exited with status success for try_number 1 2024-04-04T23:55:10.528173304Z [2024-04-04T23:55:10.527+0000] {scheduler_job.py:635} INFO - Setting external_id for to efee3199-f6bf-4d5e-b97b-ca630503b6bc 2024-04-04T23:55:10.528607596Z [2024-04-04T23:55:10.528+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-04T23:50:00+00:00, map_index=0, run_start_date=2024-04-04 23:55:09.844315+00:00, run_end_date=2024-04-04 23:55:10.278676+00:00, run_duration=0.434361, state=success, executor_state=success, try_number=1, max_tries=1, job_id=392, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:55:07.836626+00:00, queued_by_job_id=1, pid=5783 2024-04-04T23:55:13.887403432Z [2024-04-04T23:55:13.886+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:55:13.888439862Z [2024-04-04T23:55:13.888+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:50:00+00:00, run_id=scheduled__2024-04-04T23:50:00+00:00, run_start_date=2024-04-04 23:55:01.143331+00:00, run_end_date=2024-04-04 23:55:13.887927+00:00, run_duration=12.744596, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:50:00+00:00, data_interval_end=2024-04-04 23:55:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-04T23:55:13.894845660Z [2024-04-04T23:55:13.894+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:55:00+00:00, run_after=2024-04-05T00:00:00+00:00 2024-04-04T23:55:13.926912818Z [2024-04-04T23:55:13.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:50:00+00:00 exited with status success for try_number 1 2024-04-04T23:55:13.932115435Z [2024-04-04T23:55:13.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-04T23:50:00+00:00, map_index=-1, run_start_date=2024-04-04 23:55:12.455177+00:00, run_end_date=2024-04-04 23:55:12.949017+00:00, run_duration=0.49384, state=success, executor_state=success, try_number=1, max_tries=1, job_id=393, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:55:10.399725+00:00, queued_by_job_id=1, pid=5794 2024-04-04T23:55:40.053954163Z [2024-04-04T23:55:40.053+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-04T23:56:01.020435762Z [2024-04-04T23:56:01.019+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:56:00+00:00, run_after=2024-04-04T23:57:00+00:00 2024-04-04T23:56:01.038415131Z [2024-04-04T23:56:01.037+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:56:01.067395861Z [2024-04-04T23:56:01.066+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:56:00+00:00, run_after=2024-04-04T23:57:00+00:00 2024-04-04T23:56:01.083821938Z [2024-04-04T23:56:01.083+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:56:01.223777531Z [2024-04-04T23:56:01.219+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:56:01.223825574Z 2024-04-04T23:56:01.223832858Z 2024-04-04T23:56:01.223839547Z 2024-04-04T23:56:01.223845496Z 2024-04-04T23:56:01.223856194Z [2024-04-04T23:56:01.220+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:56:01.223862213Z [2024-04-04T23:56:01.220+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:56:01.223879198Z [2024-04-04T23:56:01.220+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:56:01.223885293Z [2024-04-04T23:56:01.220+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:56:01.223890036Z [2024-04-04T23:56:01.221+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:56:01.223895552Z 2024-04-04T23:56:01.223900363Z 2024-04-04T23:56:01.223905651Z 2024-04-04T23:56:01.223910874Z 2024-04-04T23:56:01.225874877Z [2024-04-04T23:56:01.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:56:01.226069963Z [2024-04-04T23:56:01.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:56:01.226371996Z [2024-04-04T23:56:01.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:56:01.226453210Z [2024-04-04T23:56:01.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:56:01.226675361Z [2024-04-04T23:56:01.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:56:01.226788142Z [2024-04-04T23:56:01.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:56:01.227084618Z [2024-04-04T23:56:01.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:56:01.227094043Z [2024-04-04T23:56:01.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:56:01.807677922Z [2024-04-04T23:56:01.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:54:00+00:00 exited with status queued for try_number 1 2024-04-04T23:56:01.807710475Z [2024-04-04T23:56:01.798+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:55:00+00:00 exited with status queued for try_number 1 2024-04-04T23:56:01.807714716Z [2024-04-04T23:56:01.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:55:00+00:00 exited with status queued for try_number 1 2024-04-04T23:56:01.807718175Z [2024-04-04T23:56:01.799+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:55:00+00:00 exited with status queued for try_number 1 2024-04-04T23:56:01.831940072Z [2024-04-04T23:56:01.829+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6674d59-a0b8-407a-bcba-49b037d43574 2024-04-04T23:56:01.831975244Z [2024-04-04T23:56:01.830+0000] {scheduler_job.py:635} INFO - Setting external_id for to b36c9e40-91ba-4ad3-89f2-2d2dd4db7112 2024-04-04T23:56:01.831980099Z [2024-04-04T23:56:01.830+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5409267-5193-448f-a031-6b0145638ca0 2024-04-04T23:56:01.831983941Z [2024-04-04T23:56:01.830+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1f15cd3-5911-4765-8bc6-ba461420e453 2024-04-04T23:56:04.402827605Z [2024-04-04T23:56:04.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:56:04.403251479Z [2024-04-04T23:56:04.403+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:55:00+00:00, run_id=scheduled__2024-04-04T23:55:00+00:00, run_start_date=2024-04-04 23:56:01.098225+00:00, run_end_date=2024-04-04 23:56:04.402791+00:00, run_duration=3.304566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:55:00+00:00, data_interval_end=2024-04-04 23:56:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:56:04.420396632Z [2024-04-04T23:56:04.419+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:56:00+00:00, run_after=2024-04-04T23:57:00+00:00 2024-04-04T23:56:04.431685945Z [2024-04-04T23:56:04.431+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:56:04.432116459Z [2024-04-04T23:56:04.431+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:54:00+00:00, run_id=scheduled__2024-04-04T23:54:00+00:00, run_start_date=2024-04-04 23:56:01.096717+00:00, run_end_date=2024-04-04 23:56:04.431667+00:00, run_duration=3.33495, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:54:00+00:00, data_interval_end=2024-04-04 23:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:56:04.444958108Z [2024-04-04T23:56:04.444+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:56:00+00:00, run_after=2024-04-04T23:58:00+00:00 2024-04-04T23:56:04.524623279Z [2024-04-04T23:56:04.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:54:00+00:00 exited with status success for try_number 1 2024-04-04T23:56:04.525149339Z [2024-04-04T23:56:04.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:55:00+00:00 exited with status success for try_number 1 2024-04-04T23:56:04.534268109Z [2024-04-04T23:56:04.533+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:54:00+00:00, map_index=-1, run_start_date=2024-04-04 23:56:02.791170+00:00, run_end_date=2024-04-04 23:56:03.267034+00:00, run_duration=0.475864, state=success, executor_state=success, try_number=1, max_tries=1, job_id=394, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:56:01.222425+00:00, queued_by_job_id=1, pid=5804 2024-04-04T23:56:04.534746973Z [2024-04-04T23:56:04.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:55:00+00:00, map_index=-1, run_start_date=2024-04-04 23:56:03.070999+00:00, run_end_date=2024-04-04 23:56:03.633638+00:00, run_duration=0.562639, state=success, executor_state=success, try_number=1, max_tries=1, job_id=395, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:56:01.222425+00:00, queued_by_job_id=1, pid=5805 2024-04-04T23:56:07.188729096Z [2024-04-04T23:56:07.187+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:56:07.189515752Z [2024-04-04T23:56:07.189+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:55:00+00:00, run_id=scheduled__2024-04-04T23:55:00+00:00, run_start_date=2024-04-04 23:56:01.099793+00:00, run_end_date=2024-04-04 23:56:07.188909+00:00, run_duration=6.089116, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:55:00+00:00, data_interval_end=2024-04-04 23:56:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:56:07.207264424Z [2024-04-04T23:56:07.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:56:00+00:00, run_after=2024-04-04T23:57:00+00:00 2024-04-04T23:56:07.216963749Z [2024-04-04T23:56:07.216+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:56:07.217400946Z [2024-04-04T23:56:07.217+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:55:00+00:00, run_id=scheduled__2024-04-04T23:55:00+00:00, run_start_date=2024-04-04 23:56:01.100971+00:00, run_end_date=2024-04-04 23:56:07.217022+00:00, run_duration=6.116051, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:55:00+00:00, data_interval_end=2024-04-04 23:56:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:56:07.230260081Z [2024-04-04T23:56:07.229+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:56:00+00:00, run_after=2024-04-04T23:57:00+00:00 2024-04-04T23:56:07.264957763Z [2024-04-04T23:56:07.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:55:00+00:00 exited with status success for try_number 1 2024-04-04T23:56:07.265169688Z [2024-04-04T23:56:07.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:55:00+00:00 exited with status success for try_number 1 2024-04-04T23:56:07.272469284Z [2024-04-04T23:56:07.272+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:55:00+00:00, map_index=-1, run_start_date=2024-04-04 23:56:04.479799+00:00, run_end_date=2024-04-04 23:56:06.479546+00:00, run_duration=1.999747, state=success, executor_state=success, try_number=1, max_tries=1, job_id=397, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:56:01.222425+00:00, queued_by_job_id=1, pid=5829 2024-04-04T23:56:07.273496882Z [2024-04-04T23:56:07.273+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:55:00+00:00, map_index=-1, run_start_date=2024-04-04 23:56:04.313716+00:00, run_end_date=2024-04-04 23:56:06.611034+00:00, run_duration=2.297318, state=success, executor_state=success, try_number=1, max_tries=1, job_id=396, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:56:01.222425+00:00, queued_by_job_id=1, pid=5828 2024-04-04T23:57:00.050281123Z [2024-04-04T23:57:00.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:57:00+00:00, run_after=2024-04-04T23:58:00+00:00 2024-04-04T23:57:00.081124267Z [2024-04-04T23:57:00.080+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:57:00+00:00, run_after=2024-04-04T23:58:00+00:00 2024-04-04T23:57:00.093237086Z [2024-04-04T23:57:00.092+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:57:00.169655016Z [2024-04-04T23:57:00.169+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:57:00.169732019Z 2024-04-04T23:57:00.169736861Z 2024-04-04T23:57:00.169740333Z 2024-04-04T23:57:00.169999742Z [2024-04-04T23:57:00.169+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:57:00.171300670Z [2024-04-04T23:57:00.170+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:57:00.171616424Z [2024-04-04T23:57:00.171+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:57:00.172660593Z [2024-04-04T23:57:00.172+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:57:00.172669687Z 2024-04-04T23:57:00.172673084Z 2024-04-04T23:57:00.172676327Z 2024-04-04T23:57:00.178516053Z [2024-04-04T23:57:00.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:57:00.178689909Z [2024-04-04T23:57:00.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:57:00.179006376Z [2024-04-04T23:57:00.178+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:57:00.179152324Z [2024-04-04T23:57:00.178+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:57:00.179497670Z [2024-04-04T23:57:00.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:57:00.179732259Z [2024-04-04T23:57:00.179+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:57:00.780766063Z [2024-04-04T23:57:00.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:56:00+00:00 exited with status queued for try_number 1 2024-04-04T23:57:00.780938575Z [2024-04-04T23:57:00.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:56:00+00:00 exited with status queued for try_number 1 2024-04-04T23:57:00.781143955Z [2024-04-04T23:57:00.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:56:00+00:00 exited with status queued for try_number 1 2024-04-04T23:57:00.805533736Z [2024-04-04T23:57:00.805+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82087145-57b9-4b2c-ab7e-c145ba5efd50 2024-04-04T23:57:00.805806742Z [2024-04-04T23:57:00.805+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09c70e7a-5f39-4760-9c58-749fa7e0a267 2024-04-04T23:57:00.806102363Z [2024-04-04T23:57:00.805+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab84b92c-aa4c-430d-ac92-0edcc67d495b 2024-04-04T23:57:03.237274937Z [2024-04-04T23:57:03.236+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:57:03.237651569Z [2024-04-04T23:57:03.237+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:56:00+00:00, run_id=scheduled__2024-04-04T23:56:00+00:00, run_start_date=2024-04-04 23:57:00.111491+00:00, run_end_date=2024-04-04 23:57:03.237124+00:00, run_duration=3.125633, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:56:00+00:00, data_interval_end=2024-04-04 23:57:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:57:03.248131403Z [2024-04-04T23:57:03.247+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:57:00+00:00, run_after=2024-04-04T23:58:00+00:00 2024-04-04T23:57:03.320304770Z [2024-04-04T23:57:03.319+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:56:00+00:00 exited with status success for try_number 1 2024-04-04T23:57:03.329317665Z [2024-04-04T23:57:03.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:56:00+00:00, map_index=-1, run_start_date=2024-04-04 23:57:01.786875+00:00, run_end_date=2024-04-04 23:57:02.320246+00:00, run_duration=0.533371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=398, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:57:00.174382+00:00, queued_by_job_id=1, pid=5861 2024-04-04T23:57:04.372347614Z [2024-04-04T23:57:04.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:57:04.372458520Z [2024-04-04T23:57:04.372+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:56:00+00:00, run_id=scheduled__2024-04-04T23:56:00+00:00, run_start_date=2024-04-04 23:57:00.112876+00:00, run_end_date=2024-04-04 23:57:04.372198+00:00, run_duration=4.259322, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:56:00+00:00, data_interval_end=2024-04-04 23:57:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:57:04.381388211Z [2024-04-04T23:57:04.381+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:57:00+00:00, run_after=2024-04-04T23:58:00+00:00 2024-04-04T23:57:04.432836386Z [2024-04-04T23:57:04.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:56:00+00:00 exited with status success for try_number 1 2024-04-04T23:57:04.443533956Z [2024-04-04T23:57:04.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:56:00+00:00, map_index=-1, run_start_date=2024-04-04 23:57:02.496121+00:00, run_end_date=2024-04-04 23:57:03.806639+00:00, run_duration=1.310518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=399, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:57:00.174382+00:00, queued_by_job_id=1, pid=5873 2024-04-04T23:57:04.738356175Z [2024-04-04T23:57:04.737+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:57:04.738864905Z [2024-04-04T23:57:04.738+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:56:00+00:00, run_id=scheduled__2024-04-04T23:56:00+00:00, run_start_date=2024-04-04 23:57:00.113910+00:00, run_end_date=2024-04-04 23:57:04.738207+00:00, run_duration=4.624297, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:56:00+00:00, data_interval_end=2024-04-04 23:57:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:57:04.757152486Z [2024-04-04T23:57:04.756+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:57:00+00:00, run_after=2024-04-04T23:58:00+00:00 2024-04-04T23:57:05.883672586Z [2024-04-04T23:57:05.883+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:56:00+00:00 exited with status success for try_number 1 2024-04-04T23:57:05.889760964Z [2024-04-04T23:57:05.889+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:56:00+00:00, map_index=-1, run_start_date=2024-04-04 23:57:02.956631+00:00, run_end_date=2024-04-04 23:57:04.656840+00:00, run_duration=1.700209, state=success, executor_state=success, try_number=1, max_tries=1, job_id=400, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:57:00.174382+00:00, queued_by_job_id=1, pid=5884 2024-04-04T23:58:00.438260429Z [2024-04-04T23:58:00.437+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:58:00.452012005Z [2024-04-04T23:58:00.451+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:58:00+00:00, run_after=2024-04-04T23:59:00+00:00 2024-04-04T23:58:00.467060950Z [2024-04-04T23:58:00.466+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:58:00+00:00, run_after=2024-04-04T23:59:00+00:00 2024-04-04T23:58:00.474694531Z [2024-04-04T23:58:00.474+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:58:00.578450980Z [2024-04-04T23:58:00.578+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-04T23:58:00.578496366Z 2024-04-04T23:58:00.578506812Z 2024-04-04T23:58:00.578516365Z 2024-04-04T23:58:00.578523030Z 2024-04-04T23:58:00.579097656Z [2024-04-04T23:58:00.578+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-04T23:58:00.579368549Z [2024-04-04T23:58:00.579+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:58:00.579551646Z [2024-04-04T23:58:00.579+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:58:00.579744759Z [2024-04-04T23:58:00.579+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:58:00.580746743Z [2024-04-04T23:58:00.580+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:58:00.580759814Z 2024-04-04T23:58:00.580763681Z 2024-04-04T23:58:00.580766953Z 2024-04-04T23:58:00.580770158Z 2024-04-04T23:58:00.585605312Z [2024-04-04T23:58:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:58:00.585826923Z [2024-04-04T23:58:00.585+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-04T23:58:00.586099416Z [2024-04-04T23:58:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:58:00.586255558Z [2024-04-04T23:58:00.586+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:58:00.586495990Z [2024-04-04T23:58:00.586+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:58:00.586728559Z [2024-04-04T23:58:00.586+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:58:00.587117930Z [2024-04-04T23:58:00.586+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:58:00.587390632Z [2024-04-04T23:58:00.587+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:58:01.159205612Z [2024-04-04T23:58:01.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:56:00+00:00 exited with status queued for try_number 1 2024-04-04T23:58:01.211729108Z [2024-04-04T23:58:01.203+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:57:00+00:00 exited with status queued for try_number 1 2024-04-04T23:58:01.211757652Z [2024-04-04T23:58:01.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:57:00+00:00 exited with status queued for try_number 1 2024-04-04T23:58:01.211763244Z [2024-04-04T23:58:01.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:57:00+00:00 exited with status queued for try_number 1 2024-04-04T23:58:01.309288190Z [2024-04-04T23:58:01.308+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab484f4a-90f9-41fd-ae0d-a399e966b708 2024-04-04T23:58:01.309400013Z [2024-04-04T23:58:01.309+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bdfa2f7-4898-46ec-b8b5-d13e95616b33 2024-04-04T23:58:01.309425648Z [2024-04-04T23:58:01.309+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5c68e70-61a3-4b44-8515-604eedecccb2 2024-04-04T23:58:01.309509895Z [2024-04-04T23:58:01.309+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1717635-b3e4-48dd-9b01-7b8a8600c715 2024-04-04T23:58:04.081285515Z [2024-04-04T23:58:04.080+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:58:04.081672895Z [2024-04-04T23:58:04.081+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:56:00+00:00, run_id=scheduled__2024-04-04T23:56:00+00:00, run_start_date=2024-04-04 23:58:00.484967+00:00, run_end_date=2024-04-04 23:58:04.081209+00:00, run_duration=3.596242, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:56:00+00:00, data_interval_end=2024-04-04 23:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-04T23:58:04.095967004Z [2024-04-04T23:58:04.095+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-04T23:58:00+00:00, run_after=2024-04-05T00:00:00+00:00 2024-04-04T23:58:04.112661870Z [2024-04-04T23:58:04.112+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:58:04.113006910Z [2024-04-04T23:58:04.112+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:57:00+00:00, run_id=scheduled__2024-04-04T23:57:00+00:00, run_start_date=2024-04-04 23:58:00.486649+00:00, run_end_date=2024-04-04 23:58:04.112582+00:00, run_duration=3.625933, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:57:00+00:00, data_interval_end=2024-04-04 23:58:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:58:04.136976553Z [2024-04-04T23:58:04.133+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:58:00+00:00, run_after=2024-04-04T23:59:00+00:00 2024-04-04T23:58:04.222685738Z [2024-04-04T23:58:04.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:56:00+00:00 exited with status success for try_number 1 2024-04-04T23:58:04.223910850Z [2024-04-04T23:58:04.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:57:00+00:00 exited with status success for try_number 1 2024-04-04T23:58:04.235151987Z [2024-04-04T23:58:04.234+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:56:00+00:00, map_index=-1, run_start_date=2024-04-04 23:58:02.434890+00:00, run_end_date=2024-04-04 23:58:03.078568+00:00, run_duration=0.643678, state=success, executor_state=success, try_number=1, max_tries=1, job_id=402, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:58:00.582472+00:00, queued_by_job_id=1, pid=5914 2024-04-04T23:58:04.235949793Z [2024-04-04T23:58:04.235+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:57:00+00:00, map_index=-1, run_start_date=2024-04-04 23:58:02.209916+00:00, run_end_date=2024-04-04 23:58:03.038134+00:00, run_duration=0.828218, state=success, executor_state=success, try_number=1, max_tries=1, job_id=401, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:58:00.582472+00:00, queued_by_job_id=1, pid=5913 2024-04-04T23:58:06.813894512Z [2024-04-04T23:58:06.813+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:58:06.814287727Z [2024-04-04T23:58:06.813+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:57:00+00:00, run_id=scheduled__2024-04-04T23:57:00+00:00, run_start_date=2024-04-04 23:58:00.488216+00:00, run_end_date=2024-04-04 23:58:06.813698+00:00, run_duration=6.325482, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:57:00+00:00, data_interval_end=2024-04-04 23:58:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:58:06.830236516Z [2024-04-04T23:58:06.829+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:58:00+00:00, run_after=2024-04-04T23:59:00+00:00 2024-04-04T23:58:06.878649866Z [2024-04-04T23:58:06.878+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:57:00+00:00 exited with status success for try_number 1 2024-04-04T23:58:06.883920556Z [2024-04-04T23:58:06.883+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:57:00+00:00, map_index=-1, run_start_date=2024-04-04 23:58:03.791908+00:00, run_end_date=2024-04-04 23:58:06.368717+00:00, run_duration=2.576809, state=success, executor_state=success, try_number=1, max_tries=1, job_id=403, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:58:00.582472+00:00, queued_by_job_id=1, pid=5937 2024-04-04T23:58:07.939339518Z [2024-04-04T23:58:07.938+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:58:07.939911912Z [2024-04-04T23:58:07.939+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:57:00+00:00, run_id=scheduled__2024-04-04T23:57:00+00:00, run_start_date=2024-04-04 23:58:00.489322+00:00, run_end_date=2024-04-04 23:58:07.939234+00:00, run_duration=7.449912, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:57:00+00:00, data_interval_end=2024-04-04 23:58:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:58:07.952258019Z [2024-04-04T23:58:07.951+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:58:00+00:00, run_after=2024-04-04T23:59:00+00:00 2024-04-04T23:58:07.991790611Z [2024-04-04T23:58:07.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:57:00+00:00 exited with status success for try_number 1 2024-04-04T23:58:07.999044754Z [2024-04-04T23:58:07.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:57:00+00:00, map_index=-1, run_start_date=2024-04-04 23:58:04.007766+00:00, run_end_date=2024-04-04 23:58:07.343293+00:00, run_duration=3.335527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=404, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:58:00.582472+00:00, queued_by_job_id=1, pid=5938 2024-04-04T23:59:00.826129937Z [2024-04-04T23:59:00.825+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:59:00+00:00, run_after=2024-04-05T00:00:00+00:00 2024-04-04T23:59:00.844200514Z [2024-04-04T23:59:00.843+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:59:00+00:00, run_after=2024-04-05T00:00:00+00:00 2024-04-04T23:59:00.854373415Z [2024-04-04T23:59:00.853+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-04T23:59:00.955974472Z [2024-04-04T23:59:00.955+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-04T23:59:00.956005971Z 2024-04-04T23:59:00.956011155Z 2024-04-04T23:59:00.956016103Z 2024-04-04T23:59:00.956260505Z [2024-04-04T23:59:00.955+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-04T23:59:00.956546070Z [2024-04-04T23:59:00.956+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:59:00.956781425Z [2024-04-04T23:59:00.956+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-04T23:59:00.957723295Z [2024-04-04T23:59:00.957+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-04T23:59:00.957737198Z 2024-04-04T23:59:00.957741526Z 2024-04-04T23:59:00.957746235Z 2024-04-04T23:59:00.962479770Z [2024-04-04T23:59:00.962+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:59:00.965473296Z [2024-04-04T23:59:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-04T23:59:00.965833671Z [2024-04-04T23:59:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:59:00.966026177Z [2024-04-04T23:59:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-04T23:59:00.966331906Z [2024-04-04T23:59:00.966+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-04T23:59:00.966516933Z [2024-04-04T23:59:00.966+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-04T23:59:01.483320734Z [2024-04-04T23:59:01.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:58:00+00:00 exited with status queued for try_number 1 2024-04-04T23:59:01.485827459Z [2024-04-04T23:59:01.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:58:00+00:00 exited with status queued for try_number 1 2024-04-04T23:59:01.485864757Z [2024-04-04T23:59:01.485+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:58:00+00:00 exited with status queued for try_number 1 2024-04-04T23:59:01.496130579Z [2024-04-04T23:59:01.495+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43d1d59b-dc2a-4d66-92fc-b1de0d491089 2024-04-04T23:59:01.496281271Z [2024-04-04T23:59:01.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87cd3492-2d05-465c-a413-986543eee3f6 2024-04-04T23:59:01.496474482Z [2024-04-04T23:59:01.496+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c2182f2-b201-46ed-ac1d-9e6fcb7791b1 2024-04-04T23:59:02.699752411Z [2024-04-04T23:59:02.699+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:59:02.700033244Z [2024-04-04T23:59:02.699+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:58:00+00:00, run_id=scheduled__2024-04-04T23:58:00+00:00, run_start_date=2024-04-04 23:59:00.879082+00:00, run_end_date=2024-04-04 23:59:02.699670+00:00, run_duration=1.820588, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:58:00+00:00, data_interval_end=2024-04-04 23:59:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-04T23:59:02.711191080Z [2024-04-04T23:59:02.710+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-04T23:59:00+00:00, run_after=2024-04-05T00:00:00+00:00 2024-04-04T23:59:02.776815056Z [2024-04-04T23:59:02.776+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:58:00+00:00 exited with status success for try_number 1 2024-04-04T23:59:02.786898269Z [2024-04-04T23:59:02.786+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:58:00+00:00, map_index=-1, run_start_date=2024-04-04 23:59:02.045412+00:00, run_end_date=2024-04-04 23:59:02.497748+00:00, run_duration=0.452336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=405, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:59:00.958698+00:00, queued_by_job_id=1, pid=5970 2024-04-04T23:59:06.405483286Z [2024-04-04T23:59:06.405+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:59:06.406024796Z [2024-04-04T23:59:06.405+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:58:00+00:00, run_id=scheduled__2024-04-04T23:58:00+00:00, run_start_date=2024-04-04 23:59:00.881019+00:00, run_end_date=2024-04-04 23:59:06.405626+00:00, run_duration=5.524607, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:58:00+00:00, data_interval_end=2024-04-04 23:59:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-04T23:59:06.416876721Z [2024-04-04T23:59:06.416+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:59:00+00:00, run_after=2024-04-05T00:00:00+00:00 2024-04-04T23:59:06.422818428Z [2024-04-04T23:59:06.422+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-04T23:59:06.423152803Z [2024-04-04T23:59:06.422+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:58:00+00:00, run_id=scheduled__2024-04-04T23:58:00+00:00, run_start_date=2024-04-04 23:59:00.882754+00:00, run_end_date=2024-04-04 23:59:06.422731+00:00, run_duration=5.539977, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:58:00+00:00, data_interval_end=2024-04-04 23:59:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-04T23:59:06.433417721Z [2024-04-04T23:59:06.433+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-04T23:59:00+00:00, run_after=2024-04-05T00:00:00+00:00 2024-04-04T23:59:06.472515002Z [2024-04-04T23:59:06.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:58:00+00:00 exited with status success for try_number 1 2024-04-04T23:59:06.472711498Z [2024-04-04T23:59:06.472+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:58:00+00:00 exited with status success for try_number 1 2024-04-04T23:59:06.479658314Z [2024-04-04T23:59:06.479+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:58:00+00:00, map_index=-1, run_start_date=2024-04-04 23:59:03.415107+00:00, run_end_date=2024-04-04 23:59:05.487095+00:00, run_duration=2.071988, state=success, executor_state=success, try_number=1, max_tries=1, job_id=407, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:59:00.958698+00:00, queued_by_job_id=1, pid=5989 2024-04-04T23:59:06.480052300Z [2024-04-04T23:59:06.479+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:58:00+00:00, map_index=-1, run_start_date=2024-04-04 23:59:03.346072+00:00, run_end_date=2024-04-04 23:59:05.480242+00:00, run_duration=2.13417, state=success, executor_state=success, try_number=1, max_tries=1, job_id=406, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-04 23:59:00.958698+00:00, queued_by_job_id=1, pid=5988 2024-04-05T00:00:00.141128790Z [2024-04-05T00:00:00.140+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:00:00.153696371Z [2024-04-05T00:00:00.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:00:00+00:00, run_after=2024-04-05T00:05:00+00:00 2024-04-05T00:00:00.169156009Z [2024-04-05T00:00:00.168+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:00:00+00:00, run_after=2024-04-05T00:01:00+00:00 2024-04-05T00:00:00.175812873Z [2024-04-05T00:00:00.175+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:00:00.188032506Z [2024-04-05T00:00:00.187+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:00:00+00:00, run_after=2024-04-05T00:01:00+00:00 2024-04-05T00:00:00.302102871Z [2024-04-05T00:00:00.301+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T00:00:00.302129669Z 2024-04-05T00:00:00.302134285Z 2024-04-05T00:00:00.302139095Z 2024-04-05T00:00:00.302143723Z 2024-04-05T00:00:00.302147907Z 2024-04-05T00:00:00.302588275Z [2024-04-05T00:00:00.302+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:00:00.302850916Z [2024-04-05T00:00:00.302+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:00:00.303069280Z [2024-04-05T00:00:00.302+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:00:00.303264210Z [2024-04-05T00:00:00.303+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:00:00.303547105Z [2024-04-05T00:00:00.303+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:00:00.304719700Z [2024-04-05T00:00:00.304+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:00:00.304732771Z 2024-04-05T00:00:00.304737035Z 2024-04-05T00:00:00.304741454Z 2024-04-05T00:00:00.304760116Z 2024-04-05T00:00:00.304769592Z 2024-04-05T00:00:00.309747809Z [2024-04-05T00:00:00.309+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-04T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T00:00:00.309974503Z [2024-04-05T00:00:00.309+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-04T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:00:00.310331206Z [2024-04-05T00:00:00.310+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-04T23:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:00:00.310515555Z [2024-04-05T00:00:00.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-04T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:00:00.310822111Z [2024-04-05T00:00:00.310+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:00:00.310992335Z [2024-04-05T00:00:00.310+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:00:00.311291416Z [2024-04-05T00:00:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:00:00.311488644Z [2024-04-05T00:00:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:00:00.311824213Z [2024-04-05T00:00:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-04T23:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:00:00.312005076Z [2024-04-05T00:00:00.311+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-04T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:00:00.815572516Z [2024-04-05T00:00:00.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:55:00+00:00 exited with status queued for try_number 1 2024-04-05T00:00:00.820198756Z [2024-04-05T00:00:00.819+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:58:00+00:00 exited with status queued for try_number 1 2024-04-05T00:00:00.820461322Z [2024-04-05T00:00:00.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:59:00+00:00 exited with status queued for try_number 1 2024-04-05T00:00:00.820684620Z [2024-04-05T00:00:00.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:59:00+00:00 exited with status queued for try_number 1 2024-04-05T00:00:00.820890760Z [2024-04-05T00:00:00.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:59:00+00:00 exited with status queued for try_number 1 2024-04-05T00:00:00.869623217Z [2024-04-05T00:00:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f515182-f2b8-4e7d-96d7-3095298afced 2024-04-05T00:00:00.869797993Z [2024-04-05T00:00:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0cd03ad2-5b33-4f39-acef-a3f4feccdc43 2024-04-05T00:00:00.869956077Z [2024-04-05T00:00:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ce20360-eb19-4dcb-821d-97e033a76eac 2024-04-05T00:00:00.870097960Z [2024-04-05T00:00:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc2fd7ed-30bd-4b0a-80ee-e7d1a9a917f8 2024-04-05T00:00:00.870247057Z [2024-04-05T00:00:00.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5bf88e84-1d5d-4e25-9459-214c7f01a8a5 2024-04-05T00:00:04.857614544Z [2024-04-05T00:00:04.857+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:00:04.858152496Z [2024-04-05T00:00:04.857+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-04 23:58:00+00:00, run_id=scheduled__2024-04-04T23:58:00+00:00, run_start_date=2024-04-05 00:00:00.202337+00:00, run_end_date=2024-04-05 00:00:04.857532+00:00, run_duration=4.655195, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:58:00+00:00, data_interval_end=2024-04-05 00:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:00:04.873354241Z [2024-04-05T00:00:04.872+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:00:00+00:00, run_after=2024-04-05T00:02:00+00:00 2024-04-05T00:00:04.886323198Z [2024-04-05T00:00:04.885+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:00:04.886678030Z [2024-04-05T00:00:04.886+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-04 23:59:00+00:00, run_id=scheduled__2024-04-04T23:59:00+00:00, run_start_date=2024-04-05 00:00:00.204776+00:00, run_end_date=2024-04-05 00:00:04.886234+00:00, run_duration=4.681458, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:59:00+00:00, data_interval_end=2024-04-05 00:00:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:00:04.906281662Z [2024-04-05T00:00:04.905+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:00:00+00:00, run_after=2024-04-05T00:01:00+00:00 2024-04-05T00:00:04.974425534Z [2024-04-05T00:00:04.974+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:00:04.974449367Z 2024-04-05T00:00:04.974467858Z [2024-04-05T00:00:04.974+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:00:04.975250885Z [2024-04-05T00:00:04.974+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:00:04.975267578Z 2024-04-05T00:00:04.981566126Z [2024-04-05T00:00:04.981+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-04T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T00:00:04.981603306Z [2024-04-05T00:00:04.981+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-04T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:00:05.103109105Z [2024-04-05T00:00:05.102+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:55:00+00:00 exited with status queued for try_number 1 2024-04-05T00:00:05.103506991Z [2024-04-05T00:00:05.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-04T23:55:00+00:00 exited with status success for try_number 1 2024-04-05T00:00:05.105199710Z [2024-04-05T00:00:05.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-04T23:58:00+00:00 exited with status success for try_number 1 2024-04-05T00:00:05.105637451Z [2024-04-05T00:00:05.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:59:00+00:00 exited with status success for try_number 1 2024-04-05T00:00:05.120262463Z [2024-04-05T00:00:05.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-04T23:58:00+00:00, map_index=-1, run_start_date=2024-04-05 00:00:02.819415+00:00, run_end_date=2024-04-05 00:00:03.633177+00:00, run_duration=0.813762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=408, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:00:00.306359+00:00, queued_by_job_id=1, pid=6023 2024-04-05T00:00:05.121100106Z [2024-04-05T00:00:05.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:59:00+00:00, map_index=-1, run_start_date=2024-04-05 00:00:03.239400+00:00, run_end_date=2024-04-05 00:00:03.993553+00:00, run_duration=0.754153, state=success, executor_state=success, try_number=1, max_tries=1, job_id=409, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:00:00.306359+00:00, queued_by_job_id=1, pid=6025 2024-04-05T00:00:05.122272586Z [2024-04-05T00:00:05.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-04T23:55:00+00:00, map_index=-1, run_start_date=2024-04-05 00:00:04.040667+00:00, run_end_date=2024-04-05 00:00:04.461230+00:00, run_duration=0.420563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=410, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:00:00.306359+00:00, queued_by_job_id=1, pid=6043 2024-04-05T00:00:05.122721776Z [2024-04-05T00:00:05.122+0000] {scheduler_job.py:635} INFO - Setting external_id for to 333c3bcc-488f-41fc-9edd-c80b8fd0c931 2024-04-05T00:00:06.754437895Z [2024-04-05T00:00:06.753+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:00:06.754558754Z [2024-04-05T00:00:06.754+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:59:00+00:00, run_id=scheduled__2024-04-04T23:59:00+00:00, run_start_date=2024-04-05 00:00:00.210119+00:00, run_end_date=2024-04-05 00:00:06.754287+00:00, run_duration=6.544168, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:59:00+00:00, data_interval_end=2024-04-05 00:00:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:00:06.771259298Z [2024-04-05T00:00:06.770+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:00:00+00:00, run_after=2024-04-05T00:01:00+00:00 2024-04-05T00:00:06.869686519Z [2024-04-05T00:00:06.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:59:00+00:00 exited with status success for try_number 1 2024-04-05T00:00:07.096740219Z [2024-04-05T00:00:07.096+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:59:00+00:00, map_index=-1, run_start_date=2024-04-05 00:00:04.716332+00:00, run_end_date=2024-04-05 00:00:06.544702+00:00, run_duration=1.82837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=411, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:00:00.306359+00:00, queued_by_job_id=1, pid=6054 2024-04-05T00:00:08.139483784Z [2024-04-05T00:00:08.139+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:00:08.139929391Z [2024-04-05T00:00:08.139+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:59:00+00:00, run_id=scheduled__2024-04-04T23:59:00+00:00, run_start_date=2024-04-05 00:00:00.207719+00:00, run_end_date=2024-04-05 00:00:08.139369+00:00, run_duration=7.93165, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:59:00+00:00, data_interval_end=2024-04-05 00:00:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:00:08.149628557Z [2024-04-05T00:00:08.149+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:00:00+00:00, run_after=2024-04-05T00:01:00+00:00 2024-04-05T00:00:08.192493826Z [2024-04-05T00:00:08.191+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:00:08.192526515Z 2024-04-05T00:00:08.192907087Z [2024-04-05T00:00:08.192+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:00:08.194026776Z [2024-04-05T00:00:08.193+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:00:08.194046191Z 2024-04-05T00:00:08.198169737Z [2024-04-05T00:00:08.197+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-04T23:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T00:00:08.198628022Z [2024-04-05T00:00:08.198+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-04T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T00:00:08.294030595Z [2024-04-05T00:00:08.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:55:00+00:00 exited with status queued for try_number 1 2024-04-05T00:00:08.294238859Z [2024-04-05T00:00:08.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-04T23:59:00+00:00 exited with status success for try_number 1 2024-04-05T00:00:08.294539321Z [2024-04-05T00:00:08.294+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-04T23:55:00+00:00 exited with status success for try_number 1 2024-04-05T00:00:08.317255526Z [2024-04-05T00:00:08.316+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-04T23:55:00+00:00, map_index=-1, run_start_date=2024-04-05 00:00:06.996745+00:00, run_end_date=2024-04-05 00:00:07.383774+00:00, run_duration=0.387029, state=success, executor_state=success, try_number=1, max_tries=1, job_id=413, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:00:04.975794+00:00, queued_by_job_id=1, pid=6078 2024-04-05T00:00:08.320455881Z [2024-04-05T00:00:08.320+0000] {scheduler_job.py:635} INFO - Setting external_id for to 065e2bb8-725e-4a08-8236-3a7c2287d065 2024-04-05T00:00:08.321025259Z [2024-04-05T00:00:08.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-04T23:59:00+00:00, map_index=-1, run_start_date=2024-04-05 00:00:05.085640+00:00, run_end_date=2024-04-05 00:00:06.765891+00:00, run_duration=1.680251, state=success, executor_state=success, try_number=1, max_tries=1, job_id=412, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:00:00.306359+00:00, queued_by_job_id=1, pid=6066 2024-04-05T00:00:11.010755950Z [2024-04-05T00:00:11.009+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:00:11.010795150Z 2024-04-05T00:00:11.012524227Z [2024-04-05T00:00:11.011+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:00:11.013350236Z [2024-04-05T00:00:11.013+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:00:11.013364175Z 2024-04-05T00:00:11.016986912Z [2024-04-05T00:00:11.016+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-04T23:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:00:11.017228128Z [2024-04-05T00:00:11.016+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-04T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:00:11.070808594Z [2024-04-05T00:00:11.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:55:00+00:00 exited with status queued for try_number 1 2024-04-05T00:00:11.071081875Z [2024-04-05T00:00:11.070+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-04T23:55:00+00:00 exited with status success for try_number 1 2024-04-05T00:00:11.080549203Z [2024-04-05T00:00:11.080+0000] {scheduler_job.py:635} INFO - Setting external_id for to e448e28f-be1c-4091-9f54-4992a0396a22 2024-04-05T00:00:11.080877492Z [2024-04-05T00:00:11.080+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-04T23:55:00+00:00, map_index=0, run_start_date=2024-04-05 00:00:10.037874+00:00, run_end_date=2024-04-05 00:00:10.372251+00:00, run_duration=0.334377, state=success, executor_state=success, try_number=1, max_tries=1, job_id=414, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:00:08.194741+00:00, queued_by_job_id=1, pid=6096 2024-04-05T00:00:13.403397688Z [2024-04-05T00:00:13.402+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:00:13.403946093Z [2024-04-05T00:00:13.403+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-04 23:55:00+00:00, run_id=scheduled__2024-04-04T23:55:00+00:00, run_start_date=2024-04-05 00:00:00.199398+00:00, run_end_date=2024-04-05 00:00:13.403394+00:00, run_duration=13.203996, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-04 23:55:00+00:00, data_interval_end=2024-04-05 00:00:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T00:00:13.414791560Z [2024-04-05T00:00:13.414+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:00:00+00:00, run_after=2024-04-05T00:05:00+00:00 2024-04-05T00:00:13.992984297Z [2024-04-05T00:00:13.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-04T23:55:00+00:00 exited with status success for try_number 1 2024-04-05T00:00:14.000552058Z [2024-04-05T00:00:14.000+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-04T23:55:00+00:00, map_index=-1, run_start_date=2024-04-05 00:00:12.879508+00:00, run_end_date=2024-04-05 00:00:13.334700+00:00, run_duration=0.455192, state=success, executor_state=success, try_number=1, max_tries=1, job_id=415, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:00:11.014299+00:00, queued_by_job_id=1, pid=6107 2024-04-05T00:00:40.129716953Z [2024-04-05T00:00:40.129+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T00:01:00.664984895Z [2024-04-05T00:01:00.664+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:01:00+00:00, run_after=2024-04-05T00:02:00+00:00 2024-04-05T00:01:00.678077620Z [2024-04-05T00:01:00.677+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:01:00.695027798Z [2024-04-05T00:01:00.694+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:01:00+00:00, run_after=2024-04-05T00:02:00+00:00 2024-04-05T00:01:00.804966511Z [2024-04-05T00:01:00.804+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:01:00.804998272Z 2024-04-05T00:01:00.805002428Z 2024-04-05T00:01:00.805005841Z 2024-04-05T00:01:00.805053587Z [2024-04-05T00:01:00.804+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:01:00.805058878Z [2024-04-05T00:01:00.804+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:01:00.805158123Z [2024-04-05T00:01:00.805+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:01:00.805653931Z [2024-04-05T00:01:00.805+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:01:00.805662099Z 2024-04-05T00:01:00.805665459Z 2024-04-05T00:01:00.805668706Z 2024-04-05T00:01:00.809472070Z [2024-04-05T00:01:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:01:00.809540271Z [2024-04-05T00:01:00.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:01:00.809780586Z [2024-04-05T00:01:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:01:00.809889478Z [2024-04-05T00:01:00.809+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:01:00.810096931Z [2024-04-05T00:01:00.809+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:01:00.810203245Z [2024-04-05T00:01:00.810+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:01:01.114004657Z [2024-04-05T00:01:01.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:00:00+00:00 exited with status queued for try_number 1 2024-04-05T00:01:01.114338105Z [2024-04-05T00:01:01.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:00:00+00:00 exited with status queued for try_number 1 2024-04-05T00:01:01.114641968Z [2024-04-05T00:01:01.114+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:00:00+00:00 exited with status queued for try_number 1 2024-04-05T00:01:01.130880276Z [2024-04-05T00:01:01.130+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8a48620-4f31-4eeb-b4ac-184e5c549aa3 2024-04-05T00:01:01.131322027Z [2024-04-05T00:01:01.131+0000] {scheduler_job.py:635} INFO - Setting external_id for to 692a2e80-509f-471d-90e1-2ef6c1db2436 2024-04-05T00:01:01.131677268Z [2024-04-05T00:01:01.131+0000] {scheduler_job.py:635} INFO - Setting external_id for to af0c75b3-29ff-4ba4-b532-b4c41c984863 2024-04-05T00:01:02.845931056Z [2024-04-05T00:01:02.845+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:01:02.847711855Z [2024-04-05T00:01:02.846+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:00:00+00:00, run_id=scheduled__2024-04-05T00:00:00+00:00, run_start_date=2024-04-05 00:01:00.711213+00:00, run_end_date=2024-04-05 00:01:02.846077+00:00, run_duration=2.134864, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:00:00+00:00, data_interval_end=2024-04-05 00:01:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:01:02.863788331Z [2024-04-05T00:01:02.863+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:01:00+00:00, run_after=2024-04-05T00:02:00+00:00 2024-04-05T00:01:02.979225513Z [2024-04-05T00:01:02.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:00:00+00:00 exited with status success for try_number 1 2024-04-05T00:01:02.989508984Z [2024-04-05T00:01:02.989+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:00:00+00:00, map_index=-1, run_start_date=2024-04-05 00:01:02.146874+00:00, run_end_date=2024-04-05 00:01:02.658191+00:00, run_duration=0.511317, state=success, executor_state=success, try_number=1, max_tries=1, job_id=416, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:01:00.806432+00:00, queued_by_job_id=1, pid=6116 2024-04-05T00:01:04.657825169Z [2024-04-05T00:01:04.657+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:01:04.658352864Z [2024-04-05T00:01:04.658+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:00:00+00:00, run_id=scheduled__2024-04-05T00:00:00+00:00, run_start_date=2024-04-05 00:01:00.713420+00:00, run_end_date=2024-04-05 00:01:04.657919+00:00, run_duration=3.944499, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:00:00+00:00, data_interval_end=2024-04-05 00:01:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:01:04.667492199Z [2024-04-05T00:01:04.667+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:01:00+00:00, run_after=2024-04-05T00:02:00+00:00 2024-04-05T00:01:05.779957287Z [2024-04-05T00:01:05.779+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:01:05.780263453Z [2024-04-05T00:01:05.780+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:00:00+00:00, run_id=scheduled__2024-04-05T00:00:00+00:00, run_start_date=2024-04-05 00:01:00.714717+00:00, run_end_date=2024-04-05 00:01:05.779935+00:00, run_duration=5.065218, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:00:00+00:00, data_interval_end=2024-04-05 00:01:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:01:05.790678688Z [2024-04-05T00:01:05.790+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:01:00+00:00, run_after=2024-04-05T00:02:00+00:00 2024-04-05T00:01:05.827515795Z [2024-04-05T00:01:05.826+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:00:00+00:00 exited with status success for try_number 1 2024-04-05T00:01:05.828045356Z [2024-04-05T00:01:05.827+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:00:00+00:00 exited with status success for try_number 1 2024-04-05T00:01:05.838971459Z [2024-04-05T00:01:05.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:00:00+00:00, map_index=-1, run_start_date=2024-04-05 00:01:03.322310+00:00, run_end_date=2024-04-05 00:01:04.626088+00:00, run_duration=1.303778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=418, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:01:00.806432+00:00, queued_by_job_id=1, pid=6135 2024-04-05T00:01:05.839398735Z [2024-04-05T00:01:05.839+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:00:00+00:00, map_index=-1, run_start_date=2024-04-05 00:01:03.256164+00:00, run_end_date=2024-04-05 00:01:05.318616+00:00, run_duration=2.062452, state=success, executor_state=success, try_number=1, max_tries=1, job_id=417, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:01:00.806432+00:00, queued_by_job_id=1, pid=6134 2024-04-05T00:02:00.460394662Z [2024-04-05T00:02:00.459+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:02:00+00:00, run_after=2024-04-05T00:03:00+00:00 2024-04-05T00:02:00.472307270Z [2024-04-05T00:02:00.471+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:02:00.481523006Z [2024-04-05T00:02:00.481+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:02:00.493911525Z [2024-04-05T00:02:00.493+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:02:00+00:00, run_after=2024-04-05T00:03:00+00:00 2024-04-05T00:02:00.610722624Z [2024-04-05T00:02:00.610+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:02:00.610746361Z 2024-04-05T00:02:00.610750799Z 2024-04-05T00:02:00.610767830Z 2024-04-05T00:02:00.610771540Z 2024-04-05T00:02:00.610974719Z [2024-04-05T00:02:00.610+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:02:00.611220577Z [2024-04-05T00:02:00.611+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:02:00.611491131Z [2024-04-05T00:02:00.611+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:02:00.611812007Z [2024-04-05T00:02:00.611+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:02:00.612529690Z [2024-04-05T00:02:00.612+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:02:00.612553639Z 2024-04-05T00:02:00.612560524Z 2024-04-05T00:02:00.612570051Z 2024-04-05T00:02:00.612575429Z 2024-04-05T00:02:00.617797206Z [2024-04-05T00:02:00.617+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:02:00.618091646Z [2024-04-05T00:02:00.617+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:02:00.618433052Z [2024-04-05T00:02:00.618+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:02:00.618665503Z [2024-04-05T00:02:00.618+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:02:00.618975867Z [2024-04-05T00:02:00.618+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:02:00.619161911Z [2024-04-05T00:02:00.618+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:02:00.619474583Z [2024-04-05T00:02:00.619+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:02:00.619726573Z [2024-04-05T00:02:00.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:02:01.482345455Z [2024-04-05T00:02:01.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:00:00+00:00 exited with status queued for try_number 1 2024-04-05T00:02:01.482567825Z [2024-04-05T00:02:01.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:01:00+00:00 exited with status queued for try_number 1 2024-04-05T00:02:01.482749434Z [2024-04-05T00:02:01.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:01:00+00:00 exited with status queued for try_number 1 2024-04-05T00:02:01.483084880Z [2024-04-05T00:02:01.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:01:00+00:00 exited with status queued for try_number 1 2024-04-05T00:02:01.501303591Z [2024-04-05T00:02:01.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c8e3be9-c6db-4d98-a6d9-b5082480c634 2024-04-05T00:02:01.501576866Z [2024-04-05T00:02:01.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to 688eed33-ae40-4734-a3dd-f19896e66bd3 2024-04-05T00:02:01.501823798Z [2024-04-05T00:02:01.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to e54adde1-85fc-4c3b-8a2d-1e9dc17e63be 2024-04-05T00:02:01.502089085Z [2024-04-05T00:02:01.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to 82aa6cde-a89b-4501-878d-d0a88a7cdc06 2024-04-05T00:02:03.322566810Z [2024-04-05T00:02:03.322+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:02:03.323100697Z [2024-04-05T00:02:03.322+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:01:00+00:00, run_id=scheduled__2024-04-05T00:01:00+00:00, run_start_date=2024-04-05 00:02:00.527127+00:00, run_end_date=2024-04-05 00:02:03.322474+00:00, run_duration=2.795347, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:01:00+00:00, data_interval_end=2024-04-05 00:02:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:02:03.334950958Z [2024-04-05T00:02:03.334+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:02:00+00:00, run_after=2024-04-05T00:03:00+00:00 2024-04-05T00:02:03.346777744Z [2024-04-05T00:02:03.346+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:02:03.347358519Z [2024-04-05T00:02:03.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:00:00+00:00, run_id=scheduled__2024-04-05T00:00:00+00:00, run_start_date=2024-04-05 00:02:00.525550+00:00, run_end_date=2024-04-05 00:02:03.346817+00:00, run_duration=2.821267, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:00:00+00:00, data_interval_end=2024-04-05 00:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:02:03.361575625Z [2024-04-05T00:02:03.361+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:02:00+00:00, run_after=2024-04-05T00:04:00+00:00 2024-04-05T00:02:03.419842877Z [2024-04-05T00:02:03.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:00:00+00:00 exited with status success for try_number 1 2024-04-05T00:02:03.420226013Z [2024-04-05T00:02:03.419+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:01:00+00:00 exited with status success for try_number 1 2024-04-05T00:02:03.427900402Z [2024-04-05T00:02:03.427+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:01:00+00:00, map_index=-1, run_start_date=2024-04-05 00:02:02.168504+00:00, run_end_date=2024-04-05 00:02:02.739770+00:00, run_duration=0.571266, state=success, executor_state=success, try_number=1, max_tries=1, job_id=419, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:02:00.613407+00:00, queued_by_job_id=1, pid=6168 2024-04-05T00:02:03.428253149Z [2024-04-05T00:02:03.428+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:00:00+00:00, map_index=-1, run_start_date=2024-04-05 00:02:02.328894+00:00, run_end_date=2024-04-05 00:02:02.754298+00:00, run_duration=0.425404, state=success, executor_state=success, try_number=1, max_tries=1, job_id=420, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:02:00.613407+00:00, queued_by_job_id=1, pid=6169 2024-04-05T00:02:05.556867008Z [2024-04-05T00:02:05.556+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:02:05.557186697Z [2024-04-05T00:02:05.556+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:01:00+00:00, run_id=scheduled__2024-04-05T00:01:00+00:00, run_start_date=2024-04-05 00:02:00.528327+00:00, run_end_date=2024-04-05 00:02:05.556794+00:00, run_duration=5.028467, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:01:00+00:00, data_interval_end=2024-04-05 00:02:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:02:05.565970352Z [2024-04-05T00:02:05.565+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:02:00+00:00, run_after=2024-04-05T00:03:00+00:00 2024-04-05T00:02:05.604337084Z [2024-04-05T00:02:05.603+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:01:00+00:00 exited with status success for try_number 1 2024-04-05T00:02:05.609502047Z [2024-04-05T00:02:05.609+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:01:00+00:00, map_index=-1, run_start_date=2024-04-05 00:02:03.573692+00:00, run_end_date=2024-04-05 00:02:05.360516+00:00, run_duration=1.786824, state=success, executor_state=success, try_number=1, max_tries=1, job_id=422, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:02:00.613407+00:00, queued_by_job_id=1, pid=6193 2024-04-05T00:02:06.194031957Z [2024-04-05T00:02:06.191+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:02:06.194061182Z [2024-04-05T00:02:06.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:01:00+00:00, run_id=scheduled__2024-04-05T00:01:00+00:00, run_start_date=2024-04-05 00:02:00.529601+00:00, run_end_date=2024-04-05 00:02:06.192296+00:00, run_duration=5.662695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:01:00+00:00, data_interval_end=2024-04-05 00:02:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:02:06.206782025Z [2024-04-05T00:02:06.206+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:02:00+00:00, run_after=2024-04-05T00:03:00+00:00 2024-04-05T00:02:06.248809131Z [2024-04-05T00:02:06.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:01:00+00:00 exited with status success for try_number 1 2024-04-05T00:02:06.256398035Z [2024-04-05T00:02:06.255+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:01:00+00:00, map_index=-1, run_start_date=2024-04-05 00:02:03.440108+00:00, run_end_date=2024-04-05 00:02:05.631943+00:00, run_duration=2.191835, state=success, executor_state=success, try_number=1, max_tries=1, job_id=421, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:02:00.613407+00:00, queued_by_job_id=1, pid=6192 2024-04-05T00:03:00.448211596Z [2024-04-05T00:03:00.447+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:03:00+00:00, run_after=2024-04-05T00:04:00+00:00 2024-04-05T00:03:00.467858459Z [2024-04-05T00:03:00.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:03:00+00:00, run_after=2024-04-05T00:04:00+00:00 2024-04-05T00:03:00.478951275Z [2024-04-05T00:03:00.478+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:03:00.586435681Z [2024-04-05T00:03:00.585+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:03:00.586467128Z 2024-04-05T00:03:00.586470857Z 2024-04-05T00:03:00.586474203Z 2024-04-05T00:03:00.586859305Z [2024-04-05T00:03:00.586+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:03:00.587285997Z [2024-04-05T00:03:00.586+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:03:00.587725417Z [2024-04-05T00:03:00.587+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:03:00.589137578Z [2024-04-05T00:03:00.588+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:03:00.589149792Z 2024-04-05T00:03:00.589153346Z 2024-04-05T00:03:00.589156685Z 2024-04-05T00:03:00.595786134Z [2024-04-05T00:03:00.595+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:03:00.596069115Z [2024-04-05T00:03:00.595+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:03:00.596605924Z [2024-04-05T00:03:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:03:00.596871362Z [2024-04-05T00:03:00.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:03:00.597245944Z [2024-04-05T00:03:00.597+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:03:00.597442773Z [2024-04-05T00:03:00.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:03:00.981925244Z [2024-04-05T00:03:00.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:02:00+00:00 exited with status queued for try_number 1 2024-04-05T00:03:00.985045106Z [2024-04-05T00:03:00.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:02:00+00:00 exited with status queued for try_number 1 2024-04-05T00:03:00.985222616Z [2024-04-05T00:03:00.985+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:02:00+00:00 exited with status queued for try_number 1 2024-04-05T00:03:00.997215139Z [2024-04-05T00:03:00.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f3927db-9bc8-4f14-83b3-fec089d77d3b 2024-04-05T00:03:00.997602650Z [2024-04-05T00:03:00.997+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5331468c-2d8e-4b00-8f3d-943be3ba55dc 2024-04-05T00:03:00.998059906Z [2024-04-05T00:03:00.997+0000] {scheduler_job.py:635} INFO - Setting external_id for to 809d030b-b1b7-4766-aa90-b774622909de 2024-04-05T00:03:02.318495920Z [2024-04-05T00:03:02.318+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:03:02.319041171Z [2024-04-05T00:03:02.318+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:02:00+00:00, run_id=scheduled__2024-04-05T00:02:00+00:00, run_start_date=2024-04-05 00:03:00.492028+00:00, run_end_date=2024-04-05 00:03:02.318631+00:00, run_duration=1.826603, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:02:00+00:00, data_interval_end=2024-04-05 00:03:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:03:02.331251953Z [2024-04-05T00:03:02.330+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:03:00+00:00, run_after=2024-04-05T00:04:00+00:00 2024-04-05T00:03:02.774896024Z [2024-04-05T00:03:02.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:02:00+00:00 exited with status success for try_number 1 2024-04-05T00:03:02.787768775Z [2024-04-05T00:03:02.787+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:02:00+00:00, map_index=-1, run_start_date=2024-04-05 00:03:01.857542+00:00, run_end_date=2024-04-05 00:03:02.274507+00:00, run_duration=0.416965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=423, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:03:00.591190+00:00, queued_by_job_id=1, pid=6224 2024-04-05T00:03:04.978365575Z [2024-04-05T00:03:04.976+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:03:04.978410098Z [2024-04-05T00:03:04.976+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:02:00+00:00, run_id=scheduled__2024-04-05T00:02:00+00:00, run_start_date=2024-04-05 00:03:00.493542+00:00, run_end_date=2024-04-05 00:03:04.976616+00:00, run_duration=4.483074, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:02:00+00:00, data_interval_end=2024-04-05 00:03:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:03:04.992951929Z [2024-04-05T00:03:04.992+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:03:00+00:00, run_after=2024-04-05T00:04:00+00:00 2024-04-05T00:03:05.005959338Z [2024-04-05T00:03:05.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:03:05.006345163Z [2024-04-05T00:03:05.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:02:00+00:00, run_id=scheduled__2024-04-05T00:02:00+00:00, run_start_date=2024-04-05 00:03:00.507843+00:00, run_end_date=2024-04-05 00:03:05.005833+00:00, run_duration=4.49799, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:02:00+00:00, data_interval_end=2024-04-05 00:03:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:03:05.023888682Z [2024-04-05T00:03:05.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:03:00+00:00, run_after=2024-04-05T00:04:00+00:00 2024-04-05T00:03:05.068280799Z [2024-04-05T00:03:05.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:02:00+00:00 exited with status success for try_number 1 2024-04-05T00:03:05.068316980Z [2024-04-05T00:03:05.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:02:00+00:00 exited with status success for try_number 1 2024-04-05T00:03:05.077077718Z [2024-04-05T00:03:05.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:02:00+00:00, map_index=-1, run_start_date=2024-04-05 00:03:02.866414+00:00, run_end_date=2024-04-05 00:03:04.109585+00:00, run_duration=1.243171, state=success, executor_state=success, try_number=1, max_tries=1, job_id=424, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:03:00.591190+00:00, queued_by_job_id=1, pid=6242 2024-04-05T00:03:05.077336348Z [2024-04-05T00:03:05.077+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:02:00+00:00, map_index=-1, run_start_date=2024-04-05 00:03:03.123521+00:00, run_end_date=2024-04-05 00:03:04.815512+00:00, run_duration=1.691991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=425, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:03:00.591190+00:00, queued_by_job_id=1, pid=6243 2024-04-05T00:04:00.195715926Z [2024-04-05T00:04:00.195+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:04:00.210734433Z [2024-04-05T00:04:00.210+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:04:00+00:00, run_after=2024-04-05T00:05:00+00:00 2024-04-05T00:04:00.219495567Z [2024-04-05T00:04:00.219+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:04:00.238627423Z [2024-04-05T00:04:00.238+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:04:00+00:00, run_after=2024-04-05T00:05:00+00:00 2024-04-05T00:04:00.324553776Z [2024-04-05T00:04:00.324+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:04:00.324583277Z 2024-04-05T00:04:00.324599476Z 2024-04-05T00:04:00.324619139Z 2024-04-05T00:04:00.324623645Z 2024-04-05T00:04:00.324970042Z [2024-04-05T00:04:00.324+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:04:00.325320608Z [2024-04-05T00:04:00.325+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:04:00.325548691Z [2024-04-05T00:04:00.325+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:04:00.325826046Z [2024-04-05T00:04:00.325+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:04:00.326652484Z [2024-04-05T00:04:00.326+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:04:00.326666887Z 2024-04-05T00:04:00.326671727Z 2024-04-05T00:04:00.326697115Z 2024-04-05T00:04:00.326701986Z 2024-04-05T00:04:00.331883882Z [2024-04-05T00:04:00.331+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:04:00.332162660Z [2024-04-05T00:04:00.331+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:04:00.332573906Z [2024-04-05T00:04:00.332+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:04:00.332858941Z [2024-04-05T00:04:00.332+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:04:00.333202645Z [2024-04-05T00:04:00.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:04:00.333423172Z [2024-04-05T00:04:00.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:04:00.333753245Z [2024-04-05T00:04:00.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:04:00.334030571Z [2024-04-05T00:04:00.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:04:00.743984850Z [2024-04-05T00:04:00.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:02:00+00:00 exited with status queued for try_number 1 2024-04-05T00:04:00.744225833Z [2024-04-05T00:04:00.743+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:03:00+00:00 exited with status queued for try_number 1 2024-04-05T00:04:00.744305937Z [2024-04-05T00:04:00.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:03:00+00:00 exited with status queued for try_number 1 2024-04-05T00:04:00.744482845Z [2024-04-05T00:04:00.744+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:03:00+00:00 exited with status queued for try_number 1 2024-04-05T00:04:00.753626302Z [2024-04-05T00:04:00.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to 023fcb78-7870-4fca-b0cf-4f72491d9687 2024-04-05T00:04:00.753667228Z [2024-04-05T00:04:00.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23f8cf5d-dd1a-407b-b2f1-7bba6537448f 2024-04-05T00:04:00.753741303Z [2024-04-05T00:04:00.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6cc70d22-00d1-403d-b53e-23a5ea998b7b 2024-04-05T00:04:00.753890784Z [2024-04-05T00:04:00.753+0000] {scheduler_job.py:635} INFO - Setting external_id for to a89221fb-01e2-4f0c-a5e3-633ff28ce2f0 2024-04-05T00:04:03.117891798Z [2024-04-05T00:04:03.117+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:04:03.118248205Z [2024-04-05T00:04:03.118+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:02:00+00:00, run_id=scheduled__2024-04-05T00:02:00+00:00, run_start_date=2024-04-05 00:04:00.250622+00:00, run_end_date=2024-04-05 00:04:03.117851+00:00, run_duration=2.867229, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:02:00+00:00, data_interval_end=2024-04-05 00:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:04:03.127823382Z [2024-04-05T00:04:03.127+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:04:00+00:00, run_after=2024-04-05T00:06:00+00:00 2024-04-05T00:04:03.138197826Z [2024-04-05T00:04:03.137+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:04:03.138604259Z [2024-04-05T00:04:03.138+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:03:00+00:00, run_id=scheduled__2024-04-05T00:03:00+00:00, run_start_date=2024-04-05 00:04:00.252293+00:00, run_end_date=2024-04-05 00:04:03.138206+00:00, run_duration=2.885913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:03:00+00:00, data_interval_end=2024-04-05 00:04:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:04:03.150963443Z [2024-04-05T00:04:03.150+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:04:00+00:00, run_after=2024-04-05T00:05:00+00:00 2024-04-05T00:04:03.247035560Z [2024-04-05T00:04:03.246+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:02:00+00:00 exited with status success for try_number 1 2024-04-05T00:04:03.247543118Z [2024-04-05T00:04:03.247+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:03:00+00:00 exited with status success for try_number 1 2024-04-05T00:04:03.258236772Z [2024-04-05T00:04:03.257+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:03:00+00:00, map_index=-1, run_start_date=2024-04-05 00:04:02.316548+00:00, run_end_date=2024-04-05 00:04:02.815618+00:00, run_duration=0.49907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=427, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:04:00.328084+00:00, queued_by_job_id=1, pid=6277 2024-04-05T00:04:03.258806966Z [2024-04-05T00:04:03.258+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:02:00+00:00, map_index=-1, run_start_date=2024-04-05 00:04:02.074293+00:00, run_end_date=2024-04-05 00:04:02.560466+00:00, run_duration=0.486173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=426, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:04:00.328084+00:00, queued_by_job_id=1, pid=6275 2024-04-05T00:04:05.412322492Z [2024-04-05T00:04:05.411+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:04:05.412747891Z [2024-04-05T00:04:05.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:03:00+00:00, run_id=scheduled__2024-04-05T00:03:00+00:00, run_start_date=2024-04-05 00:04:00.253557+00:00, run_end_date=2024-04-05 00:04:05.412214+00:00, run_duration=5.158657, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:03:00+00:00, data_interval_end=2024-04-05 00:04:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:04:05.422849758Z [2024-04-05T00:04:05.422+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:04:00+00:00, run_after=2024-04-05T00:05:00+00:00 2024-04-05T00:04:05.430500985Z [2024-04-05T00:04:05.430+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:04:05.430849040Z [2024-04-05T00:04:05.430+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:03:00+00:00, run_id=scheduled__2024-04-05T00:03:00+00:00, run_start_date=2024-04-05 00:04:00.254675+00:00, run_end_date=2024-04-05 00:04:05.430397+00:00, run_duration=5.175722, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:03:00+00:00, data_interval_end=2024-04-05 00:04:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:04:05.441347214Z [2024-04-05T00:04:05.441+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:04:00+00:00, run_after=2024-04-05T00:05:00+00:00 2024-04-05T00:04:05.481475311Z [2024-04-05T00:04:05.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:03:00+00:00 exited with status success for try_number 1 2024-04-05T00:04:05.481519659Z [2024-04-05T00:04:05.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:03:00+00:00 exited with status success for try_number 1 2024-04-05T00:04:05.489092729Z [2024-04-05T00:04:05.488+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:03:00+00:00, map_index=-1, run_start_date=2024-04-05 00:04:03.382155+00:00, run_end_date=2024-04-05 00:04:04.977571+00:00, run_duration=1.595416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=429, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:04:00.328084+00:00, queued_by_job_id=1, pid=6300 2024-04-05T00:04:05.489324801Z [2024-04-05T00:04:05.489+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:03:00+00:00, map_index=-1, run_start_date=2024-04-05 00:04:03.132133+00:00, run_end_date=2024-04-05 00:04:04.965281+00:00, run_duration=1.833148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=428, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:04:00.328084+00:00, queued_by_job_id=1, pid=6299 2024-04-05T00:05:00.041830447Z [2024-04-05T00:05:00.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:05:00+00:00, run_after=2024-04-05T00:10:00+00:00 2024-04-05T00:05:00.061988601Z [2024-04-05T00:05:00.061+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:05:00.095335540Z [2024-04-05T00:05:00.095+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:05:00+00:00, run_after=2024-04-05T00:06:00+00:00 2024-04-05T00:05:00.128432228Z [2024-04-05T00:05:00.128+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:05:00+00:00, run_after=2024-04-05T00:06:00+00:00 2024-04-05T00:05:00.209801573Z [2024-04-05T00:05:00.208+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:05:00.209830063Z 2024-04-05T00:05:00.209848695Z 2024-04-05T00:05:00.209863456Z 2024-04-05T00:05:00.209866620Z 2024-04-05T00:05:00.216025560Z [2024-04-05T00:05:00.215+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:05:00.216255807Z [2024-04-05T00:05:00.216+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:05:00.216557011Z [2024-04-05T00:05:00.216+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:05:00.216926650Z [2024-04-05T00:05:00.216+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:05:00.218494734Z [2024-04-05T00:05:00.218+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:05:00.218507313Z 2024-04-05T00:05:00.218511207Z 2024-04-05T00:05:00.218514635Z 2024-04-05T00:05:00.218517759Z 2024-04-05T00:05:00.224469635Z [2024-04-05T00:05:00.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T00:05:00.224691920Z [2024-04-05T00:05:00.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:05:00.224979756Z [2024-04-05T00:05:00.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:05:00.225154072Z [2024-04-05T00:05:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:05:00.225448644Z [2024-04-05T00:05:00.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:05:00.225603859Z [2024-04-05T00:05:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:05:00.225817194Z [2024-04-05T00:05:00.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:05:00.225947349Z [2024-04-05T00:05:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:05:00.902355244Z [2024-04-05T00:05:00.900+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:00:00+00:00 exited with status queued for try_number 1 2024-04-05T00:05:00.902902152Z [2024-04-05T00:05:00.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:04:00+00:00 exited with status queued for try_number 1 2024-04-05T00:05:00.903239786Z [2024-04-05T00:05:00.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:04:00+00:00 exited with status queued for try_number 1 2024-04-05T00:05:00.907482226Z [2024-04-05T00:05:00.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:04:00+00:00 exited with status queued for try_number 1 2024-04-05T00:05:00.959424621Z [2024-04-05T00:05:00.959+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58f07c03-c662-43cf-9026-0c0edd7a99fb 2024-04-05T00:05:00.959862316Z [2024-04-05T00:05:00.959+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8e909e21-8a1f-4511-b0fd-ef331fbb6061 2024-04-05T00:05:00.960678652Z [2024-04-05T00:05:00.960+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfe1a5a3-a622-46f2-b7db-f4ad1a194a8d 2024-04-05T00:05:00.964043098Z [2024-04-05T00:05:00.963+0000] {scheduler_job.py:635} INFO - Setting external_id for to 385b60f1-aafc-4d23-a516-0fbbc369deba 2024-04-05T00:05:02.452441714Z [2024-04-05T00:05:02.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:04:00+00:00 exited with status success for try_number 1 2024-04-05T00:05:02.459157462Z [2024-04-05T00:05:02.458+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:04:00+00:00, map_index=-1, run_start_date=2024-04-05 00:05:01.473196+00:00, run_end_date=2024-04-05 00:05:02.213063+00:00, run_duration=0.739867, state=success, executor_state=success, try_number=1, max_tries=1, job_id=430, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:05:00.219437+00:00, queued_by_job_id=1, pid=6333 2024-04-05T00:05:03.511796039Z [2024-04-05T00:05:03.508+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:05:03.512223413Z [2024-04-05T00:05:03.511+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:04:00+00:00, run_id=scheduled__2024-04-05T00:04:00+00:00, run_start_date=2024-04-05 00:05:00.142852+00:00, run_end_date=2024-04-05 00:05:03.511757+00:00, run_duration=3.368905, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:04:00+00:00, data_interval_end=2024-04-05 00:05:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:05:03.529755258Z [2024-04-05T00:05:03.529+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:05:00+00:00, run_after=2024-04-05T00:06:00+00:00 2024-04-05T00:05:05.194332837Z [2024-04-05T00:05:05.193+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:05:05.194883944Z [2024-04-05T00:05:05.194+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:04:00+00:00, run_id=scheduled__2024-04-05T00:04:00+00:00, run_start_date=2024-04-05 00:05:00.144123+00:00, run_end_date=2024-04-05 00:05:05.194183+00:00, run_duration=5.05006, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:04:00+00:00, data_interval_end=2024-04-05 00:05:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:05:05.212805723Z [2024-04-05T00:05:05.212+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:05:00+00:00, run_after=2024-04-05T00:06:00+00:00 2024-04-05T00:05:05.264237822Z [2024-04-05T00:05:05.263+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:05:05.264270507Z 2024-04-05T00:05:05.264529018Z [2024-04-05T00:05:05.264+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:05:05.265630469Z [2024-04-05T00:05:05.265+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:05:05.265638582Z 2024-04-05T00:05:05.269532130Z [2024-04-05T00:05:05.269+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T00:05:05.269618938Z [2024-04-05T00:05:05.269+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:05:05.340030842Z [2024-04-05T00:05:05.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:00:00+00:00 exited with status queued for try_number 1 2024-04-05T00:05:05.340501323Z [2024-04-05T00:05:05.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:00:00+00:00 exited with status success for try_number 1 2024-04-05T00:05:05.340751779Z [2024-04-05T00:05:05.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:04:00+00:00 exited with status success for try_number 1 2024-04-05T00:05:05.356244812Z [2024-04-05T00:05:05.352+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f82e107-7bf7-4b3e-8d1f-e47c49dfc19a 2024-04-05T00:05:05.358032167Z [2024-04-05T00:05:05.357+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:04:00+00:00, map_index=-1, run_start_date=2024-04-05 00:05:03.567308+00:00, run_end_date=2024-04-05 00:05:04.956276+00:00, run_duration=1.388968, state=success, executor_state=success, try_number=1, max_tries=1, job_id=431, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:05:00.219437+00:00, queued_by_job_id=1, pid=6347 2024-04-05T00:05:05.358659003Z [2024-04-05T00:05:05.358+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T00:00:00+00:00, map_index=-1, run_start_date=2024-04-05 00:05:04.015141+00:00, run_end_date=2024-04-05 00:05:04.457557+00:00, run_duration=0.442416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=433, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:05:00.219437+00:00, queued_by_job_id=1, pid=6364 2024-04-05T00:05:06.551754921Z [2024-04-05T00:05:06.547+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:05:06.551815494Z [2024-04-05T00:05:06.548+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:04:00+00:00, run_id=scheduled__2024-04-05T00:04:00+00:00, run_start_date=2024-04-05 00:05:00.145108+00:00, run_end_date=2024-04-05 00:05:06.548342+00:00, run_duration=6.403234, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:04:00+00:00, data_interval_end=2024-04-05 00:05:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:05:06.559813379Z [2024-04-05T00:05:06.558+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:05:00+00:00, run_after=2024-04-05T00:06:00+00:00 2024-04-05T00:05:06.625830439Z [2024-04-05T00:05:06.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:04:00+00:00 exited with status success for try_number 1 2024-04-05T00:05:06.633965718Z [2024-04-05T00:05:06.633+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:04:00+00:00, map_index=-1, run_start_date=2024-04-05 00:05:03.972805+00:00, run_end_date=2024-04-05 00:05:05.596401+00:00, run_duration=1.623596, state=success, executor_state=success, try_number=1, max_tries=1, job_id=432, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:05:00.219437+00:00, queued_by_job_id=1, pid=6363 2024-04-05T00:05:08.032603245Z [2024-04-05T00:05:08.032+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:05:08.032642467Z 2024-04-05T00:05:08.032658791Z [2024-04-05T00:05:08.032+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:05:08.033377405Z [2024-04-05T00:05:08.033+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:05:08.033397409Z 2024-04-05T00:05:08.036555771Z [2024-04-05T00:05:08.036+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T00:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T00:05:08.036661392Z [2024-04-05T00:05:08.036+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T00:05:08.095422100Z [2024-04-05T00:05:08.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:00:00+00:00 exited with status queued for try_number 1 2024-04-05T00:05:08.096107390Z [2024-04-05T00:05:08.095+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:00:00+00:00 exited with status success for try_number 1 2024-04-05T00:05:08.101882961Z [2024-04-05T00:05:08.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87ee92f8-ccda-45c4-bd2b-f595ff41b909 2024-04-05T00:05:08.102410165Z [2024-04-05T00:05:08.102+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T00:00:00+00:00, map_index=-1, run_start_date=2024-04-05 00:05:07.049471+00:00, run_end_date=2024-04-05 00:05:07.400528+00:00, run_duration=0.351057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=434, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:05:05.266234+00:00, queued_by_job_id=1, pid=6382 2024-04-05T00:05:10.320976846Z [2024-04-05T00:05:10.320+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:05:10.321016072Z 2024-04-05T00:05:10.321024420Z [2024-04-05T00:05:10.320+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:05:10.321594626Z [2024-04-05T00:05:10.321+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:05:10.321606565Z 2024-04-05T00:05:10.324420078Z [2024-04-05T00:05:10.324+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:05:10.324465718Z [2024-04-05T00:05:10.324+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:05:10.408570683Z [2024-04-05T00:05:10.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:00:00+00:00 exited with status queued for try_number 1 2024-04-05T00:05:10.408602123Z [2024-04-05T00:05:10.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:00:00+00:00 exited with status success for try_number 1 2024-04-05T00:05:10.415629159Z [2024-04-05T00:05:10.415+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0cddc376-c0eb-4baf-a43d-38ac2f58b891 2024-04-05T00:05:10.415833939Z [2024-04-05T00:05:10.415+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T00:00:00+00:00, map_index=0, run_start_date=2024-04-05 00:05:09.655498+00:00, run_end_date=2024-04-05 00:05:10.017024+00:00, run_duration=0.361526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=435, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:05:08.033793+00:00, queued_by_job_id=1, pid=6400 2024-04-05T00:05:12.662881611Z [2024-04-05T00:05:12.662+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:05:12.663004514Z [2024-04-05T00:05:12.662+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:00:00+00:00, run_id=scheduled__2024-04-05T00:00:00+00:00, run_start_date=2024-04-05 00:05:00.140872+00:00, run_end_date=2024-04-05 00:05:12.662693+00:00, run_duration=12.521821, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:00:00+00:00, data_interval_end=2024-04-05 00:05:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T00:05:12.669653808Z [2024-04-05T00:05:12.669+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:05:00+00:00, run_after=2024-04-05T00:10:00+00:00 2024-04-05T00:05:12.710121044Z [2024-04-05T00:05:12.709+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:00:00+00:00 exited with status success for try_number 1 2024-04-05T00:05:12.719864454Z [2024-04-05T00:05:12.719+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T00:00:00+00:00, map_index=-1, run_start_date=2024-04-05 00:05:12.136029+00:00, run_end_date=2024-04-05 00:05:12.490279+00:00, run_duration=0.35425, state=success, executor_state=success, try_number=1, max_tries=1, job_id=436, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:05:10.321902+00:00, queued_by_job_id=1, pid=6411 2024-04-05T00:05:40.186295642Z [2024-04-05T00:05:40.185+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T00:06:00.917391395Z [2024-04-05T00:06:00.917+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:06:00.929443285Z [2024-04-05T00:06:00.929+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:06:00+00:00, run_after=2024-04-05T00:07:00+00:00 2024-04-05T00:06:00.936650063Z [2024-04-05T00:06:00.936+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:06:00.949080953Z [2024-04-05T00:06:00.948+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:06:00+00:00, run_after=2024-04-05T00:07:00+00:00 2024-04-05T00:06:01.032725918Z [2024-04-05T00:06:01.032+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:06:01.032750021Z 2024-04-05T00:06:01.032754249Z 2024-04-05T00:06:01.032757757Z 2024-04-05T00:06:01.032760885Z 2024-04-05T00:06:01.032876344Z [2024-04-05T00:06:01.032+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:06:01.033027553Z [2024-04-05T00:06:01.032+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:06:01.033177215Z [2024-04-05T00:06:01.033+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:06:01.033320073Z [2024-04-05T00:06:01.033+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:06:01.033978044Z [2024-04-05T00:06:01.033+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:06:01.033989631Z 2024-04-05T00:06:01.033993164Z 2024-04-05T00:06:01.033996766Z 2024-04-05T00:06:01.033999995Z 2024-04-05T00:06:01.037793069Z [2024-04-05T00:06:01.037+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:06:01.037969412Z [2024-04-05T00:06:01.037+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:06:01.038238708Z [2024-04-05T00:06:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:06:01.038391762Z [2024-04-05T00:06:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:06:01.038636284Z [2024-04-05T00:06:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:06:01.038787851Z [2024-04-05T00:06:01.038+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:06:01.039023116Z [2024-04-05T00:06:01.038+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:06:01.039169444Z [2024-04-05T00:06:01.039+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:06:01.532420558Z [2024-04-05T00:06:01.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:04:00+00:00 exited with status queued for try_number 1 2024-04-05T00:06:01.532547102Z [2024-04-05T00:06:01.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:05:00+00:00 exited with status queued for try_number 1 2024-04-05T00:06:01.532777456Z [2024-04-05T00:06:01.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:05:00+00:00 exited with status queued for try_number 1 2024-04-05T00:06:01.532932707Z [2024-04-05T00:06:01.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:05:00+00:00 exited with status queued for try_number 1 2024-04-05T00:06:01.553183123Z [2024-04-05T00:06:01.552+0000] {scheduler_job.py:635} INFO - Setting external_id for to 938e74f4-6454-46c1-b256-31559da7dbc8 2024-04-05T00:06:01.553357026Z [2024-04-05T00:06:01.553+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d827122-4259-437d-acc3-c21bfac54538 2024-04-05T00:06:01.553540108Z [2024-04-05T00:06:01.553+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33d70873-f86d-4729-9613-b68ece765760 2024-04-05T00:06:01.553734873Z [2024-04-05T00:06:01.553+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd29bf32-bdab-487d-adcf-b3397490f9b9 2024-04-05T00:06:02.902797466Z [2024-04-05T00:06:02.902+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:06:02.908182223Z [2024-04-05T00:06:02.903+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:04:00+00:00, run_id=scheduled__2024-04-05T00:04:00+00:00, run_start_date=2024-04-05 00:06:00.960147+00:00, run_end_date=2024-04-05 00:06:02.902716+00:00, run_duration=1.942569, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:04:00+00:00, data_interval_end=2024-04-05 00:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:06:02.927902262Z [2024-04-05T00:06:02.927+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:06:00+00:00, run_after=2024-04-05T00:08:00+00:00 2024-04-05T00:06:02.944199738Z [2024-04-05T00:06:02.943+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:06:02.944760940Z [2024-04-05T00:06:02.944+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:05:00+00:00, run_id=scheduled__2024-04-05T00:05:00+00:00, run_start_date=2024-04-05 00:06:00.961491+00:00, run_end_date=2024-04-05 00:06:02.944125+00:00, run_duration=1.982634, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:05:00+00:00, data_interval_end=2024-04-05 00:06:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:06:02.967406898Z [2024-04-05T00:06:02.966+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:06:00+00:00, run_after=2024-04-05T00:07:00+00:00 2024-04-05T00:06:03.100497802Z [2024-04-05T00:06:03.100+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:05:00+00:00 exited with status success for try_number 1 2024-04-05T00:06:03.108367973Z [2024-04-05T00:06:03.107+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:05:00+00:00, map_index=-1, run_start_date=2024-04-05 00:06:02.223996+00:00, run_end_date=2024-04-05 00:06:02.702272+00:00, run_duration=0.478276, state=success, executor_state=success, try_number=1, max_tries=1, job_id=437, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:06:01.034916+00:00, queued_by_job_id=1, pid=6421 2024-04-05T00:06:03.992550236Z [2024-04-05T00:06:03.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:04:00+00:00 exited with status success for try_number 1 2024-04-05T00:06:03.997939725Z [2024-04-05T00:06:03.997+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:04:00+00:00, map_index=-1, run_start_date=2024-04-05 00:06:02.320717+00:00, run_end_date=2024-04-05 00:06:02.841220+00:00, run_duration=0.520503, state=success, executor_state=success, try_number=1, max_tries=1, job_id=438, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:06:01.034916+00:00, queued_by_job_id=1, pid=6422 2024-04-05T00:06:06.040860058Z [2024-04-05T00:06:06.040+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:06:06.040968476Z [2024-04-05T00:06:06.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:05:00+00:00, run_id=scheduled__2024-04-05T00:05:00+00:00, run_start_date=2024-04-05 00:06:00.962622+00:00, run_end_date=2024-04-05 00:06:06.040674+00:00, run_duration=5.078052, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:05:00+00:00, data_interval_end=2024-04-05 00:06:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:06:06.050457926Z [2024-04-05T00:06:06.050+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:06:00+00:00, run_after=2024-04-05T00:07:00+00:00 2024-04-05T00:06:06.097779958Z [2024-04-05T00:06:06.097+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:05:00+00:00 exited with status success for try_number 1 2024-04-05T00:06:06.102545805Z [2024-04-05T00:06:06.102+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:05:00+00:00, map_index=-1, run_start_date=2024-04-05 00:06:03.526511+00:00, run_end_date=2024-04-05 00:06:05.290152+00:00, run_duration=1.763641, state=success, executor_state=success, try_number=1, max_tries=1, job_id=439, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:06:01.034916+00:00, queued_by_job_id=1, pid=6445 2024-04-05T00:06:07.137874542Z [2024-04-05T00:06:07.137+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:06:07.138061551Z [2024-04-05T00:06:07.137+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:05:00+00:00, run_id=scheduled__2024-04-05T00:05:00+00:00, run_start_date=2024-04-05 00:06:00.964569+00:00, run_end_date=2024-04-05 00:06:07.137742+00:00, run_duration=6.173173, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:05:00+00:00, data_interval_end=2024-04-05 00:06:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:06:07.147177244Z [2024-04-05T00:06:07.146+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:06:00+00:00, run_after=2024-04-05T00:07:00+00:00 2024-04-05T00:06:07.187760082Z [2024-04-05T00:06:07.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:05:00+00:00 exited with status success for try_number 1 2024-04-05T00:06:07.194894589Z [2024-04-05T00:06:07.194+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:05:00+00:00, map_index=-1, run_start_date=2024-04-05 00:06:03.729067+00:00, run_end_date=2024-04-05 00:06:06.345504+00:00, run_duration=2.616437, state=success, executor_state=success, try_number=1, max_tries=1, job_id=440, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:06:01.034916+00:00, queued_by_job_id=1, pid=6446 2024-04-05T00:07:00.780089861Z [2024-04-05T00:07:00.779+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:07:00+00:00, run_after=2024-04-05T00:08:00+00:00 2024-04-05T00:07:00.795081267Z [2024-04-05T00:07:00.794+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:07:00.823856119Z [2024-04-05T00:07:00.823+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:07:00+00:00, run_after=2024-04-05T00:08:00+00:00 2024-04-05T00:07:00.939813081Z [2024-04-05T00:07:00.939+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:07:00.939849906Z 2024-04-05T00:07:00.939857314Z 2024-04-05T00:07:00.939863273Z 2024-04-05T00:07:00.940277143Z [2024-04-05T00:07:00.939+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:07:00.940608538Z [2024-04-05T00:07:00.940+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:07:00.940933600Z [2024-04-05T00:07:00.940+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:07:00.942024998Z [2024-04-05T00:07:00.941+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:07:00.942038688Z 2024-04-05T00:07:00.942044706Z 2024-04-05T00:07:00.942049549Z 2024-04-05T00:07:00.948684467Z [2024-04-05T00:07:00.948+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:07:00.949037706Z [2024-04-05T00:07:00.948+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:07:00.949501508Z [2024-04-05T00:07:00.949+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:07:00.949792043Z [2024-04-05T00:07:00.949+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:07:00.950297973Z [2024-04-05T00:07:00.950+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:07:00.950690196Z [2024-04-05T00:07:00.950+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:07:01.401578046Z [2024-04-05T00:07:01.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:06:00+00:00 exited with status queued for try_number 1 2024-04-05T00:07:01.402271762Z [2024-04-05T00:07:01.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:06:00+00:00 exited with status queued for try_number 1 2024-04-05T00:07:01.402551308Z [2024-04-05T00:07:01.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:06:00+00:00 exited with status queued for try_number 1 2024-04-05T00:07:01.423623521Z [2024-04-05T00:07:01.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84e91592-4076-4f64-b6a8-3a206402e129 2024-04-05T00:07:01.424111854Z [2024-04-05T00:07:01.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e66e322-6f21-482c-bfa0-e5c013fe55dc 2024-04-05T00:07:01.424435557Z [2024-04-05T00:07:01.424+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2f8d4ca-046b-4e39-8feb-e8005e201713 2024-04-05T00:07:02.803112713Z [2024-04-05T00:07:02.802+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:07:02.804056169Z [2024-04-05T00:07:02.803+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:06:00+00:00, run_id=scheduled__2024-04-05T00:06:00+00:00, run_start_date=2024-04-05 00:07:00.843628+00:00, run_end_date=2024-04-05 00:07:02.803283+00:00, run_duration=1.959655, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:06:00+00:00, data_interval_end=2024-04-05 00:07:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:07:02.823084621Z [2024-04-05T00:07:02.822+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:07:00+00:00, run_after=2024-04-05T00:08:00+00:00 2024-04-05T00:07:02.903342865Z [2024-04-05T00:07:02.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:06:00+00:00 exited with status success for try_number 1 2024-04-05T00:07:02.908991063Z [2024-04-05T00:07:02.908+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:06:00+00:00, map_index=-1, run_start_date=2024-04-05 00:07:02.106009+00:00, run_end_date=2024-04-05 00:07:02.694708+00:00, run_duration=0.588699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=441, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:07:00.943363+00:00, queued_by_job_id=1, pid=6478 2024-04-05T00:07:05.431002803Z [2024-04-05T00:07:05.430+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:07:05.431308616Z [2024-04-05T00:07:05.430+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:06:00+00:00, run_id=scheduled__2024-04-05T00:06:00+00:00, run_start_date=2024-04-05 00:07:00.846154+00:00, run_end_date=2024-04-05 00:07:05.430826+00:00, run_duration=4.584672, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:06:00+00:00, data_interval_end=2024-04-05 00:07:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:07:05.447813974Z [2024-04-05T00:07:05.447+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:07:00+00:00, run_after=2024-04-05T00:08:00+00:00 2024-04-05T00:07:05.457571533Z [2024-04-05T00:07:05.457+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:07:05.458012100Z [2024-04-05T00:07:05.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:06:00+00:00, run_id=scheduled__2024-04-05T00:06:00+00:00, run_start_date=2024-04-05 00:07:00.847813+00:00, run_end_date=2024-04-05 00:07:05.457562+00:00, run_duration=4.609749, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:06:00+00:00, data_interval_end=2024-04-05 00:07:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:07:05.467515266Z [2024-04-05T00:07:05.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:07:00+00:00, run_after=2024-04-05T00:08:00+00:00 2024-04-05T00:07:05.500213775Z [2024-04-05T00:07:05.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:06:00+00:00 exited with status success for try_number 1 2024-04-05T00:07:05.500790101Z [2024-04-05T00:07:05.500+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:06:00+00:00 exited with status success for try_number 1 2024-04-05T00:07:05.512736633Z [2024-04-05T00:07:05.512+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:06:00+00:00, map_index=-1, run_start_date=2024-04-05 00:07:03.271170+00:00, run_end_date=2024-04-05 00:07:04.839127+00:00, run_duration=1.567957, state=success, executor_state=success, try_number=1, max_tries=1, job_id=442, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:07:00.943363+00:00, queued_by_job_id=1, pid=6496 2024-04-05T00:07:05.513328237Z [2024-04-05T00:07:05.512+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:06:00+00:00, map_index=-1, run_start_date=2024-04-05 00:07:03.415142+00:00, run_end_date=2024-04-05 00:07:05.230345+00:00, run_duration=1.815203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=443, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:07:00.943363+00:00, queued_by_job_id=1, pid=6497 2024-04-05T00:08:00.371665036Z [2024-04-05T00:08:00.371+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:08:00.384002323Z [2024-04-05T00:08:00.383+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:08:00+00:00, run_after=2024-04-05T00:09:00+00:00 2024-04-05T00:08:00.396669966Z [2024-04-05T00:08:00.396+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:08:00+00:00, run_after=2024-04-05T00:09:00+00:00 2024-04-05T00:08:00.403665481Z [2024-04-05T00:08:00.403+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:08:00.487901896Z [2024-04-05T00:08:00.487+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:08:00.487925094Z 2024-04-05T00:08:00.487929406Z 2024-04-05T00:08:00.487932758Z 2024-04-05T00:08:00.487935991Z 2024-04-05T00:08:00.488150903Z [2024-04-05T00:08:00.487+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:08:00.488382247Z [2024-04-05T00:08:00.488+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:08:00.488581875Z [2024-04-05T00:08:00.488+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:08:00.488768733Z [2024-04-05T00:08:00.488+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:08:00.489524583Z [2024-04-05T00:08:00.489+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:08:00.489536868Z 2024-04-05T00:08:00.489540695Z 2024-04-05T00:08:00.489543940Z 2024-04-05T00:08:00.489564182Z 2024-04-05T00:08:00.493228382Z [2024-04-05T00:08:00.492+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:08:00.493518872Z [2024-04-05T00:08:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:08:00.493859230Z [2024-04-05T00:08:00.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:08:00.494123181Z [2024-04-05T00:08:00.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:08:00.494466258Z [2024-04-05T00:08:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:08:00.494719776Z [2024-04-05T00:08:00.494+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:08:00.495071001Z [2024-04-05T00:08:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:08:00.495477015Z [2024-04-05T00:08:00.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:08:01.089266442Z [2024-04-05T00:08:01.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:06:00+00:00 exited with status queued for try_number 1 2024-04-05T00:08:01.089362646Z [2024-04-05T00:08:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:07:00+00:00 exited with status queued for try_number 1 2024-04-05T00:08:01.089478560Z [2024-04-05T00:08:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:07:00+00:00 exited with status queued for try_number 1 2024-04-05T00:08:01.089590458Z [2024-04-05T00:08:01.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:07:00+00:00 exited with status queued for try_number 1 2024-04-05T00:08:01.133845084Z [2024-04-05T00:08:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c0024ef-777c-48be-b871-7ad6f353373f 2024-04-05T00:08:01.134095942Z [2024-04-05T00:08:01.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to 880f584b-bd03-44ca-b57b-b539d6eaa575 2024-04-05T00:08:01.134292626Z [2024-04-05T00:08:01.134+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06d0a4f6-335f-4d3d-bfdd-ead5d100d310 2024-04-05T00:08:01.134483468Z [2024-04-05T00:08:01.134+0000] {scheduler_job.py:635} INFO - Setting external_id for to 72de7e18-2763-4999-887e-5ac5c33e1f5b 2024-04-05T00:08:03.516486409Z [2024-04-05T00:08:03.515+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:08:03.517380035Z [2024-04-05T00:08:03.517+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:06:00+00:00, run_id=scheduled__2024-04-05T00:06:00+00:00, run_start_date=2024-04-05 00:08:00.414858+00:00, run_end_date=2024-04-05 00:08:03.516918+00:00, run_duration=3.10206, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:06:00+00:00, data_interval_end=2024-04-05 00:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:08:03.527034748Z [2024-04-05T00:08:03.526+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:08:00+00:00, run_after=2024-04-05T00:10:00+00:00 2024-04-05T00:08:03.553671988Z [2024-04-05T00:08:03.553+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:08:03.554134805Z [2024-04-05T00:08:03.553+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:07:00+00:00, run_id=scheduled__2024-04-05T00:07:00+00:00, run_start_date=2024-04-05 00:08:00.416122+00:00, run_end_date=2024-04-05 00:08:03.553732+00:00, run_duration=3.13761, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:07:00+00:00, data_interval_end=2024-04-05 00:08:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:08:03.568528356Z [2024-04-05T00:08:03.568+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:08:00+00:00, run_after=2024-04-05T00:09:00+00:00 2024-04-05T00:08:03.654674786Z [2024-04-05T00:08:03.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:06:00+00:00 exited with status success for try_number 1 2024-04-05T00:08:03.658478626Z [2024-04-05T00:08:03.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:07:00+00:00 exited with status success for try_number 1 2024-04-05T00:08:03.666042626Z [2024-04-05T00:08:03.665+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:06:00+00:00, map_index=-1, run_start_date=2024-04-05 00:08:02.376400+00:00, run_end_date=2024-04-05 00:08:02.903089+00:00, run_duration=0.526689, state=success, executor_state=success, try_number=1, max_tries=1, job_id=444, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:08:00.490454+00:00, queued_by_job_id=1, pid=6526 2024-04-05T00:08:03.666412454Z [2024-04-05T00:08:03.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:07:00+00:00, map_index=-1, run_start_date=2024-04-05 00:08:02.851161+00:00, run_end_date=2024-04-05 00:08:03.347068+00:00, run_duration=0.495907, state=success, executor_state=success, try_number=1, max_tries=1, job_id=445, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:08:00.490454+00:00, queued_by_job_id=1, pid=6537 2024-04-05T00:08:05.817868352Z [2024-04-05T00:08:05.817+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:08:05.818209222Z [2024-04-05T00:08:05.817+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:07:00+00:00, run_id=scheduled__2024-04-05T00:07:00+00:00, run_start_date=2024-04-05 00:08:00.417195+00:00, run_end_date=2024-04-05 00:08:05.817873+00:00, run_duration=5.400678, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:07:00+00:00, data_interval_end=2024-04-05 00:08:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:08:05.831433691Z [2024-04-05T00:08:05.830+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:08:00+00:00, run_after=2024-04-05T00:09:00+00:00 2024-04-05T00:08:05.870055134Z [2024-04-05T00:08:05.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:07:00+00:00 exited with status success for try_number 1 2024-04-05T00:08:05.875658813Z [2024-04-05T00:08:05.875+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:07:00+00:00, map_index=-1, run_start_date=2024-04-05 00:08:03.709641+00:00, run_end_date=2024-04-05 00:08:05.479256+00:00, run_duration=1.769615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=446, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:08:00.490454+00:00, queued_by_job_id=1, pid=6549 2024-04-05T00:08:06.920225262Z [2024-04-05T00:08:06.919+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:08:06.920506155Z [2024-04-05T00:08:06.920+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:07:00+00:00, run_id=scheduled__2024-04-05T00:07:00+00:00, run_start_date=2024-04-05 00:08:00.418173+00:00, run_end_date=2024-04-05 00:08:06.920115+00:00, run_duration=6.501942, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:07:00+00:00, data_interval_end=2024-04-05 00:08:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:08:06.929999156Z [2024-04-05T00:08:06.929+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:08:00+00:00, run_after=2024-04-05T00:09:00+00:00 2024-04-05T00:08:06.970314928Z [2024-04-05T00:08:06.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:07:00+00:00 exited with status success for try_number 1 2024-04-05T00:08:06.974918793Z [2024-04-05T00:08:06.974+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:07:00+00:00, map_index=-1, run_start_date=2024-04-05 00:08:04.002211+00:00, run_end_date=2024-04-05 00:08:06.809788+00:00, run_duration=2.807577, state=success, executor_state=success, try_number=1, max_tries=1, job_id=447, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:08:00.490454+00:00, queued_by_job_id=1, pid=6555 2024-04-05T00:09:00.284624197Z [2024-04-05T00:09:00.282+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:09:00+00:00, run_after=2024-04-05T00:10:00+00:00 2024-04-05T00:09:00.297672343Z [2024-04-05T00:09:00.297+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:09:00+00:00, run_after=2024-04-05T00:10:00+00:00 2024-04-05T00:09:00.305856975Z [2024-04-05T00:09:00.305+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:09:00.377583534Z [2024-04-05T00:09:00.377+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:09:00.377621487Z 2024-04-05T00:09:00.377625820Z 2024-04-05T00:09:00.377629108Z 2024-04-05T00:09:00.377923082Z [2024-04-05T00:09:00.377+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:09:00.378161738Z [2024-04-05T00:09:00.377+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:09:00.378380693Z [2024-04-05T00:09:00.378+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:09:00.379093220Z [2024-04-05T00:09:00.378+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:09:00.379104480Z 2024-04-05T00:09:00.379108208Z 2024-04-05T00:09:00.379111628Z 2024-04-05T00:09:00.382571367Z [2024-04-05T00:09:00.382+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:09:00.382950326Z [2024-04-05T00:09:00.382+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:09:00.383343611Z [2024-04-05T00:09:00.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:09:00.383605867Z [2024-04-05T00:09:00.383+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:09:00.383937300Z [2024-04-05T00:09:00.383+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:09:00.384213666Z [2024-04-05T00:09:00.384+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:09:00.871109838Z [2024-04-05T00:09:00.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:08:00+00:00 exited with status queued for try_number 1 2024-04-05T00:09:00.871142505Z [2024-04-05T00:09:00.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:08:00+00:00 exited with status queued for try_number 1 2024-04-05T00:09:00.871146513Z [2024-04-05T00:09:00.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:08:00+00:00 exited with status queued for try_number 1 2024-04-05T00:09:00.885912336Z [2024-04-05T00:09:00.885+0000] {scheduler_job.py:635} INFO - Setting external_id for to b55b73ec-e78b-4ee7-9409-2bc144caadc1 2024-04-05T00:09:00.886015764Z [2024-04-05T00:09:00.885+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ac0ff8f-1a5c-47a9-9088-ac2291fd591f 2024-04-05T00:09:00.886160260Z [2024-04-05T00:09:00.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c60dec1-1f1c-43d2-a576-8a3b7578820d 2024-04-05T00:09:03.253716760Z [2024-04-05T00:09:03.253+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:09:03.254328253Z [2024-04-05T00:09:03.253+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:08:00+00:00, run_id=scheduled__2024-04-05T00:08:00+00:00, run_start_date=2024-04-05 00:09:00.317015+00:00, run_end_date=2024-04-05 00:09:03.253812+00:00, run_duration=2.936797, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:08:00+00:00, data_interval_end=2024-04-05 00:09:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:09:03.293400146Z [2024-04-05T00:09:03.293+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:09:00+00:00, run_after=2024-04-05T00:10:00+00:00 2024-04-05T00:09:03.360173992Z [2024-04-05T00:09:03.359+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:08:00+00:00 exited with status success for try_number 1 2024-04-05T00:09:03.373220214Z [2024-04-05T00:09:03.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:08:00+00:00, map_index=-1, run_start_date=2024-04-05 00:09:01.633522+00:00, run_end_date=2024-04-05 00:09:02.086696+00:00, run_duration=0.453174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=448, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:09:00.379906+00:00, queued_by_job_id=1, pid=6587 2024-04-05T00:09:05.051446794Z [2024-04-05T00:09:05.050+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:09:05.051925388Z [2024-04-05T00:09:05.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:08:00+00:00, run_id=scheduled__2024-04-05T00:08:00+00:00, run_start_date=2024-04-05 00:09:00.318604+00:00, run_end_date=2024-04-05 00:09:05.051414+00:00, run_duration=4.73281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:08:00+00:00, data_interval_end=2024-04-05 00:09:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:09:05.066696189Z [2024-04-05T00:09:05.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:09:00+00:00, run_after=2024-04-05T00:10:00+00:00 2024-04-05T00:09:05.126464251Z [2024-04-05T00:09:05.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:08:00+00:00 exited with status success for try_number 1 2024-04-05T00:09:05.131394791Z [2024-04-05T00:09:05.130+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:08:00+00:00, map_index=-1, run_start_date=2024-04-05 00:09:02.899186+00:00, run_end_date=2024-04-05 00:09:04.459016+00:00, run_duration=1.55983, state=success, executor_state=success, try_number=1, max_tries=1, job_id=449, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:09:00.379906+00:00, queued_by_job_id=1, pid=6600 2024-04-05T00:09:06.190694307Z [2024-04-05T00:09:06.190+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:09:06.195745858Z [2024-04-05T00:09:06.190+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:08:00+00:00, run_id=scheduled__2024-04-05T00:08:00+00:00, run_start_date=2024-04-05 00:09:00.320024+00:00, run_end_date=2024-04-05 00:09:06.190563+00:00, run_duration=5.870539, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:08:00+00:00, data_interval_end=2024-04-05 00:09:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:09:06.201922749Z [2024-04-05T00:09:06.201+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:09:00+00:00, run_after=2024-04-05T00:10:00+00:00 2024-04-05T00:09:06.235228385Z [2024-04-05T00:09:06.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:08:00+00:00 exited with status success for try_number 1 2024-04-05T00:09:06.239890913Z [2024-04-05T00:09:06.239+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:08:00+00:00, map_index=-1, run_start_date=2024-04-05 00:09:03.238323+00:00, run_end_date=2024-04-05 00:09:05.547122+00:00, run_duration=2.308799, state=success, executor_state=success, try_number=1, max_tries=1, job_id=450, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:09:00.379906+00:00, queued_by_job_id=1, pid=6606 2024-04-05T00:10:00.146963080Z [2024-04-05T00:10:00.146+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:10:00.162505481Z [2024-04-05T00:10:00.162+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:10:00+00:00, run_after=2024-04-05T00:11:00+00:00 2024-04-05T00:10:00.170419030Z [2024-04-05T00:10:00.169+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:10:00.180659429Z [2024-04-05T00:10:00.180+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:10:00+00:00, run_after=2024-04-05T00:15:00+00:00 2024-04-05T00:10:00.194228690Z [2024-04-05T00:10:00.193+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:10:00+00:00, run_after=2024-04-05T00:11:00+00:00 2024-04-05T00:10:00.275410076Z [2024-04-05T00:10:00.275+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T00:10:00.275435389Z 2024-04-05T00:10:00.275439027Z 2024-04-05T00:10:00.275442764Z 2024-04-05T00:10:00.275446733Z 2024-04-05T00:10:00.275450084Z 2024-04-05T00:10:00.275548418Z [2024-04-05T00:10:00.275+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:10:00.275885589Z [2024-04-05T00:10:00.275+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:10:00.276068078Z [2024-04-05T00:10:00.275+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:10:00.276251451Z [2024-04-05T00:10:00.276+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:10:00.276473654Z [2024-04-05T00:10:00.276+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:10:00.277550823Z [2024-04-05T00:10:00.277+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:10:00.277564535Z 2024-04-05T00:10:00.277568732Z 2024-04-05T00:10:00.277572319Z 2024-04-05T00:10:00.277575475Z 2024-04-05T00:10:00.277595080Z 2024-04-05T00:10:00.283710235Z [2024-04-05T00:10:00.283+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T00:10:00.283927627Z [2024-04-05T00:10:00.283+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:10:00.284385736Z [2024-04-05T00:10:00.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:10:00.284574159Z [2024-04-05T00:10:00.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:10:00.284971420Z [2024-04-05T00:10:00.284+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:10:00.285147798Z [2024-04-05T00:10:00.284+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:10:00.285515708Z [2024-04-05T00:10:00.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:10:00.285700334Z [2024-04-05T00:10:00.285+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:10:00.286097259Z [2024-04-05T00:10:00.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:10:00.286309612Z [2024-04-05T00:10:00.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:10:00.882314674Z [2024-04-05T00:10:00.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:05:00+00:00 exited with status queued for try_number 1 2024-04-05T00:10:00.882386307Z [2024-04-05T00:10:00.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:08:00+00:00 exited with status queued for try_number 1 2024-04-05T00:10:00.882460822Z [2024-04-05T00:10:00.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:09:00+00:00 exited with status queued for try_number 1 2024-04-05T00:10:00.882644506Z [2024-04-05T00:10:00.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:09:00+00:00 exited with status queued for try_number 1 2024-04-05T00:10:00.882704783Z [2024-04-05T00:10:00.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:09:00+00:00 exited with status queued for try_number 1 2024-04-05T00:10:00.908017569Z [2024-04-05T00:10:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9be4c77-c80c-4c68-ae32-f394eaba4a9d 2024-04-05T00:10:00.908423140Z [2024-04-05T00:10:00.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58fe5c06-e5d6-4c92-9817-94087a0d7789 2024-04-05T00:10:00.908648597Z [2024-04-05T00:10:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to b12051e8-79c0-4e7c-a406-980025241104 2024-04-05T00:10:00.908767650Z [2024-04-05T00:10:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34b1ca60-a22c-4ab3-81c7-ad0cf5b04302 2024-04-05T00:10:00.908962439Z [2024-04-05T00:10:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ca9941d-addb-47b6-b5cc-262278b48e3a 2024-04-05T00:10:03.592909947Z [2024-04-05T00:10:03.592+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:10:03.596130116Z [2024-04-05T00:10:03.595+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:08:00+00:00, run_id=scheduled__2024-04-05T00:08:00+00:00, run_start_date=2024-04-05 00:10:00.205940+00:00, run_end_date=2024-04-05 00:10:03.592775+00:00, run_duration=3.386835, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:08:00+00:00, data_interval_end=2024-04-05 00:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:10:03.610896694Z [2024-04-05T00:10:03.610+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:10:00+00:00, run_after=2024-04-05T00:12:00+00:00 2024-04-05T00:10:03.623724669Z [2024-04-05T00:10:03.623+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:10:03.624353187Z [2024-04-05T00:10:03.623+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:09:00+00:00, run_id=scheduled__2024-04-05T00:09:00+00:00, run_start_date=2024-04-05 00:10:00.207245+00:00, run_end_date=2024-04-05 00:10:03.623637+00:00, run_duration=3.416392, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:09:00+00:00, data_interval_end=2024-04-05 00:10:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:10:03.648636906Z [2024-04-05T00:10:03.648+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:10:00+00:00, run_after=2024-04-05T00:11:00+00:00 2024-04-05T00:10:03.721704690Z [2024-04-05T00:10:03.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:08:00+00:00 exited with status success for try_number 1 2024-04-05T00:10:03.721913198Z [2024-04-05T00:10:03.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:09:00+00:00 exited with status success for try_number 1 2024-04-05T00:10:03.732185263Z [2024-04-05T00:10:03.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:09:00+00:00, map_index=-1, run_start_date=2024-04-05 00:10:02.070847+00:00, run_end_date=2024-04-05 00:10:02.499067+00:00, run_duration=0.42822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=451, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:10:00.279495+00:00, queued_by_job_id=1, pid=6641 2024-04-05T00:10:03.734450108Z [2024-04-05T00:10:03.732+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:08:00+00:00, map_index=-1, run_start_date=2024-04-05 00:10:02.419776+00:00, run_end_date=2024-04-05 00:10:02.881943+00:00, run_duration=0.462167, state=success, executor_state=success, try_number=1, max_tries=1, job_id=452, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:10:00.279495+00:00, queued_by_job_id=1, pid=6647 2024-04-05T00:10:04.213150511Z [2024-04-05T00:10:04.212+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:10:04.213192589Z 2024-04-05T00:10:04.213208317Z [2024-04-05T00:10:04.213+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:10:04.213876645Z [2024-04-05T00:10:04.213+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:10:04.213889360Z 2024-04-05T00:10:04.217425420Z [2024-04-05T00:10:04.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T00:10:04.217483034Z [2024-04-05T00:10:04.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:10:04.356184235Z [2024-04-05T00:10:04.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:05:00+00:00 exited with status queued for try_number 1 2024-04-05T00:10:04.360128490Z [2024-04-05T00:10:04.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:05:00+00:00 exited with status success for try_number 1 2024-04-05T00:10:04.367871271Z [2024-04-05T00:10:04.367+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98ada2a7-4717-4d2c-9514-6c22607f7d89 2024-04-05T00:10:04.368127129Z [2024-04-05T00:10:04.367+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T00:05:00+00:00, map_index=-1, run_start_date=2024-04-05 00:10:03.382213+00:00, run_end_date=2024-04-05 00:10:03.802988+00:00, run_duration=0.420775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=453, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:10:00.279495+00:00, queued_by_job_id=1, pid=6660 2024-04-05T00:10:05.434498456Z [2024-04-05T00:10:05.434+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:10:05.434951929Z [2024-04-05T00:10:05.434+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:09:00+00:00, run_id=scheduled__2024-04-05T00:09:00+00:00, run_start_date=2024-04-05 00:10:00.208339+00:00, run_end_date=2024-04-05 00:10:05.434602+00:00, run_duration=5.226263, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:09:00+00:00, data_interval_end=2024-04-05 00:10:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:10:05.444996186Z [2024-04-05T00:10:05.444+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:10:00+00:00, run_after=2024-04-05T00:11:00+00:00 2024-04-05T00:10:06.621614239Z [2024-04-05T00:10:06.621+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:10:06.621655551Z 2024-04-05T00:10:06.621667382Z [2024-04-05T00:10:06.621+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:10:06.622271321Z [2024-04-05T00:10:06.622+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:10:06.622282201Z 2024-04-05T00:10:06.626017714Z [2024-04-05T00:10:06.625+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T00:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T00:10:06.626083605Z [2024-04-05T00:10:06.625+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T00:10:06.710617258Z [2024-04-05T00:10:06.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:05:00+00:00 exited with status queued for try_number 1 2024-04-05T00:10:06.710913716Z [2024-04-05T00:10:06.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:09:00+00:00 exited with status success for try_number 1 2024-04-05T00:10:06.711186795Z [2024-04-05T00:10:06.710+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:05:00+00:00 exited with status success for try_number 1 2024-04-05T00:10:06.731396625Z [2024-04-05T00:10:06.730+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b5e43a1-846a-43d8-b235-4f6554dff233 2024-04-05T00:10:06.731861519Z [2024-04-05T00:10:06.731+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:09:00+00:00, map_index=-1, run_start_date=2024-04-05 00:10:03.978664+00:00, run_end_date=2024-04-05 00:10:05.383320+00:00, run_duration=1.404656, state=success, executor_state=success, try_number=1, max_tries=1, job_id=454, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:10:00.279495+00:00, queued_by_job_id=1, pid=6676 2024-04-05T00:10:06.732359500Z [2024-04-05T00:10:06.732+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T00:05:00+00:00, map_index=-1, run_start_date=2024-04-05 00:10:06.055742+00:00, run_end_date=2024-04-05 00:10:06.388093+00:00, run_duration=0.332351, state=success, executor_state=success, try_number=1, max_tries=1, job_id=456, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:10:04.214260+00:00, queued_by_job_id=1, pid=6695 2024-04-05T00:10:06.782518149Z [2024-04-05T00:10:06.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:10:06.782975662Z [2024-04-05T00:10:06.782+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:09:00+00:00, run_id=scheduled__2024-04-05T00:09:00+00:00, run_start_date=2024-04-05 00:10:00.209327+00:00, run_end_date=2024-04-05 00:10:06.782390+00:00, run_duration=6.573063, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:09:00+00:00, data_interval_end=2024-04-05 00:10:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:10:06.792859481Z [2024-04-05T00:10:06.792+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:10:00+00:00, run_after=2024-04-05T00:11:00+00:00 2024-04-05T00:10:06.843280741Z [2024-04-05T00:10:06.842+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:09:00+00:00 exited with status success for try_number 1 2024-04-05T00:10:06.850316481Z [2024-04-05T00:10:06.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:09:00+00:00, map_index=-1, run_start_date=2024-04-05 00:10:04.117873+00:00, run_end_date=2024-04-05 00:10:06.607075+00:00, run_duration=2.489202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=455, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:10:00.279495+00:00, queued_by_job_id=1, pid=6677 2024-04-05T00:10:09.177325346Z [2024-04-05T00:10:09.176+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:10:09.177368654Z 2024-04-05T00:10:09.177610179Z [2024-04-05T00:10:09.177+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:10:09.178242206Z [2024-04-05T00:10:09.178+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:10:09.178254316Z 2024-04-05T00:10:09.180747368Z [2024-04-05T00:10:09.180+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T00:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:10:09.180984959Z [2024-04-05T00:10:09.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:10:09.269130983Z [2024-04-05T00:10:09.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:05:00+00:00 exited with status queued for try_number 1 2024-04-05T00:10:09.269171134Z [2024-04-05T00:10:09.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:05:00+00:00 exited with status success for try_number 1 2024-04-05T00:10:09.291693750Z [2024-04-05T00:10:09.288+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4a4a0a4-77ae-462f-929b-abe05250485c 2024-04-05T00:10:09.291717812Z [2024-04-05T00:10:09.288+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T00:05:00+00:00, map_index=0, run_start_date=2024-04-05 00:10:08.312401+00:00, run_end_date=2024-04-05 00:10:08.640415+00:00, run_duration=0.328014, state=success, executor_state=success, try_number=1, max_tries=1, job_id=457, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:10:06.623297+00:00, queued_by_job_id=1, pid=6703 2024-04-05T00:10:11.615849028Z [2024-04-05T00:10:11.615+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:10:11.616050274Z [2024-04-05T00:10:11.615+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:05:00+00:00, run_id=scheduled__2024-04-05T00:05:00+00:00, run_start_date=2024-04-05 00:10:00.204725+00:00, run_end_date=2024-04-05 00:10:11.615696+00:00, run_duration=11.410971, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:05:00+00:00, data_interval_end=2024-04-05 00:10:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T00:10:11.627611601Z [2024-04-05T00:10:11.627+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:10:00+00:00, run_after=2024-04-05T00:15:00+00:00 2024-04-05T00:10:12.724630215Z [2024-04-05T00:10:12.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:05:00+00:00 exited with status success for try_number 1 2024-04-05T00:10:12.733611433Z [2024-04-05T00:10:12.733+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T00:05:00+00:00, map_index=-1, run_start_date=2024-04-05 00:10:10.997040+00:00, run_end_date=2024-04-05 00:10:11.554505+00:00, run_duration=0.557465, state=success, executor_state=success, try_number=1, max_tries=1, job_id=458, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:10:09.178689+00:00, queued_by_job_id=1, pid=6721 2024-04-05T00:10:40.247787442Z [2024-04-05T00:10:40.246+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T00:11:01.077045713Z [2024-04-05T00:11:01.076+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:11:01.099466642Z [2024-04-05T00:11:01.099+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:11:00+00:00, run_after=2024-04-05T00:12:00+00:00 2024-04-05T00:11:01.114461908Z [2024-04-05T00:11:01.114+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:11:00+00:00, run_after=2024-04-05T00:12:00+00:00 2024-04-05T00:11:01.216210482Z [2024-04-05T00:11:01.204+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:11:01.216229880Z 2024-04-05T00:11:01.216233939Z 2024-04-05T00:11:01.216237944Z 2024-04-05T00:11:01.216241138Z [2024-04-05T00:11:01.205+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:11:01.216259722Z [2024-04-05T00:11:01.205+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:11:01.216263099Z [2024-04-05T00:11:01.205+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:11:01.216267593Z [2024-04-05T00:11:01.208+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:11:01.216270667Z 2024-04-05T00:11:01.216289164Z 2024-04-05T00:11:01.216293477Z 2024-04-05T00:11:01.223666579Z [2024-04-05T00:11:01.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:11:01.223689169Z [2024-04-05T00:11:01.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:11:01.223692796Z [2024-04-05T00:11:01.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:11:01.223696141Z [2024-04-05T00:11:01.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:11:01.223699416Z [2024-04-05T00:11:01.215+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:11:01.223702647Z [2024-04-05T00:11:01.215+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:11:01.739324607Z [2024-04-05T00:11:01.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:10:00+00:00 exited with status queued for try_number 1 2024-04-05T00:11:01.739382530Z [2024-04-05T00:11:01.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:10:00+00:00 exited with status queued for try_number 1 2024-04-05T00:11:01.739394852Z [2024-04-05T00:11:01.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:10:00+00:00 exited with status queued for try_number 1 2024-04-05T00:11:01.749712019Z [2024-04-05T00:11:01.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4b3136de-a317-43d1-a197-6690d598c5f9 2024-04-05T00:11:01.749743783Z [2024-04-05T00:11:01.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c7dcbb9-723e-4222-ad53-07b84ec22583 2024-04-05T00:11:01.749817870Z [2024-04-05T00:11:01.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f1a85d0-809b-4d85-ba92-4c2943f8d831 2024-04-05T00:11:03.024628118Z [2024-04-05T00:11:03.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:11:03.025532558Z [2024-04-05T00:11:03.025+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:10:00+00:00, run_id=scheduled__2024-04-05T00:10:00+00:00, run_start_date=2024-04-05 00:11:01.129788+00:00, run_end_date=2024-04-05 00:11:03.024938+00:00, run_duration=1.89515, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:10:00+00:00, data_interval_end=2024-04-05 00:11:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:11:03.044148259Z [2024-04-05T00:11:03.043+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:11:00+00:00, run_after=2024-04-05T00:12:00+00:00 2024-04-05T00:11:03.131615303Z [2024-04-05T00:11:03.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:10:00+00:00 exited with status success for try_number 1 2024-04-05T00:11:03.143005734Z [2024-04-05T00:11:03.142+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:10:00+00:00, map_index=-1, run_start_date=2024-04-05 00:11:02.122774+00:00, run_end_date=2024-04-05 00:11:02.599426+00:00, run_duration=0.476652, state=success, executor_state=success, try_number=1, max_tries=1, job_id=459, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:11:01.212184+00:00, queued_by_job_id=1, pid=6733 2024-04-05T00:11:05.865249156Z [2024-04-05T00:11:05.864+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:11:05.865717842Z [2024-04-05T00:11:05.865+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:10:00+00:00, run_id=scheduled__2024-04-05T00:10:00+00:00, run_start_date=2024-04-05 00:11:01.131797+00:00, run_end_date=2024-04-05 00:11:05.865128+00:00, run_duration=4.733331, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:10:00+00:00, data_interval_end=2024-04-05 00:11:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:11:05.876589982Z [2024-04-05T00:11:05.876+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:11:00+00:00, run_after=2024-04-05T00:12:00+00:00 2024-04-05T00:11:05.887301744Z [2024-04-05T00:11:05.886+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:11:05.887651513Z [2024-04-05T00:11:05.887+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:10:00+00:00, run_id=scheduled__2024-04-05T00:10:00+00:00, run_start_date=2024-04-05 00:11:01.133585+00:00, run_end_date=2024-04-05 00:11:05.887174+00:00, run_duration=4.753589, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:10:00+00:00, data_interval_end=2024-04-05 00:11:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:11:05.898376740Z [2024-04-05T00:11:05.898+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:11:00+00:00, run_after=2024-04-05T00:12:00+00:00 2024-04-05T00:11:05.935143271Z [2024-04-05T00:11:05.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:10:00+00:00 exited with status success for try_number 1 2024-04-05T00:11:05.935408642Z [2024-04-05T00:11:05.935+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:10:00+00:00 exited with status success for try_number 1 2024-04-05T00:11:05.943894717Z [2024-04-05T00:11:05.943+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:10:00+00:00, map_index=-1, run_start_date=2024-04-05 00:11:03.483405+00:00, run_end_date=2024-04-05 00:11:05.274863+00:00, run_duration=1.791458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=460, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:11:01.212184+00:00, queued_by_job_id=1, pid=6751 2024-04-05T00:11:05.944334595Z [2024-04-05T00:11:05.944+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:10:00+00:00, map_index=-1, run_start_date=2024-04-05 00:11:03.650813+00:00, run_end_date=2024-04-05 00:11:05.280956+00:00, run_duration=1.630143, state=success, executor_state=success, try_number=1, max_tries=1, job_id=461, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:11:01.212184+00:00, queued_by_job_id=1, pid=6752 2024-04-05T00:12:00.519359792Z [2024-04-05T00:12:00.519+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:12:00.533498179Z [2024-04-05T00:12:00.533+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:12:00+00:00, run_after=2024-04-05T00:13:00+00:00 2024-04-05T00:12:00.545752479Z [2024-04-05T00:12:00.545+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:12:00.562108762Z [2024-04-05T00:12:00.561+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:12:00+00:00, run_after=2024-04-05T00:13:00+00:00 2024-04-05T00:12:00.657382834Z [2024-04-05T00:12:00.656+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:12:00.657408569Z 2024-04-05T00:12:00.657418662Z 2024-04-05T00:12:00.657423113Z 2024-04-05T00:12:00.657427438Z 2024-04-05T00:12:00.657898576Z [2024-04-05T00:12:00.657+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:12:00.658226692Z [2024-04-05T00:12:00.658+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:12:00.658524533Z [2024-04-05T00:12:00.658+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:12:00.658886663Z [2024-04-05T00:12:00.658+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:12:00.661614591Z [2024-04-05T00:12:00.660+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:12:00.661632186Z 2024-04-05T00:12:00.661636069Z 2024-04-05T00:12:00.661639541Z 2024-04-05T00:12:00.661643153Z 2024-04-05T00:12:00.665913235Z [2024-04-05T00:12:00.665+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:12:00.666212997Z [2024-04-05T00:12:00.666+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:12:00.666561856Z [2024-04-05T00:12:00.666+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:12:00.666820179Z [2024-04-05T00:12:00.666+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:12:00.667131820Z [2024-04-05T00:12:00.666+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:12:00.667375615Z [2024-04-05T00:12:00.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:12:00.667744006Z [2024-04-05T00:12:00.667+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:12:00.667975397Z [2024-04-05T00:12:00.667+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:12:01.476213073Z [2024-04-05T00:12:01.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:10:00+00:00 exited with status queued for try_number 1 2024-04-05T00:12:01.476595517Z [2024-04-05T00:12:01.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:11:00+00:00 exited with status queued for try_number 1 2024-04-05T00:12:01.476836662Z [2024-04-05T00:12:01.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:11:00+00:00 exited with status queued for try_number 1 2024-04-05T00:12:01.477067183Z [2024-04-05T00:12:01.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:11:00+00:00 exited with status queued for try_number 1 2024-04-05T00:12:01.506298783Z [2024-04-05T00:12:01.505+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30a06a2f-a8a5-446f-90f5-0bdedab7c282 2024-04-05T00:12:01.506706899Z [2024-04-05T00:12:01.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9569b11c-c5b2-4aa1-8124-17b770841eb1 2024-04-05T00:12:01.507084368Z [2024-04-05T00:12:01.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to f896bf2c-b5ca-49ff-ba02-4697b0bd4218 2024-04-05T00:12:01.507436323Z [2024-04-05T00:12:01.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9524fd90-f173-40fe-ba40-d2436131a737 2024-04-05T00:12:03.979737647Z [2024-04-05T00:12:03.978+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:12:03.980595834Z [2024-04-05T00:12:03.979+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:10:00+00:00, run_id=scheduled__2024-04-05T00:10:00+00:00, run_start_date=2024-04-05 00:12:00.578356+00:00, run_end_date=2024-04-05 00:12:03.979413+00:00, run_duration=3.401057, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:10:00+00:00, data_interval_end=2024-04-05 00:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:12:04.007025801Z [2024-04-05T00:12:04.006+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:12:00+00:00, run_after=2024-04-05T00:14:00+00:00 2024-04-05T00:12:04.027122591Z [2024-04-05T00:12:04.026+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:12:04.028025004Z [2024-04-05T00:12:04.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:11:00+00:00, run_id=scheduled__2024-04-05T00:11:00+00:00, run_start_date=2024-04-05 00:12:00.581802+00:00, run_end_date=2024-04-05 00:12:04.026942+00:00, run_duration=3.44514, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:11:00+00:00, data_interval_end=2024-04-05 00:12:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:12:04.044330646Z [2024-04-05T00:12:04.043+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:12:00+00:00, run_after=2024-04-05T00:13:00+00:00 2024-04-05T00:12:04.117531797Z [2024-04-05T00:12:04.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:10:00+00:00 exited with status success for try_number 1 2024-04-05T00:12:04.118432374Z [2024-04-05T00:12:04.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:11:00+00:00 exited with status success for try_number 1 2024-04-05T00:12:04.138577690Z [2024-04-05T00:12:04.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:10:00+00:00, map_index=-1, run_start_date=2024-04-05 00:12:02.459132+00:00, run_end_date=2024-04-05 00:12:03.079962+00:00, run_duration=0.62083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=462, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:12:00.662753+00:00, queued_by_job_id=1, pid=6785 2024-04-05T00:12:04.138669707Z [2024-04-05T00:12:04.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:11:00+00:00, map_index=-1, run_start_date=2024-04-05 00:12:02.790038+00:00, run_end_date=2024-04-05 00:12:03.380242+00:00, run_duration=0.590204, state=success, executor_state=success, try_number=1, max_tries=1, job_id=463, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:12:00.662753+00:00, queued_by_job_id=1, pid=6787 2024-04-05T00:12:05.181690476Z [2024-04-05T00:12:05.181+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:12:05.181941726Z [2024-04-05T00:12:05.181+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:11:00+00:00, run_id=scheduled__2024-04-05T00:11:00+00:00, run_start_date=2024-04-05 00:12:00.584053+00:00, run_end_date=2024-04-05 00:12:05.181549+00:00, run_duration=4.597496, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:11:00+00:00, data_interval_end=2024-04-05 00:12:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:12:05.191078628Z [2024-04-05T00:12:05.190+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:12:00+00:00, run_after=2024-04-05T00:13:00+00:00 2024-04-05T00:12:05.236198749Z [2024-04-05T00:12:05.234+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:11:00+00:00 exited with status success for try_number 1 2024-04-05T00:12:05.244544081Z [2024-04-05T00:12:05.243+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:11:00+00:00, map_index=-1, run_start_date=2024-04-05 00:12:03.371911+00:00, run_end_date=2024-04-05 00:12:04.902122+00:00, run_duration=1.530211, state=success, executor_state=success, try_number=1, max_tries=1, job_id=464, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:12:00.662753+00:00, queued_by_job_id=1, pid=6803 2024-04-05T00:12:07.661995944Z [2024-04-05T00:12:07.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:12:07.662548251Z [2024-04-05T00:12:07.662+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:11:00+00:00, run_id=scheduled__2024-04-05T00:11:00+00:00, run_start_date=2024-04-05 00:12:00.585459+00:00, run_end_date=2024-04-05 00:12:07.661883+00:00, run_duration=7.076424, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:11:00+00:00, data_interval_end=2024-04-05 00:12:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:12:07.676233940Z [2024-04-05T00:12:07.675+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:12:00+00:00, run_after=2024-04-05T00:13:00+00:00 2024-04-05T00:12:07.721835271Z [2024-04-05T00:12:07.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:11:00+00:00 exited with status success for try_number 1 2024-04-05T00:12:07.728752077Z [2024-04-05T00:12:07.728+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:11:00+00:00, map_index=-1, run_start_date=2024-04-05 00:12:03.753459+00:00, run_end_date=2024-04-05 00:12:06.667379+00:00, run_duration=2.91392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=465, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:12:00.662753+00:00, queued_by_job_id=1, pid=6814 2024-04-05T00:13:00.447157308Z [2024-04-05T00:13:00.446+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:13:00.461188884Z [2024-04-05T00:13:00.460+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:13:00+00:00, run_after=2024-04-05T00:14:00+00:00 2024-04-05T00:13:00.476168631Z [2024-04-05T00:13:00.475+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:13:00+00:00, run_after=2024-04-05T00:14:00+00:00 2024-04-05T00:13:00.564788014Z [2024-04-05T00:13:00.564+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:13:00.564827483Z 2024-04-05T00:13:00.564831259Z 2024-04-05T00:13:00.564834297Z 2024-04-05T00:13:00.564837738Z [2024-04-05T00:13:00.564+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:13:00.564930201Z [2024-04-05T00:13:00.564+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:13:00.565168641Z [2024-04-05T00:13:00.565+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:13:00.566021637Z [2024-04-05T00:13:00.565+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:13:00.566034221Z 2024-04-05T00:13:00.566037737Z 2024-04-05T00:13:00.566041169Z 2024-04-05T00:13:00.570503802Z [2024-04-05T00:13:00.570+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:13:00.570610981Z [2024-04-05T00:13:00.570+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:13:00.571108489Z [2024-04-05T00:13:00.570+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:13:00.571331598Z [2024-04-05T00:13:00.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:13:00.571727501Z [2024-04-05T00:13:00.571+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:13:00.571928293Z [2024-04-05T00:13:00.571+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:13:00.980913588Z [2024-04-05T00:13:00.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:12:00+00:00 exited with status queued for try_number 1 2024-04-05T00:13:00.981096881Z [2024-04-05T00:13:00.980+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:12:00+00:00 exited with status queued for try_number 1 2024-04-05T00:13:00.981209373Z [2024-04-05T00:13:00.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:12:00+00:00 exited with status queued for try_number 1 2024-04-05T00:13:00.990997164Z [2024-04-05T00:13:00.990+0000] {scheduler_job.py:635} INFO - Setting external_id for to 37ebecd1-186c-4b01-92e7-dcace5b5ff44 2024-04-05T00:13:00.991298146Z [2024-04-05T00:13:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to f2c0cdbe-e2ce-40d9-98df-36a68e5c2a39 2024-04-05T00:13:00.991552469Z [2024-04-05T00:13:00.991+0000] {scheduler_job.py:635} INFO - Setting external_id for to 39f511b7-fb27-44f9-bbc4-c151c74a839e 2024-04-05T00:13:03.428022733Z [2024-04-05T00:13:03.427+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:13:03.428417613Z [2024-04-05T00:13:03.428+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:12:00+00:00, run_id=scheduled__2024-04-05T00:12:00+00:00, run_start_date=2024-04-05 00:13:00.491329+00:00, run_end_date=2024-04-05 00:13:03.427866+00:00, run_duration=2.936537, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:12:00+00:00, data_interval_end=2024-04-05 00:13:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:13:03.441819505Z [2024-04-05T00:13:03.441+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:13:00+00:00, run_after=2024-04-05T00:14:00+00:00 2024-04-05T00:13:03.517698111Z [2024-04-05T00:13:03.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:12:00+00:00 exited with status success for try_number 1 2024-04-05T00:13:03.524361486Z [2024-04-05T00:13:03.523+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:12:00+00:00, map_index=-1, run_start_date=2024-04-05 00:13:01.765118+00:00, run_end_date=2024-04-05 00:13:02.325815+00:00, run_duration=0.560697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=466, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:13:00.567228+00:00, queued_by_job_id=1, pid=6841 2024-04-05T00:13:06.680407289Z [2024-04-05T00:13:06.679+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:13:06.680923726Z [2024-04-05T00:13:06.680+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:12:00+00:00, run_id=scheduled__2024-04-05T00:12:00+00:00, run_start_date=2024-04-05 00:13:00.494310+00:00, run_end_date=2024-04-05 00:13:06.680557+00:00, run_duration=6.186247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:12:00+00:00, data_interval_end=2024-04-05 00:13:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:13:06.690813653Z [2024-04-05T00:13:06.690+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:13:00+00:00, run_after=2024-04-05T00:14:00+00:00 2024-04-05T00:13:06.699076191Z [2024-04-05T00:13:06.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:13:06.699452963Z [2024-04-05T00:13:06.699+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:12:00+00:00, run_id=scheduled__2024-04-05T00:12:00+00:00, run_start_date=2024-04-05 00:13:00.493033+00:00, run_end_date=2024-04-05 00:13:06.699170+00:00, run_duration=6.206137, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:12:00+00:00, data_interval_end=2024-04-05 00:13:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:13:06.710102706Z [2024-04-05T00:13:06.709+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:13:00+00:00, run_after=2024-04-05T00:14:00+00:00 2024-04-05T00:13:06.746038100Z [2024-04-05T00:13:06.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:12:00+00:00 exited with status success for try_number 1 2024-04-05T00:13:06.746152932Z [2024-04-05T00:13:06.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:12:00+00:00 exited with status success for try_number 1 2024-04-05T00:13:06.754292244Z [2024-04-05T00:13:06.753+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:12:00+00:00, map_index=-1, run_start_date=2024-04-05 00:13:03.174377+00:00, run_end_date=2024-04-05 00:13:06.014755+00:00, run_duration=2.840378, state=success, executor_state=success, try_number=1, max_tries=1, job_id=467, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:13:00.567228+00:00, queued_by_job_id=1, pid=6859 2024-04-05T00:13:06.754664640Z [2024-04-05T00:13:06.754+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:12:00+00:00, map_index=-1, run_start_date=2024-04-05 00:13:03.375385+00:00, run_end_date=2024-04-05 00:13:06.087890+00:00, run_duration=2.712505, state=success, executor_state=success, try_number=1, max_tries=1, job_id=468, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:13:00.567228+00:00, queued_by_job_id=1, pid=6860 2024-04-05T00:14:00.261199209Z [2024-04-05T00:14:00.260+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:14:00.273830867Z [2024-04-05T00:14:00.273+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:14:00.289879283Z [2024-04-05T00:14:00.289+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:14:00+00:00, run_after=2024-04-05T00:15:00+00:00 2024-04-05T00:14:00.311617781Z [2024-04-05T00:14:00.311+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:14:00+00:00, run_after=2024-04-05T00:15:00+00:00 2024-04-05T00:14:00.400636069Z [2024-04-05T00:14:00.400+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:14:00.400669348Z 2024-04-05T00:14:00.400676660Z 2024-04-05T00:14:00.400682512Z 2024-04-05T00:14:00.400687983Z 2024-04-05T00:14:00.401172051Z [2024-04-05T00:14:00.400+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:14:00.401597930Z [2024-04-05T00:14:00.401+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:14:00.401991425Z [2024-04-05T00:14:00.401+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:14:00.402291071Z [2024-04-05T00:14:00.402+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:14:00.403635827Z [2024-04-05T00:14:00.403+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:14:00.403653402Z 2024-04-05T00:14:00.403660541Z 2024-04-05T00:14:00.403666649Z 2024-04-05T00:14:00.403672183Z 2024-04-05T00:14:00.409969018Z [2024-04-05T00:14:00.409+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:14:00.410307833Z [2024-04-05T00:14:00.410+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:14:00.410614935Z [2024-04-05T00:14:00.410+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:14:00.410780562Z [2024-04-05T00:14:00.410+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:14:00.411050657Z [2024-04-05T00:14:00.410+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:14:00.411224166Z [2024-04-05T00:14:00.410+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:14:00.411684220Z [2024-04-05T00:14:00.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:14:00.411979142Z [2024-04-05T00:14:00.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:14:01.079771818Z [2024-04-05T00:14:01.078+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:12:00+00:00 exited with status queued for try_number 1 2024-04-05T00:14:01.081780264Z [2024-04-05T00:14:01.079+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:13:00+00:00 exited with status queued for try_number 1 2024-04-05T00:14:01.088043827Z [2024-04-05T00:14:01.081+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:13:00+00:00 exited with status queued for try_number 1 2024-04-05T00:14:01.088327394Z [2024-04-05T00:14:01.087+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:13:00+00:00 exited with status queued for try_number 1 2024-04-05T00:14:01.117692964Z [2024-04-05T00:14:01.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62d6accc-6408-4378-b705-afa6fb6ab9dc 2024-04-05T00:14:01.117964118Z [2024-04-05T00:14:01.117+0000] {scheduler_job.py:635} INFO - Setting external_id for to 087df742-c061-41bd-ab4c-a4bdb2647095 2024-04-05T00:14:01.118259361Z [2024-04-05T00:14:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0bafe5a1-4975-4bb8-a0a0-c51436214bba 2024-04-05T00:14:01.118526050Z [2024-04-05T00:14:01.118+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d9a0c98-8af3-4ac4-b535-dd6385459fd3 2024-04-05T00:14:02.657215174Z [2024-04-05T00:14:02.656+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:14:02.657751804Z [2024-04-05T00:14:02.657+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:13:00+00:00, run_id=scheduled__2024-04-05T00:13:00+00:00, run_start_date=2024-04-05 00:14:00.324800+00:00, run_end_date=2024-04-05 00:14:02.657107+00:00, run_duration=2.332307, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:13:00+00:00, data_interval_end=2024-04-05 00:14:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:14:02.668891006Z [2024-04-05T00:14:02.668+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:14:00+00:00, run_after=2024-04-05T00:15:00+00:00 2024-04-05T00:14:02.682192375Z [2024-04-05T00:14:02.681+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:14:02.682756314Z [2024-04-05T00:14:02.682+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:12:00+00:00, run_id=scheduled__2024-04-05T00:12:00+00:00, run_start_date=2024-04-05 00:14:00.323450+00:00, run_end_date=2024-04-05 00:14:02.682086+00:00, run_duration=2.358636, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:12:00+00:00, data_interval_end=2024-04-05 00:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:14:02.694892296Z [2024-04-05T00:14:02.694+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:14:00+00:00, run_after=2024-04-05T00:16:00+00:00 2024-04-05T00:14:02.776666630Z [2024-04-05T00:14:02.774+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:13:00+00:00 exited with status success for try_number 1 2024-04-05T00:14:02.782983869Z [2024-04-05T00:14:02.782+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:13:00+00:00, map_index=-1, run_start_date=2024-04-05 00:14:01.675341+00:00, run_end_date=2024-04-05 00:14:02.323750+00:00, run_duration=0.648409, state=success, executor_state=success, try_number=1, max_tries=1, job_id=469, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:14:00.405623+00:00, queued_by_job_id=1, pid=6894 2024-04-05T00:14:03.263404917Z [2024-04-05T00:14:03.262+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:12:00+00:00 exited with status success for try_number 1 2024-04-05T00:14:03.272928274Z [2024-04-05T00:14:03.272+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:12:00+00:00, map_index=-1, run_start_date=2024-04-05 00:14:02.085005+00:00, run_end_date=2024-04-05 00:14:02.606516+00:00, run_duration=0.521511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=470, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:14:00.405623+00:00, queued_by_job_id=1, pid=6895 2024-04-05T00:14:05.464208326Z [2024-04-05T00:14:05.463+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:14:05.464694469Z [2024-04-05T00:14:05.464+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:13:00+00:00, run_id=scheduled__2024-04-05T00:13:00+00:00, run_start_date=2024-04-05 00:14:00.326998+00:00, run_end_date=2024-04-05 00:14:05.464096+00:00, run_duration=5.137098, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:13:00+00:00, data_interval_end=2024-04-05 00:14:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:14:05.474789146Z [2024-04-05T00:14:05.474+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:14:00+00:00, run_after=2024-04-05T00:15:00+00:00 2024-04-05T00:14:06.589041648Z [2024-04-05T00:14:06.588+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:14:06.589259783Z [2024-04-05T00:14:06.588+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:13:00+00:00, run_id=scheduled__2024-04-05T00:13:00+00:00, run_start_date=2024-04-05 00:14:00.325899+00:00, run_end_date=2024-04-05 00:14:06.588658+00:00, run_duration=6.262759, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:13:00+00:00, data_interval_end=2024-04-05 00:14:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:14:06.599099797Z [2024-04-05T00:14:06.598+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:14:00+00:00, run_after=2024-04-05T00:15:00+00:00 2024-04-05T00:14:06.629808646Z [2024-04-05T00:14:06.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:13:00+00:00 exited with status success for try_number 1 2024-04-05T00:14:06.629954255Z [2024-04-05T00:14:06.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:13:00+00:00 exited with status success for try_number 1 2024-04-05T00:14:06.636715237Z [2024-04-05T00:14:06.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:13:00+00:00, map_index=-1, run_start_date=2024-04-05 00:14:03.075009+00:00, run_end_date=2024-04-05 00:14:05.421901+00:00, run_duration=2.346892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=471, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:14:00.405623+00:00, queued_by_job_id=1, pid=6913 2024-04-05T00:14:06.637079478Z [2024-04-05T00:14:06.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:13:00+00:00, map_index=-1, run_start_date=2024-04-05 00:14:03.463327+00:00, run_end_date=2024-04-05 00:14:06.273775+00:00, run_duration=2.810448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=472, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:14:00.405623+00:00, queued_by_job_id=1, pid=6924 2024-04-05T00:15:00.190593868Z [2024-04-05T00:15:00.190+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:15:00.203847754Z [2024-04-05T00:15:00.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:15:00+00:00, run_after=2024-04-05T00:20:00+00:00 2024-04-05T00:15:00.222895362Z [2024-04-05T00:15:00.215+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:15:00+00:00, run_after=2024-04-05T00:16:00+00:00 2024-04-05T00:15:00.240107984Z [2024-04-05T00:15:00.239+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:15:00+00:00, run_after=2024-04-05T00:16:00+00:00 2024-04-05T00:15:00.321486335Z [2024-04-05T00:15:00.321+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:15:00.321525605Z 2024-04-05T00:15:00.321531365Z 2024-04-05T00:15:00.321534902Z 2024-04-05T00:15:00.321537950Z 2024-04-05T00:15:00.321585403Z [2024-04-05T00:15:00.321+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:15:00.321723050Z [2024-04-05T00:15:00.321+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:15:00.321848425Z [2024-04-05T00:15:00.321+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:15:00.321952488Z [2024-04-05T00:15:00.321+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:15:00.322511633Z [2024-04-05T00:15:00.322+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:15:00.322522322Z 2024-04-05T00:15:00.322525793Z 2024-04-05T00:15:00.322528987Z 2024-04-05T00:15:00.322532034Z 2024-04-05T00:15:00.325644828Z [2024-04-05T00:15:00.325+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T00:15:00.325885657Z [2024-04-05T00:15:00.325+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:15:00.326512051Z [2024-04-05T00:15:00.326+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:15:00.326640480Z [2024-04-05T00:15:00.326+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:15:00.326877633Z [2024-04-05T00:15:00.326+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:15:00.327023776Z [2024-04-05T00:15:00.326+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:15:00.327265099Z [2024-04-05T00:15:00.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:15:00.327417926Z [2024-04-05T00:15:00.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:15:00.778099461Z [2024-04-05T00:15:00.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:10:00+00:00 exited with status queued for try_number 1 2024-04-05T00:15:00.778293681Z [2024-04-05T00:15:00.777+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:14:00+00:00 exited with status queued for try_number 1 2024-04-05T00:15:00.778523255Z [2024-04-05T00:15:00.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:14:00+00:00 exited with status queued for try_number 1 2024-04-05T00:15:00.778755099Z [2024-04-05T00:15:00.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:14:00+00:00 exited with status queued for try_number 1 2024-04-05T00:15:00.793315605Z [2024-04-05T00:15:00.792+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f3c8688-7e2d-45ab-a75d-20fd6362728d 2024-04-05T00:15:00.793604587Z [2024-04-05T00:15:00.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35410985-68c0-4692-b8a3-74e9bb0d8d64 2024-04-05T00:15:00.793847802Z [2024-04-05T00:15:00.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a540fd7-fd49-4ef2-b976-bbcd4cd90137 2024-04-05T00:15:00.794009053Z [2024-04-05T00:15:00.793+0000] {scheduler_job.py:635} INFO - Setting external_id for to e075d6c6-9a56-41c5-9d33-bb924825d8d1 2024-04-05T00:15:03.373551224Z [2024-04-05T00:15:03.373+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:15:03.374126527Z [2024-04-05T00:15:03.373+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:14:00+00:00, run_id=scheduled__2024-04-05T00:14:00+00:00, run_start_date=2024-04-05 00:15:00.258955+00:00, run_end_date=2024-04-05 00:15:03.373722+00:00, run_duration=3.114767, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:14:00+00:00, data_interval_end=2024-04-05 00:15:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:15:03.385588393Z [2024-04-05T00:15:03.385+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:15:00+00:00, run_after=2024-04-05T00:16:00+00:00 2024-04-05T00:15:03.453065167Z [2024-04-05T00:15:03.452+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:14:00+00:00 exited with status success for try_number 1 2024-04-05T00:15:03.460237070Z [2024-04-05T00:15:03.459+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:14:00+00:00, map_index=-1, run_start_date=2024-04-05 00:15:02.277729+00:00, run_end_date=2024-04-05 00:15:02.841860+00:00, run_duration=0.564131, state=success, executor_state=success, try_number=1, max_tries=1, job_id=473, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:15:00.323238+00:00, queued_by_job_id=1, pid=6952 2024-04-05T00:15:04.268163796Z [2024-04-05T00:15:04.267+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:15:04.268193641Z 2024-04-05T00:15:04.268612880Z [2024-04-05T00:15:04.268+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:15:04.269833334Z [2024-04-05T00:15:04.269+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:15:04.269850273Z 2024-04-05T00:15:04.276199320Z [2024-04-05T00:15:04.275+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T00:15:04.276748662Z [2024-04-05T00:15:04.276+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:15:04.335102472Z [2024-04-05T00:15:04.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:10:00+00:00 exited with status queued for try_number 1 2024-04-05T00:15:04.335165349Z [2024-04-05T00:15:04.334+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:10:00+00:00 exited with status success for try_number 1 2024-04-05T00:15:04.344919517Z [2024-04-05T00:15:04.342+0000] {scheduler_job.py:635} INFO - Setting external_id for to d88b8dca-0c2b-415e-a3d6-c461119a4356 2024-04-05T00:15:04.345186479Z [2024-04-05T00:15:04.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T00:10:00+00:00, map_index=-1, run_start_date=2024-04-05 00:15:03.702539+00:00, run_end_date=2024-04-05 00:15:04.073552+00:00, run_duration=0.371013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=475, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:15:00.323238+00:00, queued_by_job_id=1, pid=6977 2024-04-05T00:15:05.576401461Z [2024-04-05T00:15:05.575+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:15:05.576831545Z [2024-04-05T00:15:05.576+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:14:00+00:00, run_id=scheduled__2024-04-05T00:14:00+00:00, run_start_date=2024-04-05 00:15:00.261188+00:00, run_end_date=2024-04-05 00:15:05.576401+00:00, run_duration=5.315213, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:14:00+00:00, data_interval_end=2024-04-05 00:15:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:15:05.593260368Z [2024-04-05T00:15:05.592+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:15:00+00:00, run_after=2024-04-05T00:16:00+00:00 2024-04-05T00:15:05.605120926Z [2024-04-05T00:15:05.604+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:15:05.605587976Z [2024-04-05T00:15:05.605+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:14:00+00:00, run_id=scheduled__2024-04-05T00:14:00+00:00, run_start_date=2024-04-05 00:15:00.260106+00:00, run_end_date=2024-04-05 00:15:05.605127+00:00, run_duration=5.345021, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:14:00+00:00, data_interval_end=2024-04-05 00:15:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:15:05.626481971Z [2024-04-05T00:15:05.625+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:15:00+00:00, run_after=2024-04-05T00:16:00+00:00 2024-04-05T00:15:05.691501726Z [2024-04-05T00:15:05.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:14:00+00:00 exited with status success for try_number 1 2024-04-05T00:15:05.691709244Z [2024-04-05T00:15:05.691+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:14:00+00:00 exited with status success for try_number 1 2024-04-05T00:15:05.700832935Z [2024-04-05T00:15:05.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:14:00+00:00, map_index=-1, run_start_date=2024-04-05 00:15:03.424147+00:00, run_end_date=2024-04-05 00:15:05.180427+00:00, run_duration=1.75628, state=success, executor_state=success, try_number=1, max_tries=1, job_id=474, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:15:00.323238+00:00, queued_by_job_id=1, pid=6966 2024-04-05T00:15:05.701244998Z [2024-04-05T00:15:05.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:14:00+00:00, map_index=-1, run_start_date=2024-04-05 00:15:03.845042+00:00, run_end_date=2024-04-05 00:15:05.365830+00:00, run_duration=1.520788, state=success, executor_state=success, try_number=1, max_tries=1, job_id=476, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:15:00.323238+00:00, queued_by_job_id=1, pid=6983 2024-04-05T00:15:06.792384726Z [2024-04-05T00:15:06.791+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:15:06.792436925Z 2024-04-05T00:15:06.792809683Z [2024-04-05T00:15:06.792+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:15:06.794068460Z [2024-04-05T00:15:06.793+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:15:06.794088840Z 2024-04-05T00:15:06.798895833Z [2024-04-05T00:15:06.798+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T00:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T00:15:06.799288788Z [2024-04-05T00:15:06.798+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T00:15:06.856302902Z [2024-04-05T00:15:06.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:10:00+00:00 exited with status queued for try_number 1 2024-04-05T00:15:06.856619679Z [2024-04-05T00:15:06.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:10:00+00:00 exited with status success for try_number 1 2024-04-05T00:15:06.864391954Z [2024-04-05T00:15:06.863+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab5b8927-1d25-498d-b6cf-57780be21dbf 2024-04-05T00:15:06.864755122Z [2024-04-05T00:15:06.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T00:10:00+00:00, map_index=-1, run_start_date=2024-04-05 00:15:06.161043+00:00, run_end_date=2024-04-05 00:15:06.570457+00:00, run_duration=0.409414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=477, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:15:04.270603+00:00, queued_by_job_id=1, pid=7001 2024-04-05T00:15:09.358902814Z [2024-04-05T00:15:09.358+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:15:09.358942371Z 2024-04-05T00:15:09.358996447Z [2024-04-05T00:15:09.358+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:15:09.359746633Z [2024-04-05T00:15:09.359+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:15:09.359757023Z 2024-04-05T00:15:09.362853202Z [2024-04-05T00:15:09.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T00:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:15:09.363087384Z [2024-04-05T00:15:09.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:15:09.417178415Z [2024-04-05T00:15:09.416+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:10:00+00:00 exited with status queued for try_number 1 2024-04-05T00:15:09.417273993Z [2024-04-05T00:15:09.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:10:00+00:00 exited with status success for try_number 1 2024-04-05T00:15:09.425479834Z [2024-04-05T00:15:09.425+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f724c81-4c29-408f-9358-89d17405e934 2024-04-05T00:15:09.425914772Z [2024-04-05T00:15:09.425+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T00:10:00+00:00, map_index=0, run_start_date=2024-04-05 00:15:08.507254+00:00, run_end_date=2024-04-05 00:15:08.850077+00:00, run_duration=0.342823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=478, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:15:06.795237+00:00, queued_by_job_id=1, pid=7009 2024-04-05T00:15:12.816953584Z [2024-04-05T00:15:12.816+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:15:12.817337034Z [2024-04-05T00:15:12.817+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:10:00+00:00, run_id=scheduled__2024-04-05T00:10:00+00:00, run_start_date=2024-04-05 00:15:00.257037+00:00, run_end_date=2024-04-05 00:15:12.816910+00:00, run_duration=12.559873, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:10:00+00:00, data_interval_end=2024-04-05 00:15:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T00:15:12.824532712Z [2024-04-05T00:15:12.824+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:15:00+00:00, run_after=2024-04-05T00:20:00+00:00 2024-04-05T00:15:12.858943233Z [2024-04-05T00:15:12.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:10:00+00:00 exited with status success for try_number 1 2024-04-05T00:15:12.864504515Z [2024-04-05T00:15:12.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T00:10:00+00:00, map_index=-1, run_start_date=2024-04-05 00:15:11.222461+00:00, run_end_date=2024-04-05 00:15:11.620868+00:00, run_duration=0.398407, state=success, executor_state=success, try_number=1, max_tries=1, job_id=479, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:15:09.360260+00:00, queued_by_job_id=1, pid=7027 2024-04-05T00:15:40.326143485Z [2024-04-05T00:15:40.325+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T00:16:00.092347710Z [2024-04-05T00:16:00.091+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:16:00+00:00, run_after=2024-04-05T00:17:00+00:00 2024-04-05T00:16:00.106520543Z [2024-04-05T00:16:00.106+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:16:00.118756099Z [2024-04-05T00:16:00.118+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:16:00.136448338Z [2024-04-05T00:16:00.136+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:16:00+00:00, run_after=2024-04-05T00:17:00+00:00 2024-04-05T00:16:00.212002733Z [2024-04-05T00:16:00.211+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:16:00.212044802Z 2024-04-05T00:16:00.212053864Z 2024-04-05T00:16:00.212059899Z 2024-04-05T00:16:00.212065746Z 2024-04-05T00:16:00.212082807Z [2024-04-05T00:16:00.211+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:16:00.212106178Z [2024-04-05T00:16:00.212+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:16:00.212239362Z [2024-04-05T00:16:00.212+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:16:00.212352618Z [2024-04-05T00:16:00.212+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:16:00.213085226Z [2024-04-05T00:16:00.212+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:16:00.213099235Z 2024-04-05T00:16:00.213126577Z 2024-04-05T00:16:00.213132984Z 2024-04-05T00:16:00.213138550Z 2024-04-05T00:16:00.217601245Z [2024-04-05T00:16:00.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:16:00.217641042Z [2024-04-05T00:16:00.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:16:00.217936013Z [2024-04-05T00:16:00.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:16:00.218106921Z [2024-04-05T00:16:00.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:16:00.218331027Z [2024-04-05T00:16:00.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:16:00.218439148Z [2024-04-05T00:16:00.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:16:00.218605126Z [2024-04-05T00:16:00.218+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:16:00.218662483Z [2024-04-05T00:16:00.218+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:16:00.617345495Z [2024-04-05T00:16:00.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:14:00+00:00 exited with status queued for try_number 1 2024-04-05T00:16:00.617434704Z [2024-04-05T00:16:00.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:15:00+00:00 exited with status queued for try_number 1 2024-04-05T00:16:00.617555844Z [2024-04-05T00:16:00.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:15:00+00:00 exited with status queued for try_number 1 2024-04-05T00:16:00.617657908Z [2024-04-05T00:16:00.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:15:00+00:00 exited with status queued for try_number 1 2024-04-05T00:16:00.633922317Z [2024-04-05T00:16:00.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17a03233-21ce-44c1-ad23-026ae4a079bc 2024-04-05T00:16:00.634127824Z [2024-04-05T00:16:00.633+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1fedd89-1dcd-48e4-9c35-48e67d158264 2024-04-05T00:16:00.634280825Z [2024-04-05T00:16:00.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71058ce3-6a70-41e7-919d-9086887ad3d7 2024-04-05T00:16:00.634436991Z [2024-04-05T00:16:00.634+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2bf3f68d-4179-48e7-a0b1-947159006198 2024-04-05T00:16:03.151309715Z [2024-04-05T00:16:03.150+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:16:03.151796538Z [2024-04-05T00:16:03.151+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:14:00+00:00, run_id=scheduled__2024-04-05T00:14:00+00:00, run_start_date=2024-04-05 00:16:00.145684+00:00, run_end_date=2024-04-05 00:16:03.151192+00:00, run_duration=3.005508, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:14:00+00:00, data_interval_end=2024-04-05 00:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:16:03.161407085Z [2024-04-05T00:16:03.160+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:16:00+00:00, run_after=2024-04-05T00:18:00+00:00 2024-04-05T00:16:03.169668768Z [2024-04-05T00:16:03.169+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:16:03.169937604Z [2024-04-05T00:16:03.169+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:15:00+00:00, run_id=scheduled__2024-04-05T00:15:00+00:00, run_start_date=2024-04-05 00:16:00.146812+00:00, run_end_date=2024-04-05 00:16:03.169570+00:00, run_duration=3.022758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:15:00+00:00, data_interval_end=2024-04-05 00:16:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:16:03.180609898Z [2024-04-05T00:16:03.180+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:16:00+00:00, run_after=2024-04-05T00:17:00+00:00 2024-04-05T00:16:03.248854905Z [2024-04-05T00:16:03.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:14:00+00:00 exited with status success for try_number 1 2024-04-05T00:16:03.249216347Z [2024-04-05T00:16:03.248+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:15:00+00:00 exited with status success for try_number 1 2024-04-05T00:16:03.262341735Z [2024-04-05T00:16:03.261+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:14:00+00:00, map_index=-1, run_start_date=2024-04-05 00:16:01.670384+00:00, run_end_date=2024-04-05 00:16:02.291390+00:00, run_duration=0.621006, state=success, executor_state=success, try_number=1, max_tries=1, job_id=480, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:16:00.214138+00:00, queued_by_job_id=1, pid=7040 2024-04-05T00:16:03.262711487Z [2024-04-05T00:16:03.262+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:15:00+00:00, map_index=-1, run_start_date=2024-04-05 00:16:02.005418+00:00, run_end_date=2024-04-05 00:16:02.509461+00:00, run_duration=0.504043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=481, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:16:00.214138+00:00, queued_by_job_id=1, pid=7042 2024-04-05T00:16:04.299828565Z [2024-04-05T00:16:04.299+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:16:04.300150062Z [2024-04-05T00:16:04.299+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:15:00+00:00, run_id=scheduled__2024-04-05T00:15:00+00:00, run_start_date=2024-04-05 00:16:00.147969+00:00, run_end_date=2024-04-05 00:16:04.299732+00:00, run_duration=4.151763, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:15:00+00:00, data_interval_end=2024-04-05 00:16:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:16:04.308977072Z [2024-04-05T00:16:04.308+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:16:00+00:00, run_after=2024-04-05T00:17:00+00:00 2024-04-05T00:16:05.412895860Z [2024-04-05T00:16:05.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:16:05.413418983Z [2024-04-05T00:16:05.413+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:15:00+00:00, run_id=scheduled__2024-04-05T00:15:00+00:00, run_start_date=2024-04-05 00:16:00.149830+00:00, run_end_date=2024-04-05 00:16:05.412919+00:00, run_duration=5.263089, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:15:00+00:00, data_interval_end=2024-04-05 00:16:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:16:05.427278943Z [2024-04-05T00:16:05.426+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:16:00+00:00, run_after=2024-04-05T00:17:00+00:00 2024-04-05T00:16:05.466289503Z [2024-04-05T00:16:05.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:15:00+00:00 exited with status success for try_number 1 2024-04-05T00:16:05.466668100Z [2024-04-05T00:16:05.466+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:15:00+00:00 exited with status success for try_number 1 2024-04-05T00:16:05.475822794Z [2024-04-05T00:16:05.475+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:15:00+00:00, map_index=-1, run_start_date=2024-04-05 00:16:03.056049+00:00, run_end_date=2024-04-05 00:16:04.265000+00:00, run_duration=1.208951, state=success, executor_state=success, try_number=1, max_tries=1, job_id=482, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:16:00.214138+00:00, queued_by_job_id=1, pid=7064 2024-04-05T00:16:05.476403467Z [2024-04-05T00:16:05.476+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:15:00+00:00, map_index=-1, run_start_date=2024-04-05 00:16:03.147186+00:00, run_end_date=2024-04-05 00:16:04.802757+00:00, run_duration=1.655571, state=success, executor_state=success, try_number=1, max_tries=1, job_id=483, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:16:00.214138+00:00, queued_by_job_id=1, pid=7065 2024-04-05T00:17:00.251082002Z [2024-04-05T00:17:00.250+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:17:00.267990202Z [2024-04-05T00:17:00.267+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:17:00+00:00, run_after=2024-04-05T00:18:00+00:00 2024-04-05T00:17:00.280792175Z [2024-04-05T00:17:00.280+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:17:00+00:00, run_after=2024-04-05T00:18:00+00:00 2024-04-05T00:17:00.344503463Z [2024-04-05T00:17:00.344+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:17:00.344526785Z 2024-04-05T00:17:00.344530812Z 2024-04-05T00:17:00.344534422Z 2024-04-05T00:17:00.344882265Z [2024-04-05T00:17:00.344+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:17:00.345171514Z [2024-04-05T00:17:00.344+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:17:00.345459714Z [2024-04-05T00:17:00.345+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:17:00.347024785Z [2024-04-05T00:17:00.346+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:17:00.347036364Z 2024-04-05T00:17:00.347040134Z 2024-04-05T00:17:00.347043392Z 2024-04-05T00:17:00.352643071Z [2024-04-05T00:17:00.352+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:17:00.352859382Z [2024-04-05T00:17:00.352+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:17:00.353212772Z [2024-04-05T00:17:00.353+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:17:00.353390708Z [2024-04-05T00:17:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:17:00.353807147Z [2024-04-05T00:17:00.353+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:17:00.354052215Z [2024-04-05T00:17:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:17:00.718751535Z [2024-04-05T00:17:00.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:16:00+00:00 exited with status queued for try_number 1 2024-04-05T00:17:00.718816239Z [2024-04-05T00:17:00.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:16:00+00:00 exited with status queued for try_number 1 2024-04-05T00:17:00.722899714Z [2024-04-05T00:17:00.718+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:16:00+00:00 exited with status queued for try_number 1 2024-04-05T00:17:00.736922252Z [2024-04-05T00:17:00.736+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8047607b-554c-4875-93c8-5689f632ad88 2024-04-05T00:17:00.737283529Z [2024-04-05T00:17:00.736+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e72bb81-6ad8-4bda-8832-ddd72586edba 2024-04-05T00:17:00.737489754Z [2024-04-05T00:17:00.737+0000] {scheduler_job.py:635} INFO - Setting external_id for to 25a35f25-d9d6-4050-aad5-08fd5a8b6bf1 2024-04-05T00:17:04.027632442Z [2024-04-05T00:17:04.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:17:04.027827111Z [2024-04-05T00:17:04.027+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:16:00+00:00, run_id=scheduled__2024-04-05T00:16:00+00:00, run_start_date=2024-04-05 00:17:00.290376+00:00, run_end_date=2024-04-05 00:17:04.027430+00:00, run_duration=3.737054, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:16:00+00:00, data_interval_end=2024-04-05 00:17:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:17:04.038496859Z [2024-04-05T00:17:04.038+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:17:00+00:00, run_after=2024-04-05T00:18:00+00:00 2024-04-05T00:17:04.095212582Z [2024-04-05T00:17:04.094+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:16:00+00:00 exited with status success for try_number 1 2024-04-05T00:17:04.101085839Z [2024-04-05T00:17:04.100+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:16:00+00:00, map_index=-1, run_start_date=2024-04-05 00:17:02.389466+00:00, run_end_date=2024-04-05 00:17:02.983818+00:00, run_duration=0.594352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=484, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:17:00.348579+00:00, queued_by_job_id=1, pid=7098 2024-04-05T00:17:06.221953343Z [2024-04-05T00:17:06.221+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:17:06.222100958Z [2024-04-05T00:17:06.221+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:16:00+00:00, run_id=scheduled__2024-04-05T00:16:00+00:00, run_start_date=2024-04-05 00:17:00.291490+00:00, run_end_date=2024-04-05 00:17:06.221863+00:00, run_duration=5.930373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:16:00+00:00, data_interval_end=2024-04-05 00:17:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:17:06.230960212Z [2024-04-05T00:17:06.230+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:17:00+00:00, run_after=2024-04-05T00:18:00+00:00 2024-04-05T00:17:06.282840748Z [2024-04-05T00:17:06.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:16:00+00:00 exited with status success for try_number 1 2024-04-05T00:17:06.283297977Z [2024-04-05T00:17:06.282+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:16:00+00:00, map_index=-1, run_start_date=2024-04-05 00:17:03.659264+00:00, run_end_date=2024-04-05 00:17:05.720675+00:00, run_duration=2.061411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=486, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:17:00.348579+00:00, queued_by_job_id=1, pid=7117 2024-04-05T00:17:06.726929932Z [2024-04-05T00:17:06.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:17:06.727321358Z [2024-04-05T00:17:06.727+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:16:00+00:00, run_id=scheduled__2024-04-05T00:16:00+00:00, run_start_date=2024-04-05 00:17:00.293253+00:00, run_end_date=2024-04-05 00:17:06.726886+00:00, run_duration=6.433633, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:16:00+00:00, data_interval_end=2024-04-05 00:17:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:17:06.738271573Z [2024-04-05T00:17:06.737+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:17:00+00:00, run_after=2024-04-05T00:18:00+00:00 2024-04-05T00:17:07.853598855Z [2024-04-05T00:17:07.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:16:00+00:00 exited with status success for try_number 1 2024-04-05T00:17:07.858966621Z [2024-04-05T00:17:07.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:16:00+00:00, map_index=-1, run_start_date=2024-04-05 00:17:03.608231+00:00, run_end_date=2024-04-05 00:17:06.628074+00:00, run_duration=3.019843, state=success, executor_state=success, try_number=1, max_tries=1, job_id=485, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:17:00.348579+00:00, queued_by_job_id=1, pid=7116 2024-04-05T00:18:00.628485155Z [2024-04-05T00:18:00.628+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:18:00+00:00, run_after=2024-04-05T00:19:00+00:00 2024-04-05T00:18:00.642134089Z [2024-04-05T00:18:00.641+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:18:00+00:00, run_after=2024-04-05T00:19:00+00:00 2024-04-05T00:18:00.649554549Z [2024-04-05T00:18:00.649+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:18:00.656865186Z [2024-04-05T00:18:00.656+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:18:00.755142230Z [2024-04-05T00:18:00.754+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:18:00.755175319Z 2024-04-05T00:18:00.755186422Z 2024-04-05T00:18:00.755191823Z 2024-04-05T00:18:00.755195465Z 2024-04-05T00:18:00.755646836Z [2024-04-05T00:18:00.755+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:18:00.755971619Z [2024-04-05T00:18:00.755+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:18:00.756275019Z [2024-04-05T00:18:00.756+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:18:00.756495338Z [2024-04-05T00:18:00.756+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:18:00.757427480Z [2024-04-05T00:18:00.757+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:18:00.757441780Z 2024-04-05T00:18:00.757447009Z 2024-04-05T00:18:00.757451315Z 2024-04-05T00:18:00.757455515Z 2024-04-05T00:18:00.762393881Z [2024-04-05T00:18:00.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:18:00.762775723Z [2024-04-05T00:18:00.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:18:00.763274467Z [2024-04-05T00:18:00.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:18:00.763632112Z [2024-04-05T00:18:00.763+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:18:00.764324715Z [2024-04-05T00:18:00.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:18:00.764704098Z [2024-04-05T00:18:00.764+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:18:00.765155604Z [2024-04-05T00:18:00.764+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:18:00.765526802Z [2024-04-05T00:18:00.765+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:18:01.596697324Z [2024-04-05T00:18:01.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:16:00+00:00 exited with status queued for try_number 1 2024-04-05T00:18:01.596766874Z [2024-04-05T00:18:01.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:17:00+00:00 exited with status queued for try_number 1 2024-04-05T00:18:01.596772881Z [2024-04-05T00:18:01.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:17:00+00:00 exited with status queued for try_number 1 2024-04-05T00:18:01.596849442Z [2024-04-05T00:18:01.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:17:00+00:00 exited with status queued for try_number 1 2024-04-05T00:18:01.645257540Z [2024-04-05T00:18:01.644+0000] {scheduler_job.py:635} INFO - Setting external_id for to e48086dd-21f1-457c-b352-1dd2dcfe98f3 2024-04-05T00:18:01.645291126Z [2024-04-05T00:18:01.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c5f1840-6d46-4147-a189-34b226a1eae2 2024-04-05T00:18:01.645416734Z [2024-04-05T00:18:01.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a729adc-1792-4be3-af16-d118948225ec 2024-04-05T00:18:01.645530928Z [2024-04-05T00:18:01.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to e9d68dd7-8216-49f3-80bf-0a54f977175a 2024-04-05T00:18:03.856311979Z [2024-04-05T00:18:03.855+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:18:03.856748028Z [2024-04-05T00:18:03.856+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:16:00+00:00, run_id=scheduled__2024-04-05T00:16:00+00:00, run_start_date=2024-04-05 00:18:00.671291+00:00, run_end_date=2024-04-05 00:18:03.856163+00:00, run_duration=3.184872, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:16:00+00:00, data_interval_end=2024-04-05 00:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:18:03.865746405Z [2024-04-05T00:18:03.865+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:18:00+00:00, run_after=2024-04-05T00:20:00+00:00 2024-04-05T00:18:03.874252217Z [2024-04-05T00:18:03.873+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:18:03.874570519Z [2024-04-05T00:18:03.874+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:17:00+00:00, run_id=scheduled__2024-04-05T00:17:00+00:00, run_start_date=2024-04-05 00:18:00.673121+00:00, run_end_date=2024-04-05 00:18:03.874140+00:00, run_duration=3.201019, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:17:00+00:00, data_interval_end=2024-04-05 00:18:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:18:03.886149653Z [2024-04-05T00:18:03.885+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:18:00+00:00, run_after=2024-04-05T00:19:00+00:00 2024-04-05T00:18:03.941373183Z [2024-04-05T00:18:03.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:16:00+00:00 exited with status success for try_number 1 2024-04-05T00:18:03.941600618Z [2024-04-05T00:18:03.941+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:17:00+00:00 exited with status success for try_number 1 2024-04-05T00:18:03.952491682Z [2024-04-05T00:18:03.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:16:00+00:00, map_index=-1, run_start_date=2024-04-05 00:18:02.930061+00:00, run_end_date=2024-04-05 00:18:03.604520+00:00, run_duration=0.674459, state=success, executor_state=success, try_number=1, max_tries=1, job_id=488, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:18:00.758846+00:00, queued_by_job_id=1, pid=7152 2024-04-05T00:18:03.953290156Z [2024-04-05T00:18:03.952+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:17:00+00:00, map_index=-1, run_start_date=2024-04-05 00:18:02.782825+00:00, run_end_date=2024-04-05 00:18:03.280085+00:00, run_duration=0.49726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=487, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:18:00.758846+00:00, queued_by_job_id=1, pid=7151 2024-04-05T00:18:06.105577083Z [2024-04-05T00:18:06.105+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:18:06.106391450Z [2024-04-05T00:18:06.105+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:17:00+00:00, run_id=scheduled__2024-04-05T00:17:00+00:00, run_start_date=2024-04-05 00:18:00.674892+00:00, run_end_date=2024-04-05 00:18:06.105720+00:00, run_duration=5.430828, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:17:00+00:00, data_interval_end=2024-04-05 00:18:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:18:06.118756418Z [2024-04-05T00:18:06.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:18:00+00:00, run_after=2024-04-05T00:19:00+00:00 2024-04-05T00:18:06.163649197Z [2024-04-05T00:18:06.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:17:00+00:00 exited with status success for try_number 1 2024-04-05T00:18:06.169766921Z [2024-04-05T00:18:06.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:17:00+00:00, map_index=-1, run_start_date=2024-04-05 00:18:04.127738+00:00, run_end_date=2024-04-05 00:18:05.699298+00:00, run_duration=1.57156, state=success, executor_state=success, try_number=1, max_tries=1, job_id=489, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:18:00.758846+00:00, queued_by_job_id=1, pid=7175 2024-04-05T00:18:07.216664850Z [2024-04-05T00:18:07.216+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:18:07.217315928Z [2024-04-05T00:18:07.217+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:17:00+00:00, run_id=scheduled__2024-04-05T00:17:00+00:00, run_start_date=2024-04-05 00:18:00.676676+00:00, run_end_date=2024-04-05 00:18:07.216825+00:00, run_duration=6.540149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:17:00+00:00, data_interval_end=2024-04-05 00:18:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:18:07.228199959Z [2024-04-05T00:18:07.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:18:00+00:00, run_after=2024-04-05T00:19:00+00:00 2024-04-05T00:18:07.260156118Z [2024-04-05T00:18:07.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:17:00+00:00 exited with status success for try_number 1 2024-04-05T00:18:07.265682578Z [2024-04-05T00:18:07.265+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:17:00+00:00, map_index=-1, run_start_date=2024-04-05 00:18:04.202766+00:00, run_end_date=2024-04-05 00:18:06.626723+00:00, run_duration=2.423957, state=success, executor_state=success, try_number=1, max_tries=1, job_id=490, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:18:00.758846+00:00, queued_by_job_id=1, pid=7176 2024-04-05T00:19:01.024088234Z [2024-04-05T00:19:01.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:19:00+00:00, run_after=2024-04-05T00:20:00+00:00 2024-04-05T00:19:01.043913073Z [2024-04-05T00:19:01.043+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:19:00+00:00, run_after=2024-04-05T00:20:00+00:00 2024-04-05T00:19:01.054192817Z [2024-04-05T00:19:01.053+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:19:01.179637981Z [2024-04-05T00:19:01.173+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:19:01.179665251Z 2024-04-05T00:19:01.179669410Z 2024-04-05T00:19:01.179672766Z 2024-04-05T00:19:01.179676071Z [2024-04-05T00:19:01.173+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:19:01.179679217Z [2024-04-05T00:19:01.174+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:19:01.179682199Z [2024-04-05T00:19:01.174+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:19:01.179698625Z [2024-04-05T00:19:01.175+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:19:01.179702131Z 2024-04-05T00:19:01.179705061Z 2024-04-05T00:19:01.179708104Z 2024-04-05T00:19:01.203647582Z [2024-04-05T00:19:01.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:19:01.203675138Z [2024-04-05T00:19:01.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:19:01.203678749Z [2024-04-05T00:19:01.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:19:01.203682292Z [2024-04-05T00:19:01.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:19:01.203685644Z [2024-04-05T00:19:01.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:19:01.203688936Z [2024-04-05T00:19:01.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:19:01.586426424Z [2024-04-05T00:19:01.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:18:00+00:00 exited with status queued for try_number 1 2024-04-05T00:19:01.586687322Z [2024-04-05T00:19:01.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:18:00+00:00 exited with status queued for try_number 1 2024-04-05T00:19:01.586878742Z [2024-04-05T00:19:01.586+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:18:00+00:00 exited with status queued for try_number 1 2024-04-05T00:19:01.596597117Z [2024-04-05T00:19:01.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to c597ead6-3fee-40da-84ce-7fb23bfa5fd3 2024-04-05T00:19:01.596975469Z [2024-04-05T00:19:01.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc2c93a9-d769-4463-9287-265bb13ab430 2024-04-05T00:19:01.597211842Z [2024-04-05T00:19:01.597+0000] {scheduler_job.py:635} INFO - Setting external_id for to edc767c1-1fae-4259-a3cb-16c215732ae9 2024-04-05T00:19:02.822849685Z [2024-04-05T00:19:02.822+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:19:02.823396998Z [2024-04-05T00:19:02.823+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:18:00+00:00, run_id=scheduled__2024-04-05T00:18:00+00:00, run_start_date=2024-04-05 00:19:01.071023+00:00, run_end_date=2024-04-05 00:19:02.822738+00:00, run_duration=1.751715, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:18:00+00:00, data_interval_end=2024-04-05 00:19:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:19:02.842147221Z [2024-04-05T00:19:02.841+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:19:00+00:00, run_after=2024-04-05T00:20:00+00:00 2024-04-05T00:19:02.926846143Z [2024-04-05T00:19:02.926+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:18:00+00:00 exited with status success for try_number 1 2024-04-05T00:19:02.936150129Z [2024-04-05T00:19:02.935+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:18:00+00:00, map_index=-1, run_start_date=2024-04-05 00:19:02.174982+00:00, run_end_date=2024-04-05 00:19:02.707935+00:00, run_duration=0.532953, state=success, executor_state=success, try_number=1, max_tries=1, job_id=491, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:19:01.182510+00:00, queued_by_job_id=1, pid=7208 2024-04-05T00:19:05.836539460Z [2024-04-05T00:19:05.836+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:19:05.836673206Z [2024-04-05T00:19:05.836+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:18:00+00:00, run_id=scheduled__2024-04-05T00:18:00+00:00, run_start_date=2024-04-05 00:19:01.074156+00:00, run_end_date=2024-04-05 00:19:05.836400+00:00, run_duration=4.762244, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:18:00+00:00, data_interval_end=2024-04-05 00:19:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:19:05.845607257Z [2024-04-05T00:19:05.845+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:19:00+00:00, run_after=2024-04-05T00:20:00+00:00 2024-04-05T00:19:05.854339543Z [2024-04-05T00:19:05.853+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:19:05.854577100Z [2024-04-05T00:19:05.854+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:18:00+00:00, run_id=scheduled__2024-04-05T00:18:00+00:00, run_start_date=2024-04-05 00:19:01.077109+00:00, run_end_date=2024-04-05 00:19:05.854244+00:00, run_duration=4.777135, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:18:00+00:00, data_interval_end=2024-04-05 00:19:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:19:05.863818848Z [2024-04-05T00:19:05.863+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:19:00+00:00, run_after=2024-04-05T00:20:00+00:00 2024-04-05T00:19:05.893248071Z [2024-04-05T00:19:05.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:18:00+00:00 exited with status success for try_number 1 2024-04-05T00:19:05.893373603Z [2024-04-05T00:19:05.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:18:00+00:00 exited with status success for try_number 1 2024-04-05T00:19:05.901713385Z [2024-04-05T00:19:05.901+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:18:00+00:00, map_index=-1, run_start_date=2024-04-05 00:19:03.682295+00:00, run_end_date=2024-04-05 00:19:05.449858+00:00, run_duration=1.767563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=493, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:19:01.182510+00:00, queued_by_job_id=1, pid=7227 2024-04-05T00:19:05.901889668Z [2024-04-05T00:19:05.901+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:18:00+00:00, map_index=-1, run_start_date=2024-04-05 00:19:03.395145+00:00, run_end_date=2024-04-05 00:19:05.512551+00:00, run_duration=2.117406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=492, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:19:01.182510+00:00, queued_by_job_id=1, pid=7221 2024-04-05T00:20:00.408673038Z [2024-04-05T00:20:00.408+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:20:00+00:00, run_after=2024-04-05T00:21:00+00:00 2024-04-05T00:20:00.415627227Z [2024-04-05T00:20:00.415+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:20:00.431653868Z [2024-04-05T00:20:00.431+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:20:00+00:00, run_after=2024-04-05T00:21:00+00:00 2024-04-05T00:20:00.450626148Z [2024-04-05T00:20:00.450+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:20:00+00:00, run_after=2024-04-05T00:25:00+00:00 2024-04-05T00:20:00.458625583Z [2024-04-05T00:20:00.458+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:20:00.568994924Z [2024-04-05T00:20:00.568+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T00:20:00.569029090Z 2024-04-05T00:20:00.569048025Z 2024-04-05T00:20:00.569051818Z 2024-04-05T00:20:00.569054937Z 2024-04-05T00:20:00.569057996Z 2024-04-05T00:20:00.569836661Z [2024-04-05T00:20:00.569+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:20:00.570219226Z [2024-04-05T00:20:00.570+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:20:00.570610600Z [2024-04-05T00:20:00.570+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:20:00.570906652Z [2024-04-05T00:20:00.570+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:20:00.571198302Z [2024-04-05T00:20:00.571+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:20:00.572276104Z [2024-04-05T00:20:00.572+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:20:00.572290900Z 2024-04-05T00:20:00.572295824Z 2024-04-05T00:20:00.572300285Z 2024-04-05T00:20:00.572304730Z 2024-04-05T00:20:00.572360749Z 2024-04-05T00:20:00.577503018Z [2024-04-05T00:20:00.577+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T00:20:00.577858079Z [2024-04-05T00:20:00.577+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:20:00.578225976Z [2024-04-05T00:20:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:20:00.578480841Z [2024-04-05T00:20:00.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:20:00.578850655Z [2024-04-05T00:20:00.578+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:20:00.579126032Z [2024-04-05T00:20:00.578+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:20:00.579500302Z [2024-04-05T00:20:00.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:20:00.579846600Z [2024-04-05T00:20:00.579+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:20:00.580193264Z [2024-04-05T00:20:00.580+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:20:00.580478313Z [2024-04-05T00:20:00.580+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:20:01.179705145Z [2024-04-05T00:20:01.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:15:00+00:00 exited with status queued for try_number 1 2024-04-05T00:20:01.179737335Z [2024-04-05T00:20:01.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:18:00+00:00 exited with status queued for try_number 1 2024-04-05T00:20:01.179744865Z [2024-04-05T00:20:01.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:19:00+00:00 exited with status queued for try_number 1 2024-04-05T00:20:01.179748401Z [2024-04-05T00:20:01.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:19:00+00:00 exited with status queued for try_number 1 2024-04-05T00:20:01.179751690Z [2024-04-05T00:20:01.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:19:00+00:00 exited with status queued for try_number 1 2024-04-05T00:20:01.209369707Z [2024-04-05T00:20:01.203+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f95be46-fe98-452f-8613-7da42b245019 2024-04-05T00:20:01.209405265Z [2024-04-05T00:20:01.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to af27069a-0f0b-49bf-aed5-cf3f3d934f47 2024-04-05T00:20:01.209409162Z [2024-04-05T00:20:01.204+0000] {scheduler_job.py:635} INFO - Setting external_id for to 550c9af2-9756-42ad-bc5a-6cd830afa428 2024-04-05T00:20:01.215764060Z [2024-04-05T00:20:01.209+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc0e23ed-88d9-470b-9ede-2a9fda7cbd08 2024-04-05T00:20:01.215794012Z [2024-04-05T00:20:01.210+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5873ce8-299b-4a0f-9616-ccab07976c8a 2024-04-05T00:20:02.647012322Z [2024-04-05T00:20:02.644+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:20:02.647039905Z [2024-04-05T00:20:02.644+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:18:00+00:00, run_id=scheduled__2024-04-05T00:18:00+00:00, run_start_date=2024-04-05 00:20:00.473779+00:00, run_end_date=2024-04-05 00:20:02.644632+00:00, run_duration=2.170853, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:18:00+00:00, data_interval_end=2024-04-05 00:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:20:02.662675166Z [2024-04-05T00:20:02.662+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:20:00+00:00, run_after=2024-04-05T00:22:00+00:00 2024-04-05T00:20:02.747867409Z [2024-04-05T00:20:02.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:18:00+00:00 exited with status success for try_number 1 2024-04-05T00:20:02.756695285Z [2024-04-05T00:20:02.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:18:00+00:00, map_index=-1, run_start_date=2024-04-05 00:20:01.971924+00:00, run_end_date=2024-04-05 00:20:02.477658+00:00, run_duration=0.505734, state=success, executor_state=success, try_number=1, max_tries=1, job_id=494, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:20:00.573880+00:00, queued_by_job_id=1, pid=7261 2024-04-05T00:20:03.802358597Z [2024-04-05T00:20:03.801+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:20:03.802537437Z [2024-04-05T00:20:03.802+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:19:00+00:00, run_id=scheduled__2024-04-05T00:19:00+00:00, run_start_date=2024-04-05 00:20:00.475172+00:00, run_end_date=2024-04-05 00:20:03.802264+00:00, run_duration=3.327092, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:19:00+00:00, data_interval_end=2024-04-05 00:20:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:20:03.823273054Z [2024-04-05T00:20:03.822+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:20:00+00:00, run_after=2024-04-05T00:21:00+00:00 2024-04-05T00:20:03.933565163Z [2024-04-05T00:20:03.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:19:00+00:00 exited with status success for try_number 1 2024-04-05T00:20:03.942356788Z [2024-04-05T00:20:03.941+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:19:00+00:00, map_index=-1, run_start_date=2024-04-05 00:20:02.180247+00:00, run_end_date=2024-04-05 00:20:02.757204+00:00, run_duration=0.576957, state=success, executor_state=success, try_number=1, max_tries=1, job_id=495, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:20:00.573880+00:00, queued_by_job_id=1, pid=7262 2024-04-05T00:20:04.464038006Z [2024-04-05T00:20:04.463+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:20:04.464068419Z 2024-04-05T00:20:04.464487704Z [2024-04-05T00:20:04.464+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:20:04.465624079Z [2024-04-05T00:20:04.465+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:20:04.465639331Z 2024-04-05T00:20:04.470066083Z [2024-04-05T00:20:04.469+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T00:20:04.470391120Z [2024-04-05T00:20:04.470+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:20:04.524066261Z [2024-04-05T00:20:04.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:15:00+00:00 exited with status queued for try_number 1 2024-04-05T00:20:04.524187432Z [2024-04-05T00:20:04.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:15:00+00:00 exited with status success for try_number 1 2024-04-05T00:20:04.531887849Z [2024-04-05T00:20:04.531+0000] {scheduler_job.py:635} INFO - Setting external_id for to 32ec4ce7-27c4-4e15-8d25-3dd3d728d076 2024-04-05T00:20:04.532028108Z [2024-04-05T00:20:04.531+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T00:15:00+00:00, map_index=-1, run_start_date=2024-04-05 00:20:03.428030+00:00, run_end_date=2024-04-05 00:20:03.910830+00:00, run_duration=0.4828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=496, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:20:00.573880+00:00, queued_by_job_id=1, pid=7291 2024-04-05T00:20:05.727742993Z [2024-04-05T00:20:05.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:20:05.728372791Z [2024-04-05T00:20:05.728+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:19:00+00:00, run_id=scheduled__2024-04-05T00:19:00+00:00, run_start_date=2024-04-05 00:20:00.476486+00:00, run_end_date=2024-04-05 00:20:05.727861+00:00, run_duration=5.251375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:19:00+00:00, data_interval_end=2024-04-05 00:20:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:20:05.741418719Z [2024-04-05T00:20:05.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:20:00+00:00, run_after=2024-04-05T00:21:00+00:00 2024-04-05T00:20:05.750944548Z [2024-04-05T00:20:05.750+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:20:05.751435129Z [2024-04-05T00:20:05.751+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:19:00+00:00, run_id=scheduled__2024-04-05T00:19:00+00:00, run_start_date=2024-04-05 00:20:00.477563+00:00, run_end_date=2024-04-05 00:20:05.750798+00:00, run_duration=5.273235, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:19:00+00:00, data_interval_end=2024-04-05 00:20:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:20:05.766277043Z [2024-04-05T00:20:05.765+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:20:00+00:00, run_after=2024-04-05T00:21:00+00:00 2024-04-05T00:20:05.836246180Z [2024-04-05T00:20:05.835+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:19:00+00:00 exited with status success for try_number 1 2024-04-05T00:20:05.836525344Z [2024-04-05T00:20:05.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:19:00+00:00 exited with status success for try_number 1 2024-04-05T00:20:05.844928954Z [2024-04-05T00:20:05.844+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:19:00+00:00, map_index=-1, run_start_date=2024-04-05 00:20:03.676868+00:00, run_end_date=2024-04-05 00:20:05.010980+00:00, run_duration=1.334112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=498, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:20:00.573880+00:00, queued_by_job_id=1, pid=7293 2024-04-05T00:20:05.845343341Z [2024-04-05T00:20:05.845+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:19:00+00:00, map_index=-1, run_start_date=2024-04-05 00:20:03.672608+00:00, run_end_date=2024-04-05 00:20:05.326599+00:00, run_duration=1.653991, state=success, executor_state=success, try_number=1, max_tries=1, job_id=497, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:20:00.573880+00:00, queued_by_job_id=1, pid=7292 2024-04-05T00:20:06.924136426Z [2024-04-05T00:20:06.923+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:20:06.924192347Z 2024-04-05T00:20:06.924498446Z [2024-04-05T00:20:06.924+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:20:06.925444499Z [2024-04-05T00:20:06.925+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:20:06.925500444Z 2024-04-05T00:20:06.928646310Z [2024-04-05T00:20:06.928+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T00:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T00:20:06.928877606Z [2024-04-05T00:20:06.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T00:20:06.983794393Z [2024-04-05T00:20:06.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:15:00+00:00 exited with status queued for try_number 1 2024-04-05T00:20:06.983879728Z [2024-04-05T00:20:06.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:15:00+00:00 exited with status success for try_number 1 2024-04-05T00:20:06.992529769Z [2024-04-05T00:20:06.992+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7029d8d-bffa-4dc0-9629-36f772a144bc 2024-04-05T00:20:06.992917994Z [2024-04-05T00:20:06.992+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T00:15:00+00:00, map_index=-1, run_start_date=2024-04-05 00:20:06.109145+00:00, run_end_date=2024-04-05 00:20:06.461570+00:00, run_duration=0.352425, state=success, executor_state=success, try_number=1, max_tries=1, job_id=499, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:20:04.466333+00:00, queued_by_job_id=1, pid=7316 2024-04-05T00:20:09.263988498Z [2024-04-05T00:20:09.263+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:20:09.264032706Z 2024-04-05T00:20:09.264069963Z [2024-04-05T00:20:09.263+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:20:09.264653672Z [2024-04-05T00:20:09.264+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:20:09.264674551Z 2024-04-05T00:20:09.267775248Z [2024-04-05T00:20:09.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T00:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:20:09.267844006Z [2024-04-05T00:20:09.267+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:20:09.360930131Z [2024-04-05T00:20:09.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:15:00+00:00 exited with status queued for try_number 1 2024-04-05T00:20:09.361169931Z [2024-04-05T00:20:09.360+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:15:00+00:00 exited with status success for try_number 1 2024-04-05T00:20:09.371425540Z [2024-04-05T00:20:09.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to 588b82a6-3575-4c49-8513-e81604192cb0 2024-04-05T00:20:09.371882137Z [2024-04-05T00:20:09.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T00:15:00+00:00, map_index=0, run_start_date=2024-04-05 00:20:08.579239+00:00, run_end_date=2024-04-05 00:20:08.929445+00:00, run_duration=0.350206, state=success, executor_state=success, try_number=1, max_tries=1, job_id=500, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:20:06.925941+00:00, queued_by_job_id=1, pid=7324 2024-04-05T00:20:11.718348255Z [2024-04-05T00:20:11.717+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:20:11.718744498Z [2024-04-05T00:20:11.718+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:15:00+00:00, run_id=scheduled__2024-04-05T00:15:00+00:00, run_start_date=2024-04-05 00:20:00.472237+00:00, run_end_date=2024-04-05 00:20:11.718291+00:00, run_duration=11.246054, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:15:00+00:00, data_interval_end=2024-04-05 00:20:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T00:20:11.728382791Z [2024-04-05T00:20:11.728+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:20:00+00:00, run_after=2024-04-05T00:25:00+00:00 2024-04-05T00:20:11.785691058Z [2024-04-05T00:20:11.782+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:15:00+00:00 exited with status success for try_number 1 2024-04-05T00:20:11.796252989Z [2024-04-05T00:20:11.795+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T00:15:00+00:00, map_index=-1, run_start_date=2024-04-05 00:20:11.065758+00:00, run_end_date=2024-04-05 00:20:11.440802+00:00, run_duration=0.375044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=501, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:20:09.265130+00:00, queued_by_job_id=1, pid=7341 2024-04-05T00:20:40.384596694Z [2024-04-05T00:20:40.384+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T00:21:00.269259192Z [2024-04-05T00:21:00.268+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:21:00.285265078Z [2024-04-05T00:21:00.284+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:21:00+00:00, run_after=2024-04-05T00:22:00+00:00 2024-04-05T00:21:00.302455458Z [2024-04-05T00:21:00.302+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:21:00+00:00, run_after=2024-04-05T00:22:00+00:00 2024-04-05T00:21:00.377242144Z [2024-04-05T00:21:00.376+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:21:00.377274768Z 2024-04-05T00:21:00.377281456Z 2024-04-05T00:21:00.377287882Z 2024-04-05T00:21:00.377303775Z [2024-04-05T00:21:00.377+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:21:00.377380255Z [2024-04-05T00:21:00.377+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:21:00.377486358Z [2024-04-05T00:21:00.377+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:21:00.378053317Z [2024-04-05T00:21:00.377+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:21:00.378064327Z 2024-04-05T00:21:00.378070100Z 2024-04-05T00:21:00.378075817Z 2024-04-05T00:21:00.381186171Z [2024-04-05T00:21:00.380+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:21:00.381421247Z [2024-04-05T00:21:00.381+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:21:00.381617006Z [2024-04-05T00:21:00.381+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:21:00.381679545Z [2024-04-05T00:21:00.381+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:21:00.381846264Z [2024-04-05T00:21:00.381+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:21:00.381898908Z [2024-04-05T00:21:00.381+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:21:00.852518423Z [2024-04-05T00:21:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:20:00+00:00 exited with status queued for try_number 1 2024-04-05T00:21:00.852589042Z [2024-04-05T00:21:00.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:20:00+00:00 exited with status queued for try_number 1 2024-04-05T00:21:00.852602425Z [2024-04-05T00:21:00.852+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:20:00+00:00 exited with status queued for try_number 1 2024-04-05T00:21:00.872525069Z [2024-04-05T00:21:00.872+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2af161dc-1b3d-4fb9-92c0-193e04b20af6 2024-04-05T00:21:00.872590251Z [2024-04-05T00:21:00.872+0000] {scheduler_job.py:635} INFO - Setting external_id for to c32b853f-f4a8-4089-b2fb-117561f47c97 2024-04-05T00:21:00.872647195Z [2024-04-05T00:21:00.872+0000] {scheduler_job.py:635} INFO - Setting external_id for to afe9befe-9dc9-4873-a080-20918b39fecc 2024-04-05T00:21:02.146591884Z [2024-04-05T00:21:02.145+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:21:02.147204973Z [2024-04-05T00:21:02.146+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:20:00+00:00, run_id=scheduled__2024-04-05T00:20:00+00:00, run_start_date=2024-04-05 00:21:00.316449+00:00, run_end_date=2024-04-05 00:21:02.146533+00:00, run_duration=1.830084, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:20:00+00:00, data_interval_end=2024-04-05 00:21:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:21:02.166356980Z [2024-04-05T00:21:02.165+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:21:00+00:00, run_after=2024-04-05T00:22:00+00:00 2024-04-05T00:21:03.339730320Z [2024-04-05T00:21:03.339+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:20:00+00:00 exited with status success for try_number 1 2024-04-05T00:21:03.349140068Z [2024-04-05T00:21:03.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:20:00+00:00, map_index=-1, run_start_date=2024-04-05 00:21:01.636938+00:00, run_end_date=2024-04-05 00:21:02.066807+00:00, run_duration=0.429869, state=success, executor_state=success, try_number=1, max_tries=1, job_id=502, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:21:00.378888+00:00, queued_by_job_id=1, pid=7353 2024-04-05T00:21:04.394158917Z [2024-04-05T00:21:04.393+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:21:04.394198297Z [2024-04-05T00:21:04.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:20:00+00:00, run_id=scheduled__2024-04-05T00:20:00+00:00, run_start_date=2024-04-05 00:21:00.318133+00:00, run_end_date=2024-04-05 00:21:04.393905+00:00, run_duration=4.075772, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:20:00+00:00, data_interval_end=2024-04-05 00:21:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:21:04.402636896Z [2024-04-05T00:21:04.402+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:21:00+00:00, run_after=2024-04-05T00:22:00+00:00 2024-04-05T00:21:04.445576628Z [2024-04-05T00:21:04.445+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:20:00+00:00 exited with status success for try_number 1 2024-04-05T00:21:04.451517451Z [2024-04-05T00:21:04.451+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:20:00+00:00, map_index=-1, run_start_date=2024-04-05 00:21:02.560521+00:00, run_end_date=2024-04-05 00:21:04.074217+00:00, run_duration=1.513696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=503, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:21:00.378888+00:00, queued_by_job_id=1, pid=7366 2024-04-05T00:21:05.498815940Z [2024-04-05T00:21:05.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:21:05.499267363Z [2024-04-05T00:21:05.499+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:20:00+00:00, run_id=scheduled__2024-04-05T00:20:00+00:00, run_start_date=2024-04-05 00:21:00.319745+00:00, run_end_date=2024-04-05 00:21:05.498831+00:00, run_duration=5.179086, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:20:00+00:00, data_interval_end=2024-04-05 00:21:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:21:05.509786319Z [2024-04-05T00:21:05.509+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:21:00+00:00, run_after=2024-04-05T00:22:00+00:00 2024-04-05T00:21:05.541459303Z [2024-04-05T00:21:05.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:20:00+00:00 exited with status success for try_number 1 2024-04-05T00:21:05.547542954Z [2024-04-05T00:21:05.547+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:20:00+00:00, map_index=-1, run_start_date=2024-04-05 00:21:02.953227+00:00, run_end_date=2024-04-05 00:21:05.069396+00:00, run_duration=2.116169, state=success, executor_state=success, try_number=1, max_tries=1, job_id=504, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:21:00.378888+00:00, queued_by_job_id=1, pid=7377 2024-04-05T00:22:01.025405576Z [2024-04-05T00:22:01.024+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:22:01.049762020Z [2024-04-05T00:22:01.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:22:00+00:00, run_after=2024-04-05T00:23:00+00:00 2024-04-05T00:22:01.077681467Z [2024-04-05T00:22:01.076+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:22:00+00:00, run_after=2024-04-05T00:23:00+00:00 2024-04-05T00:22:01.089025964Z [2024-04-05T00:22:01.088+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:22:01.223696253Z [2024-04-05T00:22:01.219+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:22:01.223742657Z 2024-04-05T00:22:01.223747671Z 2024-04-05T00:22:01.223751329Z 2024-04-05T00:22:01.223754730Z 2024-04-05T00:22:01.223759374Z [2024-04-05T00:22:01.220+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:22:01.223762787Z [2024-04-05T00:22:01.220+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:22:01.223766347Z [2024-04-05T00:22:01.220+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:22:01.223769366Z [2024-04-05T00:22:01.220+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:22:01.223935115Z [2024-04-05T00:22:01.222+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:22:01.223941857Z 2024-04-05T00:22:01.223947234Z 2024-04-05T00:22:01.223950437Z 2024-04-05T00:22:01.223953675Z 2024-04-05T00:22:01.233829853Z [2024-04-05T00:22:01.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:22:01.233862565Z [2024-04-05T00:22:01.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:22:01.233883764Z [2024-04-05T00:22:01.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:22:01.233886992Z [2024-04-05T00:22:01.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:22:01.233890119Z [2024-04-05T00:22:01.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:22:01.233893724Z [2024-04-05T00:22:01.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:22:01.235526976Z [2024-04-05T00:22:01.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:22:01.235552129Z [2024-04-05T00:22:01.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:22:01.812230702Z [2024-04-05T00:22:01.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:20:00+00:00 exited with status queued for try_number 1 2024-04-05T00:22:01.812260552Z [2024-04-05T00:22:01.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:21:00+00:00 exited with status queued for try_number 1 2024-04-05T00:22:01.812264825Z [2024-04-05T00:22:01.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:21:00+00:00 exited with status queued for try_number 1 2024-04-05T00:22:01.812268735Z [2024-04-05T00:22:01.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:21:00+00:00 exited with status queued for try_number 1 2024-04-05T00:22:01.831719168Z [2024-04-05T00:22:01.824+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d996d4b-1aeb-4a62-b406-cb6a82b1ceb2 2024-04-05T00:22:01.831748643Z [2024-04-05T00:22:01.825+0000] {scheduler_job.py:635} INFO - Setting external_id for to 472daeb7-7bd1-448f-8313-d408f85773c8 2024-04-05T00:22:01.831754920Z [2024-04-05T00:22:01.825+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7bc4e1a6-c0af-43b6-a055-629b6d78371b 2024-04-05T00:22:01.831795328Z [2024-04-05T00:22:01.825+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64a17581-5c37-4e66-bddf-f4b4cefa029a 2024-04-05T00:22:03.193517277Z [2024-04-05T00:22:03.193+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:21:00+00:00 exited with status success for try_number 1 2024-04-05T00:22:03.203967789Z [2024-04-05T00:22:03.203+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:21:00+00:00, map_index=-1, run_start_date=2024-04-05 00:22:02.367747+00:00, run_end_date=2024-04-05 00:22:02.968522+00:00, run_duration=0.600775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=505, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:22:01.223440+00:00, queued_by_job_id=1, pid=7406 2024-04-05T00:22:04.242091308Z [2024-04-05T00:22:04.241+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:22:04.242446484Z [2024-04-05T00:22:04.242+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:20:00+00:00, run_id=scheduled__2024-04-05T00:20:00+00:00, run_start_date=2024-04-05 00:22:01.103852+00:00, run_end_date=2024-04-05 00:22:04.241991+00:00, run_duration=3.138139, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:20:00+00:00, data_interval_end=2024-04-05 00:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:22:04.252560265Z [2024-04-05T00:22:04.252+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:22:00+00:00, run_after=2024-04-05T00:24:00+00:00 2024-04-05T00:22:04.261213411Z [2024-04-05T00:22:04.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:22:04.261724875Z [2024-04-05T00:22:04.261+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:21:00+00:00, run_id=scheduled__2024-04-05T00:21:00+00:00, run_start_date=2024-04-05 00:22:01.105776+00:00, run_end_date=2024-04-05 00:22:04.261074+00:00, run_duration=3.155298, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:21:00+00:00, data_interval_end=2024-04-05 00:22:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:22:04.272405926Z [2024-04-05T00:22:04.272+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:22:00+00:00, run_after=2024-04-05T00:23:00+00:00 2024-04-05T00:22:04.343014768Z [2024-04-05T00:22:04.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:20:00+00:00 exited with status success for try_number 1 2024-04-05T00:22:04.349520094Z [2024-04-05T00:22:04.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:20:00+00:00, map_index=-1, run_start_date=2024-04-05 00:22:02.464380+00:00, run_end_date=2024-04-05 00:22:03.157268+00:00, run_duration=0.692888, state=success, executor_state=success, try_number=1, max_tries=1, job_id=506, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:22:01.223440+00:00, queued_by_job_id=1, pid=7407 2024-04-05T00:22:06.500157882Z [2024-04-05T00:22:06.499+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:22:06.500726526Z [2024-04-05T00:22:06.500+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:21:00+00:00, run_id=scheduled__2024-04-05T00:21:00+00:00, run_start_date=2024-04-05 00:22:01.108658+00:00, run_end_date=2024-04-05 00:22:06.500088+00:00, run_duration=5.39143, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:21:00+00:00, data_interval_end=2024-04-05 00:22:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:22:06.514786355Z [2024-04-05T00:22:06.514+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:22:00+00:00, run_after=2024-04-05T00:23:00+00:00 2024-04-05T00:22:06.557314309Z [2024-04-05T00:22:06.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:21:00+00:00 exited with status success for try_number 1 2024-04-05T00:22:06.565089361Z [2024-04-05T00:22:06.564+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:21:00+00:00, map_index=-1, run_start_date=2024-04-05 00:22:03.774390+00:00, run_end_date=2024-04-05 00:22:05.604902+00:00, run_duration=1.830512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=507, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:22:01.223440+00:00, queued_by_job_id=1, pid=7425 2024-04-05T00:22:06.911190691Z [2024-04-05T00:22:06.910+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:22:06.911702304Z [2024-04-05T00:22:06.911+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:21:00+00:00, run_id=scheduled__2024-04-05T00:21:00+00:00, run_start_date=2024-04-05 00:22:01.106935+00:00, run_end_date=2024-04-05 00:22:06.911049+00:00, run_duration=5.804114, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:21:00+00:00, data_interval_end=2024-04-05 00:22:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:22:06.923023235Z [2024-04-05T00:22:06.922+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:22:00+00:00, run_after=2024-04-05T00:23:00+00:00 2024-04-05T00:22:06.965115276Z [2024-04-05T00:22:06.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:21:00+00:00 exited with status success for try_number 1 2024-04-05T00:22:06.972726213Z [2024-04-05T00:22:06.972+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:21:00+00:00, map_index=-1, run_start_date=2024-04-05 00:22:04.151096+00:00, run_end_date=2024-04-05 00:22:06.594075+00:00, run_duration=2.442979, state=success, executor_state=success, try_number=1, max_tries=1, job_id=508, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:22:01.223440+00:00, queued_by_job_id=1, pid=7436 2024-04-05T00:22:25.311315655Z [2024-04-05T00:22:25.310+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886 to 2024-04-05T00:22:00+00:00, run_after=2024-04-05T00:23:00+00:00 2024-04-05T00:22:25.349872691Z [2024-04-05T00:22:25.349+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:22:25.349896687Z 2024-04-05T00:22:25.350189698Z [2024-04-05T00:22:25.349+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886 has 0/16 running and queued tasks 2024-04-05T00:22:25.350822045Z [2024-04-05T00:22:25.350+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:22:25.350836002Z 2024-04-05T00:22:25.354538508Z [2024-04-05T00:22:25.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:22:25.354625191Z [2024-04-05T00:22:25.354+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:22:25.409533869Z [2024-04-05T00:22:25.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:21:00+00:00 exited with status queued for try_number 1 2024-04-05T00:22:25.414525354Z [2024-04-05T00:22:25.414+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3a34f6c-6efa-49a4-99e3-e56ecc13a470 2024-04-05T00:22:27.213668704Z [2024-04-05T00:22:27.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:22:27.214311615Z [2024-04-05T00:22:27.213+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886, execution_date=2024-04-05 00:21:00+00:00, run_id=scheduled__2024-04-05T00:21:00+00:00, run_start_date=2024-04-05 00:22:25.321702+00:00, run_end_date=2024-04-05 00:22:27.213796+00:00, run_duration=1.892094, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:21:00+00:00, data_interval_end=2024-04-05 00:22:00+00:00, dag_hash=a5810c22a42d42dad5fd831cef61936d 2024-04-05T00:22:27.225777465Z [2024-04-05T00:22:27.225+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886 to 2024-04-05T00:22:00+00:00, run_after=2024-04-05T00:23:00+00:00 2024-04-05T00:22:27.252202430Z [2024-04-05T00:22:27.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:21:00+00:00 exited with status success for try_number 1 2024-04-05T00:22:27.257000655Z [2024-04-05T00:22:27.256+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:21:00+00:00, map_index=-1, run_start_date=2024-04-05 00:22:26.015790+00:00, run_end_date=2024-04-05 00:22:26.413612+00:00, run_duration=0.397822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=509, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:22:25.351155+00:00, queued_by_job_id=1, pid=7461 2024-04-05T00:23:00.295478666Z [2024-04-05T00:23:00.295+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886 to 2024-04-05T00:23:00+00:00, run_after=2024-04-05T00:24:00+00:00 2024-04-05T00:23:00.302790334Z [2024-04-05T00:23:00.302+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:23:00.316282727Z [2024-04-05T00:23:00.315+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:23:00+00:00, run_after=2024-04-05T00:24:00+00:00 2024-04-05T00:23:00.333406042Z [2024-04-05T00:23:00.333+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:23:00+00:00, run_after=2024-04-05T00:24:00+00:00 2024-04-05T00:23:00.418196150Z [2024-04-05T00:23:00.417+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:23:00.418231975Z 2024-04-05T00:23:00.418235918Z 2024-04-05T00:23:00.418239213Z 2024-04-05T00:23:00.418242717Z 2024-04-05T00:23:00.418252553Z [2024-04-05T00:23:00.418+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:23:00.418372178Z [2024-04-05T00:23:00.418+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:23:00.418488663Z [2024-04-05T00:23:00.418+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:23:00.418599744Z [2024-04-05T00:23:00.418+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886 has 0/16 running and queued tasks 2024-04-05T00:23:00.419496702Z [2024-04-05T00:23:00.419+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:23:00.419504602Z 2024-04-05T00:23:00.419507901Z 2024-04-05T00:23:00.419510985Z 2024-04-05T00:23:00.419514274Z 2024-04-05T00:23:00.425030903Z [2024-04-05T00:23:00.424+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:23:00.425129014Z [2024-04-05T00:23:00.424+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:23:00.425520424Z [2024-04-05T00:23:00.425+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:23:00.425640652Z [2024-04-05T00:23:00.425+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:23:00.425811167Z [2024-04-05T00:23:00.425+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:23:00.425892880Z [2024-04-05T00:23:00.425+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:23:00.426044094Z [2024-04-05T00:23:00.425+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:23:00.426123377Z [2024-04-05T00:23:00.426+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:23:00.984399366Z [2024-04-05T00:23:00.983+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:22:00+00:00 exited with status queued for try_number 1 2024-04-05T00:23:00.987831669Z [2024-04-05T00:23:00.984+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:22:00+00:00 exited with status queued for try_number 1 2024-04-05T00:23:00.988051795Z [2024-04-05T00:23:00.987+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:22:00+00:00 exited with status queued for try_number 1 2024-04-05T00:23:00.988106848Z [2024-04-05T00:23:00.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:22:00+00:00 exited with status queued for try_number 1 2024-04-05T00:23:01.029141897Z [2024-04-05T00:23:01.028+0000] {scheduler_job.py:635} INFO - Setting external_id for to 117be46e-b52e-4cfd-89c8-ba872d14173b 2024-04-05T00:23:01.029214365Z [2024-04-05T00:23:01.029+0000] {scheduler_job.py:635} INFO - Setting external_id for to 56b04ebc-ae6e-4055-a6e9-625375c0a946 2024-04-05T00:23:01.036057858Z [2024-04-05T00:23:01.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to 168b3983-de62-4d6e-9e80-a67691ff7502 2024-04-05T00:23:01.036181892Z [2024-04-05T00:23:01.036+0000] {scheduler_job.py:635} INFO - Setting external_id for to c8b2d843-b622-4dd7-827e-a07d70a1d45a 2024-04-05T00:23:02.521468288Z [2024-04-05T00:23:02.521+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:23:02.521970519Z [2024-04-05T00:23:02.521+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886, execution_date=2024-04-05 00:22:00+00:00, run_id=scheduled__2024-04-05T00:22:00+00:00, run_start_date=2024-04-05 00:23:00.343464+00:00, run_end_date=2024-04-05 00:23:02.521520+00:00, run_duration=2.178056, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:22:00+00:00, data_interval_end=2024-04-05 00:23:00+00:00, dag_hash=a5810c22a42d42dad5fd831cef61936d 2024-04-05T00:23:02.536663516Z [2024-04-05T00:23:02.536+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886 to 2024-04-05T00:23:00+00:00, run_after=2024-04-05T00:24:00+00:00 2024-04-05T00:23:02.545706824Z [2024-04-05T00:23:02.545+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:23:02.546022589Z [2024-04-05T00:23:02.545+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:22:00+00:00, run_id=scheduled__2024-04-05T00:22:00+00:00, run_start_date=2024-04-05 00:23:00.344686+00:00, run_end_date=2024-04-05 00:23:02.545726+00:00, run_duration=2.20104, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:22:00+00:00, data_interval_end=2024-04-05 00:23:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:23:02.558246064Z [2024-04-05T00:23:02.557+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:23:00+00:00, run_after=2024-04-05T00:24:00+00:00 2024-04-05T00:23:02.644775634Z [2024-04-05T00:23:02.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:22:00+00:00 exited with status success for try_number 1 2024-04-05T00:23:02.644815032Z [2024-04-05T00:23:02.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:22:00+00:00 exited with status success for try_number 1 2024-04-05T00:23:02.654886448Z [2024-04-05T00:23:02.654+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:22:00+00:00, map_index=-1, run_start_date=2024-04-05 00:23:01.938128+00:00, run_end_date=2024-04-05 00:23:02.344686+00:00, run_duration=0.406558, state=success, executor_state=success, try_number=1, max_tries=1, job_id=511, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:23:00.421493+00:00, queued_by_job_id=1, pid=7483 2024-04-05T00:23:02.654990457Z [2024-04-05T00:23:02.654+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:22:00+00:00, map_index=-1, run_start_date=2024-04-05 00:23:01.842682+00:00, run_end_date=2024-04-05 00:23:02.369311+00:00, run_duration=0.526629, state=success, executor_state=success, try_number=1, max_tries=1, job_id=510, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:23:00.421493+00:00, queued_by_job_id=1, pid=7482 2024-04-05T00:23:04.823634026Z [2024-04-05T00:23:04.823+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:23:04.823863784Z [2024-04-05T00:23:04.823+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:22:00+00:00, run_id=scheduled__2024-04-05T00:22:00+00:00, run_start_date=2024-04-05 00:23:00.346780+00:00, run_end_date=2024-04-05 00:23:04.823457+00:00, run_duration=4.476677, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:22:00+00:00, data_interval_end=2024-04-05 00:23:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:23:04.833627923Z [2024-04-05T00:23:04.833+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:23:00+00:00, run_after=2024-04-05T00:24:00+00:00 2024-04-05T00:23:04.841386212Z [2024-04-05T00:23:04.840+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:23:04.841908940Z [2024-04-05T00:23:04.841+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:22:00+00:00, run_id=scheduled__2024-04-05T00:22:00+00:00, run_start_date=2024-04-05 00:23:00.345794+00:00, run_end_date=2024-04-05 00:23:04.841435+00:00, run_duration=4.495641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:22:00+00:00, data_interval_end=2024-04-05 00:23:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:23:04.854525903Z [2024-04-05T00:23:04.854+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:23:00+00:00, run_after=2024-04-05T00:24:00+00:00 2024-04-05T00:23:04.897503116Z [2024-04-05T00:23:04.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:22:00+00:00 exited with status success for try_number 1 2024-04-05T00:23:04.897711913Z [2024-04-05T00:23:04.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:22:00+00:00 exited with status success for try_number 1 2024-04-05T00:23:04.904728515Z [2024-04-05T00:23:04.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:22:00+00:00, map_index=-1, run_start_date=2024-04-05 00:23:03.087431+00:00, run_end_date=2024-04-05 00:23:04.283009+00:00, run_duration=1.195578, state=success, executor_state=success, try_number=1, max_tries=1, job_id=513, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:23:00.421493+00:00, queued_by_job_id=1, pid=7511 2024-04-05T00:23:04.905038929Z [2024-04-05T00:23:04.904+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:22:00+00:00, map_index=-1, run_start_date=2024-04-05 00:23:02.719807+00:00, run_end_date=2024-04-05 00:23:04.302931+00:00, run_duration=1.583124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=512, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:23:00.421493+00:00, queued_by_job_id=1, pid=7500 2024-04-05T00:24:00.493552206Z [2024-04-05T00:24:00.493+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:24:00+00:00, run_after=2024-04-05T00:25:00+00:00 2024-04-05T00:24:00.512376039Z [2024-04-05T00:24:00.511+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:24:00+00:00, run_after=2024-04-05T00:25:00+00:00 2024-04-05T00:24:00.519681585Z [2024-04-05T00:24:00.519+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:24:00.526811644Z [2024-04-05T00:24:00.526+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:24:00.548116010Z [2024-04-05T00:24:00.547+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886 to 2024-04-05T00:24:00+00:00, run_after=2024-04-05T00:25:00+00:00 2024-04-05T00:24:00.657333039Z [2024-04-05T00:24:00.656+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T00:24:00.657364196Z 2024-04-05T00:24:00.657370596Z 2024-04-05T00:24:00.657375697Z 2024-04-05T00:24:00.657380359Z 2024-04-05T00:24:00.657385285Z 2024-04-05T00:24:00.662061903Z [2024-04-05T00:24:00.657+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:24:00.662350630Z [2024-04-05T00:24:00.662+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:24:00.662531717Z [2024-04-05T00:24:00.662+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:24:00.662732451Z [2024-04-05T00:24:00.662+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:24:00.662917226Z [2024-04-05T00:24:00.662+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886 has 0/16 running and queued tasks 2024-04-05T00:24:00.663675595Z [2024-04-05T00:24:00.663+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:24:00.663687634Z 2024-04-05T00:24:00.663691150Z 2024-04-05T00:24:00.663694148Z 2024-04-05T00:24:00.663697238Z 2024-04-05T00:24:00.663700155Z 2024-04-05T00:24:00.669702800Z [2024-04-05T00:24:00.669+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:24:00.670308401Z [2024-04-05T00:24:00.669+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:24:00.670843152Z [2024-04-05T00:24:00.670+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:24:00.671185655Z [2024-04-05T00:24:00.670+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:24:00.671789195Z [2024-04-05T00:24:00.671+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:24:00.672263168Z [2024-04-05T00:24:00.671+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:24:00.672835340Z [2024-04-05T00:24:00.672+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:24:00.673277149Z [2024-04-05T00:24:00.672+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:24:00.673773660Z [2024-04-05T00:24:00.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:24:00.674131536Z [2024-04-05T00:24:00.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:24:01.154118245Z [2024-04-05T00:24:01.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:22:00+00:00 exited with status queued for try_number 1 2024-04-05T00:24:01.186440930Z [2024-04-05T00:24:01.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:23:00+00:00 exited with status queued for try_number 1 2024-04-05T00:24:01.186474804Z [2024-04-05T00:24:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:23:00+00:00 exited with status queued for try_number 1 2024-04-05T00:24:01.186480411Z [2024-04-05T00:24:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:23:00+00:00 exited with status queued for try_number 1 2024-04-05T00:24:01.186485392Z [2024-04-05T00:24:01.180+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:23:00+00:00 exited with status queued for try_number 1 2024-04-05T00:24:01.251060398Z [2024-04-05T00:24:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to a1c36fb0-b47e-41ce-8fdc-6d0afa214223 2024-04-05T00:24:01.251090102Z [2024-04-05T00:24:01.247+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad01e30f-657d-4368-98df-979df34cd4cd 2024-04-05T00:24:01.251094051Z [2024-04-05T00:24:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8447e49e-f9e7-415b-a5bb-05844522583a 2024-04-05T00:24:01.251097417Z [2024-04-05T00:24:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to 486aadd4-a9a8-4a58-97b1-c11be5c8cb43 2024-04-05T00:24:01.251101240Z [2024-04-05T00:24:01.248+0000] {scheduler_job.py:635} INFO - Setting external_id for to a26c8f5b-416b-47bf-9eec-a221adf8a549 2024-04-05T00:24:02.853649365Z [2024-04-05T00:24:02.853+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:23:00+00:00 exited with status failed for try_number 1 2024-04-05T00:24:02.859122532Z [2024-04-05T00:24:02.858+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:23:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:24:00.665263+00:00, queued_by_job_id=1, pid=None 2024-04-05T00:24:02.859492994Z [2024-04-05T00:24:02.859+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T00:24:02.862034857Z [2024-04-05T00:24:02.861+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T00:24:02.878291654Z [2024-04-05T00:24:02.877+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=sdnc_status_9ef54b87-f8e5-4e56-9590-a5edf0ce3886, task_id=get_sdnc_status_and_send_to_prometheus, execution_date=20240405T002300, start_date=, end_date=20240405T002402 2024-04-05T00:24:03.476108275Z [2024-04-05T00:24:03.475+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:24:03.476745413Z [2024-04-05T00:24:03.476+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:23:00+00:00, run_id=scheduled__2024-04-05T00:23:00+00:00, run_start_date=2024-04-05 00:24:00.566446+00:00, run_end_date=2024-04-05 00:24:03.476040+00:00, run_duration=2.909594, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:23:00+00:00, data_interval_end=2024-04-05 00:24:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:24:03.495246895Z [2024-04-05T00:24:03.494+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:24:00+00:00, run_after=2024-04-05T00:25:00+00:00 2024-04-05T00:24:03.503315722Z [2024-04-05T00:24:03.502+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:24:03.503729302Z [2024-04-05T00:24:03.503+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:22:00+00:00, run_id=scheduled__2024-04-05T00:22:00+00:00, run_start_date=2024-04-05 00:24:00.562650+00:00, run_end_date=2024-04-05 00:24:03.503221+00:00, run_duration=2.940571, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:22:00+00:00, data_interval_end=2024-04-05 00:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:24:03.513164971Z [2024-04-05T00:24:03.512+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:24:00+00:00, run_after=2024-04-05T00:26:00+00:00 2024-04-05T00:24:03.579347484Z [2024-04-05T00:24:03.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:22:00+00:00 exited with status success for try_number 1 2024-04-05T00:24:03.579396331Z [2024-04-05T00:24:03.579+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:23:00+00:00 exited with status success for try_number 1 2024-04-05T00:24:03.587281556Z [2024-04-05T00:24:03.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:22:00+00:00, map_index=-1, run_start_date=2024-04-05 00:24:02.313909+00:00, run_end_date=2024-04-05 00:24:02.777534+00:00, run_duration=0.463625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=514, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:24:00.665263+00:00, queued_by_job_id=1, pid=7551 2024-04-05T00:24:03.587616357Z [2024-04-05T00:24:03.587+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:23:00+00:00, map_index=-1, run_start_date=2024-04-05 00:24:02.363303+00:00, run_end_date=2024-04-05 00:24:02.910198+00:00, run_duration=0.546895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=515, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:24:00.665263+00:00, queued_by_job_id=1, pid=7552 2024-04-05T00:24:04.644290175Z [2024-04-05T00:24:04.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:24:04.644415775Z [2024-04-05T00:24:04.644+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:23:00+00:00, run_id=scheduled__2024-04-05T00:23:00+00:00, run_start_date=2024-04-05 00:24:00.567771+00:00, run_end_date=2024-04-05 00:24:04.644011+00:00, run_duration=4.07624, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:23:00+00:00, data_interval_end=2024-04-05 00:24:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:24:04.653521327Z [2024-04-05T00:24:04.653+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:24:00+00:00, run_after=2024-04-05T00:25:00+00:00 2024-04-05T00:24:04.704788894Z [2024-04-05T00:24:04.704+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:23:00+00:00 exited with status success for try_number 1 2024-04-05T00:24:04.710406031Z [2024-04-05T00:24:04.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:23:00+00:00, map_index=-1, run_start_date=2024-04-05 00:24:03.112685+00:00, run_end_date=2024-04-05 00:24:04.339276+00:00, run_duration=1.226591, state=success, executor_state=success, try_number=1, max_tries=1, job_id=516, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:24:00.665263+00:00, queued_by_job_id=1, pid=7569 2024-04-05T00:24:05.758709929Z [2024-04-05T00:24:05.758+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:24:05.759069576Z [2024-04-05T00:24:05.758+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:23:00+00:00, run_id=scheduled__2024-04-05T00:23:00+00:00, run_start_date=2024-04-05 00:24:00.569130+00:00, run_end_date=2024-04-05 00:24:05.758621+00:00, run_duration=5.189491, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:23:00+00:00, data_interval_end=2024-04-05 00:24:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:24:05.769808998Z [2024-04-05T00:24:05.769+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:24:00+00:00, run_after=2024-04-05T00:25:00+00:00 2024-04-05T00:24:05.814723952Z [2024-04-05T00:24:05.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:23:00+00:00 exited with status success for try_number 1 2024-04-05T00:24:05.819538677Z [2024-04-05T00:24:05.819+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:23:00+00:00, map_index=-1, run_start_date=2024-04-05 00:24:03.704373+00:00, run_end_date=2024-04-05 00:24:05.545265+00:00, run_duration=1.840892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=517, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:24:00.665263+00:00, queued_by_job_id=1, pid=7580 2024-04-05T00:25:00.286398040Z [2024-04-05T00:25:00.285+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:25:00.299845733Z [2024-04-05T00:25:00.299+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:25:00+00:00, run_after=2024-04-05T00:26:00+00:00 2024-04-05T00:25:00.313632830Z [2024-04-05T00:25:00.313+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:25:00+00:00, run_after=2024-04-05T00:30:00+00:00 2024-04-05T00:25:00.328219782Z [2024-04-05T00:25:00.327+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:25:00+00:00, run_after=2024-04-05T00:26:00+00:00 2024-04-05T00:25:00.423906473Z [2024-04-05T00:25:00.423+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:25:00.423944432Z 2024-04-05T00:25:00.423953590Z 2024-04-05T00:25:00.423957132Z 2024-04-05T00:25:00.423960604Z 2024-04-05T00:25:00.424232690Z [2024-04-05T00:25:00.424+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:25:00.424534857Z [2024-04-05T00:25:00.424+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:25:00.425086230Z [2024-04-05T00:25:00.424+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:25:00.425358230Z [2024-04-05T00:25:00.425+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:25:00.426299974Z [2024-04-05T00:25:00.426+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:25:00.426313618Z 2024-04-05T00:25:00.426318452Z 2024-04-05T00:25:00.426323060Z 2024-04-05T00:25:00.426347106Z 2024-04-05T00:25:00.431009377Z [2024-04-05T00:25:00.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T00:25:00.431425495Z [2024-04-05T00:25:00.431+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:25:00.431837329Z [2024-04-05T00:25:00.431+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:25:00.432069921Z [2024-04-05T00:25:00.431+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:25:00.432499621Z [2024-04-05T00:25:00.432+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:25:00.432735053Z [2024-04-05T00:25:00.432+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:25:00.433047925Z [2024-04-05T00:25:00.432+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:25:00.433268180Z [2024-04-05T00:25:00.433+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:25:00.899475110Z [2024-04-05T00:25:00.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:20:00+00:00 exited with status queued for try_number 1 2024-04-05T00:25:00.899657724Z [2024-04-05T00:25:00.899+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:24:00+00:00 exited with status queued for try_number 1 2024-04-05T00:25:00.901902366Z [2024-04-05T00:25:00.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:24:00+00:00 exited with status queued for try_number 1 2024-04-05T00:25:00.902016527Z [2024-04-05T00:25:00.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:24:00+00:00 exited with status queued for try_number 1 2024-04-05T00:25:00.927419247Z [2024-04-05T00:25:00.927+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c0abab5-081c-4e70-ad27-b67c57997a8d 2024-04-05T00:25:00.927488465Z [2024-04-05T00:25:00.927+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d64f9e7-d046-4c9d-81e6-e8d12c535f62 2024-04-05T00:25:00.927655005Z [2024-04-05T00:25:00.927+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f59c4a1-45d0-4456-8a8b-10b9696f9a5b 2024-04-05T00:25:00.927900493Z [2024-04-05T00:25:00.927+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90eeba45-0b50-4477-b305-05be88bf6364 2024-04-05T00:25:03.385114164Z [2024-04-05T00:25:03.384+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:25:03.385884935Z [2024-04-05T00:25:03.385+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:24:00+00:00, run_id=scheduled__2024-04-05T00:24:00+00:00, run_start_date=2024-04-05 00:25:00.343523+00:00, run_end_date=2024-04-05 00:25:03.385293+00:00, run_duration=3.04177, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:24:00+00:00, data_interval_end=2024-04-05 00:25:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:25:03.435523142Z [2024-04-05T00:25:03.435+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:25:00+00:00, run_after=2024-04-05T00:26:00+00:00 2024-04-05T00:25:03.579854497Z [2024-04-05T00:25:03.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:24:00+00:00 exited with status success for try_number 1 2024-04-05T00:25:03.587346683Z [2024-04-05T00:25:03.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:24:00+00:00, map_index=-1, run_start_date=2024-04-05 00:25:01.841131+00:00, run_end_date=2024-04-05 00:25:02.692136+00:00, run_duration=0.851005, state=success, executor_state=success, try_number=1, max_tries=1, job_id=518, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:25:00.427744+00:00, queued_by_job_id=1, pid=7609 2024-04-05T00:25:04.363793119Z [2024-04-05T00:25:04.363+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:25:04.363827386Z 2024-04-05T00:25:04.363833888Z [2024-04-05T00:25:04.363+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:25:04.364456845Z [2024-04-05T00:25:04.364+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:25:04.364524631Z 2024-04-05T00:25:04.367919169Z [2024-04-05T00:25:04.367+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T00:25:04.367957498Z [2024-04-05T00:25:04.367+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:25:04.454182113Z [2024-04-05T00:25:04.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:20:00+00:00 exited with status queued for try_number 1 2024-04-05T00:25:04.454230532Z [2024-04-05T00:25:04.453+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:20:00+00:00 exited with status success for try_number 1 2024-04-05T00:25:04.460834114Z [2024-04-05T00:25:04.460+0000] {scheduler_job.py:635} INFO - Setting external_id for to 58861733-b41c-45cf-b794-7c211294b564 2024-04-05T00:25:04.461096123Z [2024-04-05T00:25:04.460+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T00:20:00+00:00, map_index=-1, run_start_date=2024-04-05 00:25:03.586893+00:00, run_end_date=2024-04-05 00:25:04.053626+00:00, run_duration=0.466733, state=success, executor_state=success, try_number=1, max_tries=1, job_id=519, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:25:00.427744+00:00, queued_by_job_id=1, pid=7623 2024-04-05T00:25:05.680058601Z [2024-04-05T00:25:05.679+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:25:05.680723151Z [2024-04-05T00:25:05.680+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:24:00+00:00, run_id=scheduled__2024-04-05T00:24:00+00:00, run_start_date=2024-04-05 00:25:00.344569+00:00, run_end_date=2024-04-05 00:25:05.680196+00:00, run_duration=5.335627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:24:00+00:00, data_interval_end=2024-04-05 00:25:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:25:05.703044446Z [2024-04-05T00:25:05.702+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:25:00+00:00, run_after=2024-04-05T00:26:00+00:00 2024-04-05T00:25:05.815882963Z [2024-04-05T00:25:05.815+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:24:00+00:00 exited with status success for try_number 1 2024-04-05T00:25:05.823944107Z [2024-04-05T00:25:05.823+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:24:00+00:00, map_index=-1, run_start_date=2024-04-05 00:25:03.855170+00:00, run_end_date=2024-04-05 00:25:05.255844+00:00, run_duration=1.400674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=520, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:25:00.427744+00:00, queued_by_job_id=1, pid=7634 2024-04-05T00:25:06.877771094Z [2024-04-05T00:25:06.877+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:25:06.878280515Z [2024-04-05T00:25:06.877+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:24:00+00:00, run_id=scheduled__2024-04-05T00:24:00+00:00, run_start_date=2024-04-05 00:25:00.345551+00:00, run_end_date=2024-04-05 00:25:06.877668+00:00, run_duration=6.532117, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:24:00+00:00, data_interval_end=2024-04-05 00:25:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:25:06.894246298Z [2024-04-05T00:25:06.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:25:00+00:00, run_after=2024-04-05T00:26:00+00:00 2024-04-05T00:25:06.943121927Z [2024-04-05T00:25:06.942+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:25:06.943155917Z 2024-04-05T00:25:06.943424613Z [2024-04-05T00:25:06.943+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:25:06.944627298Z [2024-04-05T00:25:06.944+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:25:06.944645574Z 2024-04-05T00:25:06.948430015Z [2024-04-05T00:25:06.948+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T00:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T00:25:06.948731162Z [2024-04-05T00:25:06.948+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T00:25:07.002587025Z [2024-04-05T00:25:07.002+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:20:00+00:00 exited with status queued for try_number 1 2024-04-05T00:25:07.002724519Z [2024-04-05T00:25:07.002+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:24:00+00:00 exited with status success for try_number 1 2024-04-05T00:25:07.002908846Z [2024-04-05T00:25:07.002+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:20:00+00:00 exited with status success for try_number 1 2024-04-05T00:25:07.015272789Z [2024-04-05T00:25:07.014+0000] {scheduler_job.py:635} INFO - Setting external_id for to 884dd70d-3d65-4200-a6bc-807556eb4f6d 2024-04-05T00:25:07.015630399Z [2024-04-05T00:25:07.015+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:24:00+00:00, map_index=-1, run_start_date=2024-04-05 00:25:03.878509+00:00, run_end_date=2024-04-05 00:25:05.791188+00:00, run_duration=1.912679, state=success, executor_state=success, try_number=1, max_tries=1, job_id=521, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:25:00.427744+00:00, queued_by_job_id=1, pid=7635 2024-04-05T00:25:07.016022719Z [2024-04-05T00:25:07.015+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T00:20:00+00:00, map_index=-1, run_start_date=2024-04-05 00:25:06.073463+00:00, run_end_date=2024-04-05 00:25:06.388295+00:00, run_duration=0.314832, state=success, executor_state=success, try_number=1, max_tries=1, job_id=522, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:25:04.364870+00:00, queued_by_job_id=1, pid=7658 2024-04-05T00:25:09.241801984Z [2024-04-05T00:25:09.241+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:25:09.241836253Z 2024-04-05T00:25:09.241967148Z [2024-04-05T00:25:09.241+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:25:09.242667436Z [2024-04-05T00:25:09.242+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:25:09.242686515Z 2024-04-05T00:25:09.245488480Z [2024-04-05T00:25:09.245+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T00:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:25:09.245603729Z [2024-04-05T00:25:09.245+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:25:09.321431221Z [2024-04-05T00:25:09.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:20:00+00:00 exited with status queued for try_number 1 2024-04-05T00:25:09.321639523Z [2024-04-05T00:25:09.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:20:00+00:00 exited with status success for try_number 1 2024-04-05T00:25:09.327680360Z [2024-04-05T00:25:09.327+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e26ce4f-bc0d-42e3-ba84-8b1bb1d839bc 2024-04-05T00:25:09.328024889Z [2024-04-05T00:25:09.327+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T00:20:00+00:00, map_index=0, run_start_date=2024-04-05 00:25:08.609488+00:00, run_end_date=2024-04-05 00:25:08.918177+00:00, run_duration=0.308689, state=success, executor_state=success, try_number=1, max_tries=1, job_id=523, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:25:06.945302+00:00, queued_by_job_id=1, pid=7666 2024-04-05T00:25:11.710627093Z [2024-04-05T00:25:11.710+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:25:11.711323597Z [2024-04-05T00:25:11.710+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:20:00+00:00, run_id=scheduled__2024-04-05T00:20:00+00:00, run_start_date=2024-04-05 00:25:00.342169+00:00, run_end_date=2024-04-05 00:25:11.710549+00:00, run_duration=11.36838, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:20:00+00:00, data_interval_end=2024-04-05 00:25:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T00:25:11.721266804Z [2024-04-05T00:25:11.720+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:25:00+00:00, run_after=2024-04-05T00:30:00+00:00 2024-04-05T00:25:11.758349570Z [2024-04-05T00:25:11.757+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:20:00+00:00 exited with status success for try_number 1 2024-04-05T00:25:11.780207432Z [2024-04-05T00:25:11.779+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T00:20:00+00:00, map_index=-1, run_start_date=2024-04-05 00:25:10.847936+00:00, run_end_date=2024-04-05 00:25:11.141294+00:00, run_duration=0.293358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=524, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:25:09.243160+00:00, queued_by_job_id=1, pid=7684 2024-04-05T00:25:40.446116247Z [2024-04-05T00:25:40.445+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T00:26:00.194001101Z [2024-04-05T00:26:00.193+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:26:00+00:00, run_after=2024-04-05T00:27:00+00:00 2024-04-05T00:26:00.210106052Z [2024-04-05T00:26:00.209+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:26:00.233517261Z [2024-04-05T00:26:00.233+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:26:00+00:00, run_after=2024-04-05T00:27:00+00:00 2024-04-05T00:26:00.267097603Z [2024-04-05T00:26:00.266+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:26:00.404514211Z [2024-04-05T00:26:00.404+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:26:00.404551039Z 2024-04-05T00:26:00.404555436Z 2024-04-05T00:26:00.404558861Z 2024-04-05T00:26:00.404562120Z 2024-04-05T00:26:00.404873681Z [2024-04-05T00:26:00.404+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:26:00.405098466Z [2024-04-05T00:26:00.404+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:26:00.405377496Z [2024-04-05T00:26:00.405+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:26:00.405588322Z [2024-04-05T00:26:00.405+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:26:00.406242345Z [2024-04-05T00:26:00.406+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:26:00.406253115Z 2024-04-05T00:26:00.406257027Z 2024-04-05T00:26:00.406260150Z 2024-04-05T00:26:00.406264084Z 2024-04-05T00:26:00.410789774Z [2024-04-05T00:26:00.410+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:26:00.411089854Z [2024-04-05T00:26:00.410+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:26:00.411419202Z [2024-04-05T00:26:00.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:26:00.411694828Z [2024-04-05T00:26:00.411+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:26:00.412019090Z [2024-04-05T00:26:00.411+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:26:00.412244226Z [2024-04-05T00:26:00.412+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:26:00.412580464Z [2024-04-05T00:26:00.412+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:26:00.412819358Z [2024-04-05T00:26:00.412+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:26:00.990532743Z [2024-04-05T00:26:00.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:24:00+00:00 exited with status queued for try_number 1 2024-04-05T00:26:00.990560115Z [2024-04-05T00:26:00.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:25:00+00:00 exited with status queued for try_number 1 2024-04-05T00:26:00.990564182Z [2024-04-05T00:26:00.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:25:00+00:00 exited with status queued for try_number 1 2024-04-05T00:26:00.990567919Z [2024-04-05T00:26:00.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:25:00+00:00 exited with status queued for try_number 1 2024-04-05T00:26:01.000300559Z [2024-04-05T00:26:00.999+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90318137-52d3-429d-a178-5a943b6354da 2024-04-05T00:26:01.000954593Z [2024-04-05T00:26:01.000+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6fd6232-e4f3-4ad2-8f72-927577b95cb8 2024-04-05T00:26:01.001837298Z [2024-04-05T00:26:01.000+0000] {scheduler_job.py:635} INFO - Setting external_id for to 139152f0-afaa-4278-9b59-ffb67bcd2445 2024-04-05T00:26:01.002450045Z [2024-04-05T00:26:01.001+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d6bc5e2-912e-4c17-b496-51bf61b57e95 2024-04-05T00:26:03.828567945Z [2024-04-05T00:26:03.828+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:26:03.828800579Z [2024-04-05T00:26:03.828+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:24:00+00:00, run_id=scheduled__2024-04-05T00:24:00+00:00, run_start_date=2024-04-05 00:26:00.303550+00:00, run_end_date=2024-04-05 00:26:03.828457+00:00, run_duration=3.524907, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:24:00+00:00, data_interval_end=2024-04-05 00:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:26:03.842365216Z [2024-04-05T00:26:03.841+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:26:00+00:00, run_after=2024-04-05T00:28:00+00:00 2024-04-05T00:26:03.853225586Z [2024-04-05T00:26:03.852+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:26:03.853621665Z [2024-04-05T00:26:03.853+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:25:00+00:00, run_id=scheduled__2024-04-05T00:25:00+00:00, run_start_date=2024-04-05 00:26:00.307955+00:00, run_end_date=2024-04-05 00:26:03.853154+00:00, run_duration=3.545199, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:25:00+00:00, data_interval_end=2024-04-05 00:26:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:26:03.871537956Z [2024-04-05T00:26:03.871+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:26:00+00:00, run_after=2024-04-05T00:27:00+00:00 2024-04-05T00:26:03.940397346Z [2024-04-05T00:26:03.939+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:24:00+00:00 exited with status success for try_number 1 2024-04-05T00:26:03.940555927Z [2024-04-05T00:26:03.940+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:25:00+00:00 exited with status success for try_number 1 2024-04-05T00:26:03.952049258Z [2024-04-05T00:26:03.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:24:00+00:00, map_index=-1, run_start_date=2024-04-05 00:26:02.197832+00:00, run_end_date=2024-04-05 00:26:02.864243+00:00, run_duration=0.666411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=526, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:26:00.407290+00:00, queued_by_job_id=1, pid=7698 2024-04-05T00:26:03.952455817Z [2024-04-05T00:26:03.952+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:25:00+00:00, map_index=-1, run_start_date=2024-04-05 00:26:02.113370+00:00, run_end_date=2024-04-05 00:26:02.774874+00:00, run_duration=0.661504, state=success, executor_state=success, try_number=1, max_tries=1, job_id=525, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:26:00.407290+00:00, queued_by_job_id=1, pid=7697 2024-04-05T00:26:06.100036334Z [2024-04-05T00:26:06.099+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:26:06.100436937Z [2024-04-05T00:26:06.100+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:25:00+00:00, run_id=scheduled__2024-04-05T00:25:00+00:00, run_start_date=2024-04-05 00:26:00.309196+00:00, run_end_date=2024-04-05 00:26:06.100095+00:00, run_duration=5.790899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:25:00+00:00, data_interval_end=2024-04-05 00:26:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:26:06.114727347Z [2024-04-05T00:26:06.114+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:26:00+00:00, run_after=2024-04-05T00:27:00+00:00 2024-04-05T00:26:06.167990509Z [2024-04-05T00:26:06.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:25:00+00:00 exited with status success for try_number 1 2024-04-05T00:26:06.172736740Z [2024-04-05T00:26:06.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:25:00+00:00, map_index=-1, run_start_date=2024-04-05 00:26:03.664971+00:00, run_end_date=2024-04-05 00:26:05.788108+00:00, run_duration=2.123137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=527, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:26:00.407290+00:00, queued_by_job_id=1, pid=7721 2024-04-05T00:26:07.247494296Z [2024-04-05T00:26:07.247+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:26:07.248057207Z [2024-04-05T00:26:07.247+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:25:00+00:00, run_id=scheduled__2024-04-05T00:25:00+00:00, run_start_date=2024-04-05 00:26:00.310284+00:00, run_end_date=2024-04-05 00:26:07.247660+00:00, run_duration=6.937376, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:25:00+00:00, data_interval_end=2024-04-05 00:26:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:26:07.257398705Z [2024-04-05T00:26:07.257+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:26:00+00:00, run_after=2024-04-05T00:27:00+00:00 2024-04-05T00:26:07.292286160Z [2024-04-05T00:26:07.291+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:25:00+00:00 exited with status success for try_number 1 2024-04-05T00:26:07.299200549Z [2024-04-05T00:26:07.298+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:25:00+00:00, map_index=-1, run_start_date=2024-04-05 00:26:03.753698+00:00, run_end_date=2024-04-05 00:26:06.648986+00:00, run_duration=2.895288, state=success, executor_state=success, try_number=1, max_tries=1, job_id=528, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:26:00.407290+00:00, queued_by_job_id=1, pid=7722 2024-04-05T00:27:00.418523364Z [2024-04-05T00:27:00.418+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:27:00.450509187Z [2024-04-05T00:27:00.450+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:27:00+00:00, run_after=2024-04-05T00:28:00+00:00 2024-04-05T00:27:00.473289479Z [2024-04-05T00:27:00.472+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:27:00+00:00, run_after=2024-04-05T00:28:00+00:00 2024-04-05T00:27:00.573553976Z [2024-04-05T00:27:00.573+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:27:00.573577894Z 2024-04-05T00:27:00.573594289Z 2024-04-05T00:27:00.573597833Z 2024-04-05T00:27:00.573754443Z [2024-04-05T00:27:00.573+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:27:00.573993506Z [2024-04-05T00:27:00.573+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:27:00.574864663Z [2024-04-05T00:27:00.573+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:27:00.575989475Z [2024-04-05T00:27:00.575+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:27:00.576002612Z 2024-04-05T00:27:00.576006070Z 2024-04-05T00:27:00.576009271Z 2024-04-05T00:27:00.580136823Z [2024-04-05T00:27:00.579+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:27:00.580205874Z [2024-04-05T00:27:00.580+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:27:00.580394639Z [2024-04-05T00:27:00.580+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:27:00.580465202Z [2024-04-05T00:27:00.580+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:27:00.580677587Z [2024-04-05T00:27:00.580+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:27:00.580730055Z [2024-04-05T00:27:00.580+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:27:00.923525471Z [2024-04-05T00:27:00.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:26:00+00:00 exited with status queued for try_number 1 2024-04-05T00:27:00.923633081Z [2024-04-05T00:27:00.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:26:00+00:00 exited with status queued for try_number 1 2024-04-05T00:27:00.923639198Z [2024-04-05T00:27:00.923+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:26:00+00:00 exited with status queued for try_number 1 2024-04-05T00:27:00.943772574Z [2024-04-05T00:27:00.943+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bcaf089-077c-41a9-a096-370c422b34b7 2024-04-05T00:27:00.943858676Z [2024-04-05T00:27:00.943+0000] {scheduler_job.py:635} INFO - Setting external_id for to 945276a4-47e7-44a9-8034-84b1d4ee3c24 2024-04-05T00:27:00.943959466Z [2024-04-05T00:27:00.943+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65fff5c8-8b00-4517-b61e-d2ef13fb30aa 2024-04-05T00:27:04.416326626Z [2024-04-05T00:27:04.415+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:27:04.416928283Z [2024-04-05T00:27:04.416+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:26:00+00:00, run_id=scheduled__2024-04-05T00:26:00+00:00, run_start_date=2024-04-05 00:27:00.493259+00:00, run_end_date=2024-04-05 00:27:04.416258+00:00, run_duration=3.922999, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:26:00+00:00, data_interval_end=2024-04-05 00:27:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:27:04.435868072Z [2024-04-05T00:27:04.435+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:27:00+00:00, run_after=2024-04-05T00:28:00+00:00 2024-04-05T00:27:04.518491075Z [2024-04-05T00:27:04.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:26:00+00:00 exited with status success for try_number 1 2024-04-05T00:27:04.523725757Z [2024-04-05T00:27:04.523+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:26:00+00:00, map_index=-1, run_start_date=2024-04-05 00:27:02.570528+00:00, run_end_date=2024-04-05 00:27:03.225273+00:00, run_duration=0.654745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=529, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:27:00.576749+00:00, queued_by_job_id=1, pid=7754 2024-04-05T00:27:06.640543797Z [2024-04-05T00:27:06.640+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:27:06.641059302Z [2024-04-05T00:27:06.640+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:26:00+00:00, run_id=scheduled__2024-04-05T00:26:00+00:00, run_start_date=2024-04-05 00:27:00.495866+00:00, run_end_date=2024-04-05 00:27:06.640393+00:00, run_duration=6.144527, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:26:00+00:00, data_interval_end=2024-04-05 00:27:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:27:06.654284086Z [2024-04-05T00:27:06.653+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:27:00+00:00, run_after=2024-04-05T00:28:00+00:00 2024-04-05T00:27:06.712338769Z [2024-04-05T00:27:06.711+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:26:00+00:00 exited with status success for try_number 1 2024-04-05T00:27:06.720572577Z [2024-04-05T00:27:06.719+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:26:00+00:00, map_index=-1, run_start_date=2024-04-05 00:27:04.009813+00:00, run_end_date=2024-04-05 00:27:06.273746+00:00, run_duration=2.263933, state=success, executor_state=success, try_number=1, max_tries=1, job_id=531, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:27:00.576749+00:00, queued_by_job_id=1, pid=7773 2024-04-05T00:27:08.219717538Z [2024-04-05T00:27:08.219+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:27:08.220278411Z [2024-04-05T00:27:08.219+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:26:00+00:00, run_id=scheduled__2024-04-05T00:26:00+00:00, run_start_date=2024-04-05 00:27:00.497314+00:00, run_end_date=2024-04-05 00:27:08.219604+00:00, run_duration=7.72229, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:26:00+00:00, data_interval_end=2024-04-05 00:27:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:27:08.233463047Z [2024-04-05T00:27:08.233+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:27:00+00:00, run_after=2024-04-05T00:28:00+00:00 2024-04-05T00:27:08.276869850Z [2024-04-05T00:27:08.276+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:26:00+00:00 exited with status success for try_number 1 2024-04-05T00:27:08.286822274Z [2024-04-05T00:27:08.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:26:00+00:00, map_index=-1, run_start_date=2024-04-05 00:27:03.927096+00:00, run_end_date=2024-04-05 00:27:07.139528+00:00, run_duration=3.212432, state=success, executor_state=success, try_number=1, max_tries=1, job_id=530, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:27:00.576749+00:00, queued_by_job_id=1, pid=7772 2024-04-05T00:28:01.063423743Z [2024-04-05T00:28:01.063+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:28:01.074754917Z [2024-04-05T00:28:01.074+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:28:01.107024531Z [2024-04-05T00:28:01.106+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:28:00+00:00, run_after=2024-04-05T00:29:00+00:00 2024-04-05T00:28:01.136826909Z [2024-04-05T00:28:01.136+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:28:00+00:00, run_after=2024-04-05T00:29:00+00:00 2024-04-05T00:28:01.311115974Z [2024-04-05T00:28:01.310+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:28:01.311143703Z 2024-04-05T00:28:01.311148563Z 2024-04-05T00:28:01.311152319Z 2024-04-05T00:28:01.311155879Z 2024-04-05T00:28:01.311897806Z [2024-04-05T00:28:01.311+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:28:01.312289664Z [2024-04-05T00:28:01.312+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:28:01.312685091Z [2024-04-05T00:28:01.312+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:28:01.313005053Z [2024-04-05T00:28:01.312+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:28:01.314545695Z [2024-04-05T00:28:01.314+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:28:01.314562035Z 2024-04-05T00:28:01.314568615Z 2024-04-05T00:28:01.314573553Z 2024-04-05T00:28:01.314578490Z 2024-04-05T00:28:01.326347229Z [2024-04-05T00:28:01.325+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:28:01.327348746Z [2024-04-05T00:28:01.326+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:28:01.327757491Z [2024-04-05T00:28:01.327+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:28:01.328065297Z [2024-04-05T00:28:01.327+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:28:01.328370291Z [2024-04-05T00:28:01.328+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:28:01.329697881Z [2024-04-05T00:28:01.328+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:28:01.330066695Z [2024-04-05T00:28:01.329+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:28:01.332811454Z [2024-04-05T00:28:01.330+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:28:01.906392644Z [2024-04-05T00:28:01.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:26:00+00:00 exited with status queued for try_number 1 2024-04-05T00:28:01.912133116Z [2024-04-05T00:28:01.911+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:27:00+00:00 exited with status queued for try_number 1 2024-04-05T00:28:01.912224693Z [2024-04-05T00:28:01.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:27:00+00:00 exited with status queued for try_number 1 2024-04-05T00:28:01.912362172Z [2024-04-05T00:28:01.912+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:27:00+00:00 exited with status queued for try_number 1 2024-04-05T00:28:01.941709783Z [2024-04-05T00:28:01.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6efccf9-f25e-478a-863b-89dba1956fa3 2024-04-05T00:28:01.941915892Z [2024-04-05T00:28:01.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1bfa0e38-7332-481f-aad4-c53d4f6fd515 2024-04-05T00:28:01.942081364Z [2024-04-05T00:28:01.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to 98d748c9-9f4e-405f-a163-8de13d2f7458 2024-04-05T00:28:01.942359103Z [2024-04-05T00:28:01.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to c42f612a-4052-4a91-b03e-59db64adef49 2024-04-05T00:28:03.684228162Z [2024-04-05T00:28:03.683+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:28:03.684585583Z [2024-04-05T00:28:03.684+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:26:00+00:00, run_id=scheduled__2024-04-05T00:26:00+00:00, run_start_date=2024-04-05 00:28:01.172250+00:00, run_end_date=2024-04-05 00:28:03.684130+00:00, run_duration=2.51188, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:26:00+00:00, data_interval_end=2024-04-05 00:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:28:03.694940992Z [2024-04-05T00:28:03.694+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:28:00+00:00, run_after=2024-04-05T00:30:00+00:00 2024-04-05T00:28:03.709103575Z [2024-04-05T00:28:03.708+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:28:03.709645710Z [2024-04-05T00:28:03.709+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:27:00+00:00, run_id=scheduled__2024-04-05T00:27:00+00:00, run_start_date=2024-04-05 00:28:01.175995+00:00, run_end_date=2024-04-05 00:28:03.709014+00:00, run_duration=2.533019, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:27:00+00:00, data_interval_end=2024-04-05 00:28:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:28:03.721136628Z [2024-04-05T00:28:03.720+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:28:00+00:00, run_after=2024-04-05T00:29:00+00:00 2024-04-05T00:28:03.785526489Z [2024-04-05T00:28:03.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:26:00+00:00 exited with status success for try_number 1 2024-04-05T00:28:03.785592817Z [2024-04-05T00:28:03.785+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:27:00+00:00 exited with status success for try_number 1 2024-04-05T00:28:03.792888158Z [2024-04-05T00:28:03.792+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:26:00+00:00, map_index=-1, run_start_date=2024-04-05 00:28:02.552788+00:00, run_end_date=2024-04-05 00:28:03.223538+00:00, run_duration=0.67075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=532, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:28:01.316478+00:00, queued_by_job_id=1, pid=7803 2024-04-05T00:28:03.793846408Z [2024-04-05T00:28:03.793+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:27:00+00:00, map_index=-1, run_start_date=2024-04-05 00:28:03.158766+00:00, run_end_date=2024-04-05 00:28:03.551617+00:00, run_duration=0.392851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=533, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:28:01.316478+00:00, queued_by_job_id=1, pid=7815 2024-04-05T00:28:07.065264111Z [2024-04-05T00:28:07.064+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:28:07.066055385Z [2024-04-05T00:28:07.065+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:27:00+00:00, run_id=scheduled__2024-04-05T00:27:00+00:00, run_start_date=2024-04-05 00:28:01.181874+00:00, run_end_date=2024-04-05 00:28:07.065142+00:00, run_duration=5.883268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:27:00+00:00, data_interval_end=2024-04-05 00:28:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:28:07.076490162Z [2024-04-05T00:28:07.076+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:28:00+00:00, run_after=2024-04-05T00:29:00+00:00 2024-04-05T00:28:07.083799667Z [2024-04-05T00:28:07.083+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:28:07.084028383Z [2024-04-05T00:28:07.083+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:27:00+00:00, run_id=scheduled__2024-04-05T00:27:00+00:00, run_start_date=2024-04-05 00:28:01.184378+00:00, run_end_date=2024-04-05 00:28:07.083741+00:00, run_duration=5.899363, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:27:00+00:00, data_interval_end=2024-04-05 00:28:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:28:07.094633994Z [2024-04-05T00:28:07.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:28:00+00:00, run_after=2024-04-05T00:29:00+00:00 2024-04-05T00:28:07.153904209Z [2024-04-05T00:28:07.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:27:00+00:00 exited with status success for try_number 1 2024-04-05T00:28:07.154565965Z [2024-04-05T00:28:07.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:27:00+00:00 exited with status success for try_number 1 2024-04-05T00:28:07.169039459Z [2024-04-05T00:28:07.168+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:27:00+00:00, map_index=-1, run_start_date=2024-04-05 00:28:03.905569+00:00, run_end_date=2024-04-05 00:28:05.970461+00:00, run_duration=2.064892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=535, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:28:01.316478+00:00, queued_by_job_id=1, pid=7832 2024-04-05T00:28:07.169672061Z [2024-04-05T00:28:07.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:27:00+00:00, map_index=-1, run_start_date=2024-04-05 00:28:03.711707+00:00, run_end_date=2024-04-05 00:28:06.689375+00:00, run_duration=2.977668, state=success, executor_state=success, try_number=1, max_tries=1, job_id=534, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:28:01.316478+00:00, queued_by_job_id=1, pid=7831 2024-04-05T00:29:00.045299926Z [2024-04-05T00:29:00.044+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:29:00+00:00, run_after=2024-04-05T00:30:00+00:00 2024-04-05T00:29:00.054496750Z [2024-04-05T00:29:00.054+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:29:00.070162171Z [2024-04-05T00:29:00.069+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:29:00+00:00, run_after=2024-04-05T00:30:00+00:00 2024-04-05T00:29:00.141359149Z [2024-04-05T00:29:00.140+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:29:00.141403138Z 2024-04-05T00:29:00.141408966Z 2024-04-05T00:29:00.141413311Z 2024-04-05T00:29:00.141427049Z [2024-04-05T00:29:00.141+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:29:00.141634994Z [2024-04-05T00:29:00.141+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:29:00.141805713Z [2024-04-05T00:29:00.141+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:29:00.142512982Z [2024-04-05T00:29:00.142+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:29:00.142523781Z 2024-04-05T00:29:00.142528154Z 2024-04-05T00:29:00.142532727Z 2024-04-05T00:29:00.146095137Z [2024-04-05T00:29:00.145+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:29:00.146594115Z [2024-04-05T00:29:00.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:29:00.146912727Z [2024-04-05T00:29:00.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:29:00.147083624Z [2024-04-05T00:29:00.146+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:29:00.147371185Z [2024-04-05T00:29:00.147+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:29:00.147513809Z [2024-04-05T00:29:00.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:29:00.566606715Z [2024-04-05T00:29:00.565+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:28:00+00:00 exited with status queued for try_number 1 2024-04-05T00:29:00.566905612Z [2024-04-05T00:29:00.566+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:28:00+00:00 exited with status queued for try_number 1 2024-04-05T00:29:00.567261931Z [2024-04-05T00:29:00.567+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:28:00+00:00 exited with status queued for try_number 1 2024-04-05T00:29:00.590606639Z [2024-04-05T00:29:00.590+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4eaf8b3d-3561-4c39-8656-d28a9a3657bb 2024-04-05T00:29:00.593815026Z [2024-04-05T00:29:00.593+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09d402b5-cead-44ca-9e4c-4c7dcc5d0e10 2024-04-05T00:29:00.594211256Z [2024-04-05T00:29:00.594+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c574204-02da-41bb-b1cf-b8dab1183f2d 2024-04-05T00:29:03.071375156Z [2024-04-05T00:29:03.070+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:29:03.071623181Z [2024-04-05T00:29:03.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:28:00+00:00, run_id=scheduled__2024-04-05T00:28:00+00:00, run_start_date=2024-04-05 00:29:00.084860+00:00, run_end_date=2024-04-05 00:29:03.071237+00:00, run_duration=2.986377, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:28:00+00:00, data_interval_end=2024-04-05 00:29:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:29:03.081770958Z [2024-04-05T00:29:03.081+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:29:00+00:00, run_after=2024-04-05T00:30:00+00:00 2024-04-05T00:29:03.160461936Z [2024-04-05T00:29:03.160+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:28:00+00:00 exited with status success for try_number 1 2024-04-05T00:29:03.170103545Z [2024-04-05T00:29:03.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:28:00+00:00, map_index=-1, run_start_date=2024-04-05 00:29:01.285912+00:00, run_end_date=2024-04-05 00:29:01.987126+00:00, run_duration=0.701214, state=success, executor_state=success, try_number=1, max_tries=1, job_id=536, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:29:00.143320+00:00, queued_by_job_id=1, pid=7864 2024-04-05T00:29:05.204276393Z [2024-04-05T00:29:05.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:29:05.204804920Z [2024-04-05T00:29:05.204+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:28:00+00:00, run_id=scheduled__2024-04-05T00:28:00+00:00, run_start_date=2024-04-05 00:29:00.088506+00:00, run_end_date=2024-04-05 00:29:05.204371+00:00, run_duration=5.115865, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:28:00+00:00, data_interval_end=2024-04-05 00:29:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:29:05.215021811Z [2024-04-05T00:29:05.214+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:29:00+00:00, run_after=2024-04-05T00:30:00+00:00 2024-04-05T00:29:05.224439355Z [2024-04-05T00:29:05.224+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:29:05.225020422Z [2024-04-05T00:29:05.224+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:28:00+00:00, run_id=scheduled__2024-04-05T00:28:00+00:00, run_start_date=2024-04-05 00:29:00.089733+00:00, run_end_date=2024-04-05 00:29:05.224496+00:00, run_duration=5.134763, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:28:00+00:00, data_interval_end=2024-04-05 00:29:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:29:05.237325592Z [2024-04-05T00:29:05.236+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:29:00+00:00, run_after=2024-04-05T00:30:00+00:00 2024-04-05T00:29:05.286169125Z [2024-04-05T00:29:05.285+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:28:00+00:00 exited with status success for try_number 1 2024-04-05T00:29:05.286592432Z [2024-04-05T00:29:05.286+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:28:00+00:00 exited with status success for try_number 1 2024-04-05T00:29:05.297294507Z [2024-04-05T00:29:05.296+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:28:00+00:00, map_index=-1, run_start_date=2024-04-05 00:29:02.864744+00:00, run_end_date=2024-04-05 00:29:04.468046+00:00, run_duration=1.603302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=537, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:29:00.143320+00:00, queued_by_job_id=1, pid=7882 2024-04-05T00:29:05.297789047Z [2024-04-05T00:29:05.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:28:00+00:00, map_index=-1, run_start_date=2024-04-05 00:29:02.940649+00:00, run_end_date=2024-04-05 00:29:04.840990+00:00, run_duration=1.900341, state=success, executor_state=success, try_number=1, max_tries=1, job_id=538, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:29:00.143320+00:00, queued_by_job_id=1, pid=7883 2024-04-05T00:30:01.031668426Z [2024-04-05T00:30:01.031+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:30:00+00:00, run_after=2024-04-05T00:31:00+00:00 2024-04-05T00:30:01.048014275Z [2024-04-05T00:30:01.047+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:30:00+00:00, run_after=2024-04-05T00:31:00+00:00 2024-04-05T00:30:01.055251083Z [2024-04-05T00:30:01.054+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:30:01.068272255Z [2024-04-05T00:30:01.067+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:30:00+00:00, run_after=2024-04-05T00:35:00+00:00 2024-04-05T00:30:01.075805743Z [2024-04-05T00:30:01.075+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:30:01.167767712Z [2024-04-05T00:30:01.167+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T00:30:01.167797651Z 2024-04-05T00:30:01.167803828Z 2024-04-05T00:30:01.167813047Z 2024-04-05T00:30:01.167818621Z 2024-04-05T00:30:01.167824145Z 2024-04-05T00:30:01.180612357Z [2024-04-05T00:30:01.167+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:30:01.180637076Z [2024-04-05T00:30:01.167+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:30:01.180642086Z [2024-04-05T00:30:01.168+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:30:01.180646403Z [2024-04-05T00:30:01.168+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:30:01.180650989Z [2024-04-05T00:30:01.168+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:30:01.180655195Z [2024-04-05T00:30:01.168+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:30:01.180659985Z 2024-04-05T00:30:01.180665152Z 2024-04-05T00:30:01.180669207Z 2024-04-05T00:30:01.180673332Z 2024-04-05T00:30:01.180691438Z 2024-04-05T00:30:01.180699432Z [2024-04-05T00:30:01.172+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T00:30:01.180703713Z [2024-04-05T00:30:01.172+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:30:01.180708887Z [2024-04-05T00:30:01.172+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:30:01.180713507Z [2024-04-05T00:30:01.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:30:01.180717568Z [2024-04-05T00:30:01.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:30:01.180721509Z [2024-04-05T00:30:01.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:30:01.180725488Z [2024-04-05T00:30:01.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:30:01.180729393Z [2024-04-05T00:30:01.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:30:01.180736321Z [2024-04-05T00:30:01.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:30:01.180740510Z [2024-04-05T00:30:01.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:30:01.876869099Z [2024-04-05T00:30:01.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:25:00+00:00 exited with status queued for try_number 1 2024-04-05T00:30:01.877114121Z [2024-04-05T00:30:01.876+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:28:00+00:00 exited with status queued for try_number 1 2024-04-05T00:30:01.877315006Z [2024-04-05T00:30:01.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:29:00+00:00 exited with status queued for try_number 1 2024-04-05T00:30:01.877386910Z [2024-04-05T00:30:01.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:29:00+00:00 exited with status queued for try_number 1 2024-04-05T00:30:01.877449201Z [2024-04-05T00:30:01.877+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:29:00+00:00 exited with status queued for try_number 1 2024-04-05T00:30:01.905715375Z [2024-04-05T00:30:01.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to 24438337-77a9-465c-8266-d9bf1d7beaa0 2024-04-05T00:30:01.906177758Z [2024-04-05T00:30:01.905+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6304362e-79f8-4e85-8500-2a038e61dbcb 2024-04-05T00:30:01.906461137Z [2024-04-05T00:30:01.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to 83a0ab68-1ab0-47f4-aede-96e57187874b 2024-04-05T00:30:01.906703206Z [2024-04-05T00:30:01.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e08c981-7f4c-4674-b34c-9a3618e30cb9 2024-04-05T00:30:01.906907129Z [2024-04-05T00:30:01.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to 27970948-57af-4dbd-9d77-9ef3863fb9cc 2024-04-05T00:30:03.337326235Z [2024-04-05T00:30:03.336+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:30:03.337550660Z [2024-04-05T00:30:03.337+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:28:00+00:00, run_id=scheduled__2024-04-05T00:28:00+00:00, run_start_date=2024-04-05 00:30:01.087363+00:00, run_end_date=2024-04-05 00:30:03.337232+00:00, run_duration=2.249869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:28:00+00:00, data_interval_end=2024-04-05 00:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:30:03.363922136Z [2024-04-05T00:30:03.363+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:30:00+00:00, run_after=2024-04-05T00:32:00+00:00 2024-04-05T00:30:03.521008064Z [2024-04-05T00:30:03.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:28:00+00:00 exited with status success for try_number 1 2024-04-05T00:30:03.536329946Z [2024-04-05T00:30:03.535+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:28:00+00:00, map_index=-1, run_start_date=2024-04-05 00:30:02.698439+00:00, run_end_date=2024-04-05 00:30:03.141334+00:00, run_duration=0.442895, state=success, executor_state=success, try_number=1, max_tries=1, job_id=539, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:30:01.169947+00:00, queued_by_job_id=1, pid=7917 2024-04-05T00:30:04.610717316Z [2024-04-05T00:30:04.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:30:04.610887038Z [2024-04-05T00:30:04.610+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:29:00+00:00, run_id=scheduled__2024-04-05T00:29:00+00:00, run_start_date=2024-04-05 00:30:01.088456+00:00, run_end_date=2024-04-05 00:30:04.610594+00:00, run_duration=3.522138, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:29:00+00:00, data_interval_end=2024-04-05 00:30:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:30:04.623141510Z [2024-04-05T00:30:04.622+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:30:00+00:00, run_after=2024-04-05T00:31:00+00:00 2024-04-05T00:30:04.729299610Z [2024-04-05T00:30:04.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:29:00+00:00 exited with status success for try_number 1 2024-04-05T00:30:04.738442612Z [2024-04-05T00:30:04.737+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:29:00+00:00, map_index=-1, run_start_date=2024-04-05 00:30:02.762572+00:00, run_end_date=2024-04-05 00:30:03.452372+00:00, run_duration=0.6898, state=success, executor_state=success, try_number=1, max_tries=1, job_id=540, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:30:01.169947+00:00, queued_by_job_id=1, pid=7918 2024-04-05T00:30:05.084698049Z [2024-04-05T00:30:05.084+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:30:05.084755800Z 2024-04-05T00:30:05.084885344Z [2024-04-05T00:30:05.084+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:30:05.085997720Z [2024-04-05T00:30:05.085+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:30:05.086017892Z 2024-04-05T00:30:05.089756361Z [2024-04-05T00:30:05.089+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T00:30:05.090159106Z [2024-04-05T00:30:05.089+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:30:05.139433728Z [2024-04-05T00:30:05.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:25:00+00:00 exited with status queued for try_number 1 2024-04-05T00:30:05.139649991Z [2024-04-05T00:30:05.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:25:00+00:00 exited with status success for try_number 1 2024-04-05T00:30:05.146736779Z [2024-04-05T00:30:05.146+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a21a2e6-b707-4e0f-9655-9d1959373ed0 2024-04-05T00:30:05.146787956Z [2024-04-05T00:30:05.146+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T00:25:00+00:00, map_index=-1, run_start_date=2024-04-05 00:30:04.255267+00:00, run_end_date=2024-04-05 00:30:04.736104+00:00, run_duration=0.480837, state=success, executor_state=success, try_number=1, max_tries=1, job_id=542, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:30:01.169947+00:00, queued_by_job_id=1, pid=7949 2024-04-05T00:30:06.377807549Z [2024-04-05T00:30:06.373+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:30:06.377833856Z [2024-04-05T00:30:06.373+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:29:00+00:00, run_id=scheduled__2024-04-05T00:29:00+00:00, run_start_date=2024-04-05 00:30:01.089527+00:00, run_end_date=2024-04-05 00:30:06.373450+00:00, run_duration=5.283923, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:29:00+00:00, data_interval_end=2024-04-05 00:30:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:30:06.388290093Z [2024-04-05T00:30:06.387+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:30:00+00:00, run_after=2024-04-05T00:31:00+00:00 2024-04-05T00:30:06.458335319Z [2024-04-05T00:30:06.457+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:29:00+00:00 exited with status success for try_number 1 2024-04-05T00:30:06.464337910Z [2024-04-05T00:30:06.463+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:29:00+00:00, map_index=-1, run_start_date=2024-04-05 00:30:04.098019+00:00, run_end_date=2024-04-05 00:30:05.403051+00:00, run_duration=1.305032, state=success, executor_state=success, try_number=1, max_tries=1, job_id=541, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:30:01.169947+00:00, queued_by_job_id=1, pid=7947 2024-04-05T00:30:07.500710031Z [2024-04-05T00:30:07.500+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:30:07.500954810Z [2024-04-05T00:30:07.500+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:29:00+00:00, run_id=scheduled__2024-04-05T00:29:00+00:00, run_start_date=2024-04-05 00:30:01.090720+00:00, run_end_date=2024-04-05 00:30:07.500571+00:00, run_duration=6.409851, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:29:00+00:00, data_interval_end=2024-04-05 00:30:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:30:07.510083611Z [2024-04-05T00:30:07.509+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:30:00+00:00, run_after=2024-04-05T00:31:00+00:00 2024-04-05T00:30:07.539820754Z [2024-04-05T00:30:07.539+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:30:07.539852907Z 2024-04-05T00:30:07.539882624Z [2024-04-05T00:30:07.539+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:30:07.540537368Z [2024-04-05T00:30:07.540+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:30:07.540560829Z 2024-04-05T00:30:07.543475081Z [2024-04-05T00:30:07.543+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T00:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T00:30:07.543725096Z [2024-04-05T00:30:07.543+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T00:30:07.605174591Z [2024-04-05T00:30:07.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:25:00+00:00 exited with status queued for try_number 1 2024-04-05T00:30:07.605587791Z [2024-04-05T00:30:07.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:29:00+00:00 exited with status success for try_number 1 2024-04-05T00:30:07.606204538Z [2024-04-05T00:30:07.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:25:00+00:00 exited with status success for try_number 1 2024-04-05T00:30:07.617519258Z [2024-04-05T00:30:07.616+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T00:25:00+00:00, map_index=-1, run_start_date=2024-04-05 00:30:06.894215+00:00, run_end_date=2024-04-05 00:30:07.252670+00:00, run_duration=0.358455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=544, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:30:05.086624+00:00, queued_by_job_id=1, pid=7972 2024-04-05T00:30:07.617932985Z [2024-04-05T00:30:07.617+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:29:00+00:00, map_index=-1, run_start_date=2024-04-05 00:30:04.259284+00:00, run_end_date=2024-04-05 00:30:06.677224+00:00, run_duration=2.41794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=543, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:30:01.169947+00:00, queued_by_job_id=1, pid=7948 2024-04-05T00:30:07.618266982Z [2024-04-05T00:30:07.618+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9b51866-4bc4-4fe5-a6eb-4d03d5026d6f 2024-04-05T00:30:09.894213023Z [2024-04-05T00:30:09.893+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:30:09.894243329Z 2024-04-05T00:30:09.894328311Z [2024-04-05T00:30:09.894+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:30:09.895006266Z [2024-04-05T00:30:09.894+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:30:09.895019246Z 2024-04-05T00:30:09.898264746Z [2024-04-05T00:30:09.897+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T00:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:30:09.898428130Z [2024-04-05T00:30:09.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:30:09.947436499Z [2024-04-05T00:30:09.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:25:00+00:00 exited with status queued for try_number 1 2024-04-05T00:30:09.947463674Z [2024-04-05T00:30:09.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:25:00+00:00 exited with status success for try_number 1 2024-04-05T00:30:09.956027058Z [2024-04-05T00:30:09.955+0000] {scheduler_job.py:635} INFO - Setting external_id for to 728e1f0d-4f5c-4559-bfac-010bd74490ce 2024-04-05T00:30:09.956453360Z [2024-04-05T00:30:09.956+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T00:25:00+00:00, map_index=0, run_start_date=2024-04-05 00:30:09.244730+00:00, run_end_date=2024-04-05 00:30:09.622536+00:00, run_duration=0.377806, state=success, executor_state=success, try_number=1, max_tries=1, job_id=545, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:30:07.541069+00:00, queued_by_job_id=1, pid=7986 2024-04-05T00:30:12.422989458Z [2024-04-05T00:30:12.422+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:30:12.423329753Z [2024-04-05T00:30:12.423+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:25:00+00:00, run_id=scheduled__2024-04-05T00:25:00+00:00, run_start_date=2024-04-05 00:30:01.086088+00:00, run_end_date=2024-04-05 00:30:12.422920+00:00, run_duration=11.336832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:25:00+00:00, data_interval_end=2024-04-05 00:30:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T00:30:12.431256446Z [2024-04-05T00:30:12.430+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:30:00+00:00, run_after=2024-04-05T00:35:00+00:00 2024-04-05T00:30:12.462211651Z [2024-04-05T00:30:12.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:25:00+00:00 exited with status success for try_number 1 2024-04-05T00:30:12.467019520Z [2024-04-05T00:30:12.466+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T00:25:00+00:00, map_index=-1, run_start_date=2024-04-05 00:30:11.786309+00:00, run_end_date=2024-04-05 00:30:12.160955+00:00, run_duration=0.374646, state=success, executor_state=success, try_number=1, max_tries=1, job_id=546, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:30:09.895667+00:00, queued_by_job_id=1, pid=8000 2024-04-05T00:30:40.543715168Z [2024-04-05T00:30:40.543+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T00:31:00.214577366Z [2024-04-05T00:31:00.214+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:31:00+00:00, run_after=2024-04-05T00:32:00+00:00 2024-04-05T00:31:00.231056256Z [2024-04-05T00:31:00.230+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:31:00+00:00, run_after=2024-04-05T00:32:00+00:00 2024-04-05T00:31:00.242277684Z [2024-04-05T00:31:00.241+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:31:00.341162836Z [2024-04-05T00:31:00.340+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:31:00.341280907Z 2024-04-05T00:31:00.341292105Z 2024-04-05T00:31:00.341300690Z 2024-04-05T00:31:00.341819136Z [2024-04-05T00:31:00.341+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:31:00.342165602Z [2024-04-05T00:31:00.341+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:31:00.342521832Z [2024-04-05T00:31:00.342+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:31:00.343874317Z [2024-04-05T00:31:00.343+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:31:00.343923168Z 2024-04-05T00:31:00.343930568Z 2024-04-05T00:31:00.343936372Z 2024-04-05T00:31:00.349640509Z [2024-04-05T00:31:00.349+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:31:00.350361470Z [2024-04-05T00:31:00.349+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:31:00.351224316Z [2024-04-05T00:31:00.350+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:31:00.355706599Z [2024-04-05T00:31:00.351+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:31:00.357624182Z [2024-04-05T00:31:00.357+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:31:00.358032201Z [2024-04-05T00:31:00.357+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:31:00.967770639Z [2024-04-05T00:31:00.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:30:00+00:00 exited with status queued for try_number 1 2024-04-05T00:31:00.967798120Z [2024-04-05T00:31:00.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:30:00+00:00 exited with status queued for try_number 1 2024-04-05T00:31:00.967801805Z [2024-04-05T00:31:00.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:30:00+00:00 exited with status queued for try_number 1 2024-04-05T00:31:00.997763851Z [2024-04-05T00:31:00.997+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53019aa7-eeac-4274-9e69-9fb5177227b3 2024-04-05T00:31:00.997876437Z [2024-04-05T00:31:00.997+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a267971-3d2d-40bc-a0e4-4ae3691b9d9b 2024-04-05T00:31:00.998078805Z [2024-04-05T00:31:00.997+0000] {scheduler_job.py:635} INFO - Setting external_id for to 883b52a1-47be-4f2f-9109-5eb2af503f05 2024-04-05T00:31:02.575176968Z [2024-04-05T00:31:02.574+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:30:00+00:00 exited with status success for try_number 1 2024-04-05T00:31:02.582684939Z [2024-04-05T00:31:02.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:30:00+00:00, map_index=-1, run_start_date=2024-04-05 00:31:01.845270+00:00, run_end_date=2024-04-05 00:31:02.344568+00:00, run_duration=0.499298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=547, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:31:00.345442+00:00, queued_by_job_id=1, pid=8009 2024-04-05T00:31:03.645084421Z [2024-04-05T00:31:03.644+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:31:03.645390219Z [2024-04-05T00:31:03.645+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:30:00+00:00, run_id=scheduled__2024-04-05T00:30:00+00:00, run_start_date=2024-04-05 00:31:00.257124+00:00, run_end_date=2024-04-05 00:31:03.644950+00:00, run_duration=3.387826, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:30:00+00:00, data_interval_end=2024-04-05 00:31:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:31:03.655386992Z [2024-04-05T00:31:03.655+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:31:00+00:00, run_after=2024-04-05T00:32:00+00:00 2024-04-05T00:31:05.090140420Z [2024-04-05T00:31:05.089+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:31:05.090297592Z [2024-04-05T00:31:05.090+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:30:00+00:00, run_id=scheduled__2024-04-05T00:30:00+00:00, run_start_date=2024-04-05 00:31:00.258605+00:00, run_end_date=2024-04-05 00:31:05.090002+00:00, run_duration=4.831397, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:30:00+00:00, data_interval_end=2024-04-05 00:31:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:31:05.100559896Z [2024-04-05T00:31:05.100+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:31:00+00:00, run_after=2024-04-05T00:32:00+00:00 2024-04-05T00:31:05.152712583Z [2024-04-05T00:31:05.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:30:00+00:00 exited with status success for try_number 1 2024-04-05T00:31:05.159730171Z [2024-04-05T00:31:05.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:30:00+00:00, map_index=-1, run_start_date=2024-04-05 00:31:03.291166+00:00, run_end_date=2024-04-05 00:31:04.833214+00:00, run_duration=1.542048, state=success, executor_state=success, try_number=1, max_tries=1, job_id=548, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:31:00.345442+00:00, queued_by_job_id=1, pid=8027 2024-04-05T00:31:06.110885349Z [2024-04-05T00:31:06.110+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:31:06.111508938Z [2024-04-05T00:31:06.111+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:30:00+00:00, run_id=scheduled__2024-04-05T00:30:00+00:00, run_start_date=2024-04-05 00:31:00.259837+00:00, run_end_date=2024-04-05 00:31:06.110789+00:00, run_duration=5.850952, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:30:00+00:00, data_interval_end=2024-04-05 00:31:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:31:06.120770227Z [2024-04-05T00:31:06.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:31:00+00:00, run_after=2024-04-05T00:32:00+00:00 2024-04-05T00:31:06.150960860Z [2024-04-05T00:31:06.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:30:00+00:00 exited with status success for try_number 1 2024-04-05T00:31:06.155929356Z [2024-04-05T00:31:06.155+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:30:00+00:00, map_index=-1, run_start_date=2024-04-05 00:31:03.334856+00:00, run_end_date=2024-04-05 00:31:05.172698+00:00, run_duration=1.837842, state=success, executor_state=success, try_number=1, max_tries=1, job_id=549, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:31:00.345442+00:00, queued_by_job_id=1, pid=8028 2024-04-05T00:32:00.480769351Z [2024-04-05T00:32:00.480+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:32:00+00:00, run_after=2024-04-05T00:33:00+00:00 2024-04-05T00:32:00.502186117Z [2024-04-05T00:32:00.501+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:32:00+00:00, run_after=2024-04-05T00:33:00+00:00 2024-04-05T00:32:00.510412005Z [2024-04-05T00:32:00.510+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:32:00.519474709Z [2024-04-05T00:32:00.519+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:32:00.608898014Z [2024-04-05T00:32:00.608+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:32:00.608972087Z 2024-04-05T00:32:00.608979974Z 2024-04-05T00:32:00.608985375Z 2024-04-05T00:32:00.608990386Z 2024-04-05T00:32:00.609015876Z [2024-04-05T00:32:00.608+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:32:00.609160162Z [2024-04-05T00:32:00.608+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:32:00.609373746Z [2024-04-05T00:32:00.609+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:32:00.609582547Z [2024-04-05T00:32:00.609+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:32:00.610218728Z [2024-04-05T00:32:00.610+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:32:00.610229590Z 2024-04-05T00:32:00.610233685Z 2024-04-05T00:32:00.610236872Z 2024-04-05T00:32:00.610239847Z 2024-04-05T00:32:00.615222996Z [2024-04-05T00:32:00.614+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:32:00.615400185Z [2024-04-05T00:32:00.615+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:32:00.615699729Z [2024-04-05T00:32:00.615+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:32:00.616956532Z [2024-04-05T00:32:00.616+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:32:00.618617085Z [2024-04-05T00:32:00.618+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:32:00.618805887Z [2024-04-05T00:32:00.618+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:32:00.619046877Z [2024-04-05T00:32:00.618+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:32:00.619420146Z [2024-04-05T00:32:00.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:32:01.082991717Z [2024-04-05T00:32:01.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:30:00+00:00 exited with status queued for try_number 1 2024-04-05T00:32:01.083065757Z [2024-04-05T00:32:01.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:31:00+00:00 exited with status queued for try_number 1 2024-04-05T00:32:01.083083284Z [2024-04-05T00:32:01.082+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:31:00+00:00 exited with status queued for try_number 1 2024-04-05T00:32:01.083137183Z [2024-04-05T00:32:01.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:31:00+00:00 exited with status queued for try_number 1 2024-04-05T00:32:01.101783221Z [2024-04-05T00:32:01.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7125979-2714-4899-a0de-eb2fbadc6e2f 2024-04-05T00:32:01.101929230Z [2024-04-05T00:32:01.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1eb08a4c-a272-4778-b988-c3d8121ffa73 2024-04-05T00:32:01.102087877Z [2024-04-05T00:32:01.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to ade705f5-fb62-4e15-af7d-1ed45490e0cd 2024-04-05T00:32:01.102347659Z [2024-04-05T00:32:01.102+0000] {scheduler_job.py:635} INFO - Setting external_id for to cc0bbb35-6fca-4624-b003-cbc6f4a3dc20 2024-04-05T00:32:03.085408404Z [2024-04-05T00:32:03.085+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:32:03.085915373Z [2024-04-05T00:32:03.085+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:30:00+00:00, run_id=scheduled__2024-04-05T00:30:00+00:00, run_start_date=2024-04-05 00:32:00.541704+00:00, run_end_date=2024-04-05 00:32:03.085355+00:00, run_duration=2.543651, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:30:00+00:00, data_interval_end=2024-04-05 00:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:32:03.095369752Z [2024-04-05T00:32:03.094+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:32:00+00:00, run_after=2024-04-05T00:34:00+00:00 2024-04-05T00:32:03.105351665Z [2024-04-05T00:32:03.104+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:32:03.105742366Z [2024-04-05T00:32:03.105+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:31:00+00:00, run_id=scheduled__2024-04-05T00:31:00+00:00, run_start_date=2024-04-05 00:32:00.543463+00:00, run_end_date=2024-04-05 00:32:03.105262+00:00, run_duration=2.561799, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:31:00+00:00, data_interval_end=2024-04-05 00:32:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:32:03.117510144Z [2024-04-05T00:32:03.117+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:32:00+00:00, run_after=2024-04-05T00:33:00+00:00 2024-04-05T00:32:03.188208614Z [2024-04-05T00:32:03.187+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:31:00+00:00 exited with status success for try_number 1 2024-04-05T00:32:03.198309962Z [2024-04-05T00:32:03.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:31:00+00:00, map_index=-1, run_start_date=2024-04-05 00:32:02.215369+00:00, run_end_date=2024-04-05 00:32:02.808871+00:00, run_duration=0.593502, state=success, executor_state=success, try_number=1, max_tries=1, job_id=550, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:32:00.611090+00:00, queued_by_job_id=1, pid=8063 2024-04-05T00:32:04.308179111Z [2024-04-05T00:32:04.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:30:00+00:00 exited with status success for try_number 1 2024-04-05T00:32:04.315123870Z [2024-04-05T00:32:04.314+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:30:00+00:00, map_index=-1, run_start_date=2024-04-05 00:32:02.519951+00:00, run_end_date=2024-04-05 00:32:03.052664+00:00, run_duration=0.532713, state=success, executor_state=success, try_number=1, max_tries=1, job_id=551, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:32:00.611090+00:00, queued_by_job_id=1, pid=8064 2024-04-05T00:32:05.357193905Z [2024-04-05T00:32:05.356+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:32:05.357746541Z [2024-04-05T00:32:05.357+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:31:00+00:00, run_id=scheduled__2024-04-05T00:31:00+00:00, run_start_date=2024-04-05 00:32:00.544935+00:00, run_end_date=2024-04-05 00:32:05.357074+00:00, run_duration=4.812139, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:31:00+00:00, data_interval_end=2024-04-05 00:32:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:32:05.368810729Z [2024-04-05T00:32:05.368+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:32:00+00:00, run_after=2024-04-05T00:33:00+00:00 2024-04-05T00:32:05.410109488Z [2024-04-05T00:32:05.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:31:00+00:00 exited with status success for try_number 1 2024-04-05T00:32:05.415965402Z [2024-04-05T00:32:05.415+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:31:00+00:00, map_index=-1, run_start_date=2024-04-05 00:32:03.323352+00:00, run_end_date=2024-04-05 00:32:04.843362+00:00, run_duration=1.52001, state=success, executor_state=success, try_number=1, max_tries=1, job_id=552, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:32:00.611090+00:00, queued_by_job_id=1, pid=8081 2024-04-05T00:32:06.627131083Z [2024-04-05T00:32:06.626+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:32:06.627591640Z [2024-04-05T00:32:06.627+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:31:00+00:00, run_id=scheduled__2024-04-05T00:31:00+00:00, run_start_date=2024-04-05 00:32:00.546263+00:00, run_end_date=2024-04-05 00:32:06.627212+00:00, run_duration=6.080949, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:31:00+00:00, data_interval_end=2024-04-05 00:32:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:32:06.637487566Z [2024-04-05T00:32:06.637+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:32:00+00:00, run_after=2024-04-05T00:33:00+00:00 2024-04-05T00:32:06.668492536Z [2024-04-05T00:32:06.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:31:00+00:00 exited with status success for try_number 1 2024-04-05T00:32:06.673368766Z [2024-04-05T00:32:06.672+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:31:00+00:00, map_index=-1, run_start_date=2024-04-05 00:32:03.762337+00:00, run_end_date=2024-04-05 00:32:06.018954+00:00, run_duration=2.256617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=553, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:32:00.611090+00:00, queued_by_job_id=1, pid=8092 2024-04-05T00:33:00.664160751Z [2024-04-05T00:33:00.663+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:33:00+00:00, run_after=2024-04-05T00:34:00+00:00 2024-04-05T00:33:00.676353958Z [2024-04-05T00:33:00.676+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:33:00+00:00, run_after=2024-04-05T00:34:00+00:00 2024-04-05T00:33:00.683070543Z [2024-04-05T00:33:00.682+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:33:00.751320898Z [2024-04-05T00:33:00.750+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:33:00.751370151Z 2024-04-05T00:33:00.751375636Z 2024-04-05T00:33:00.751380066Z 2024-04-05T00:33:00.751451414Z [2024-04-05T00:33:00.751+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:33:00.751818791Z [2024-04-05T00:33:00.751+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:33:00.751941369Z [2024-04-05T00:33:00.751+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:33:00.752560211Z [2024-04-05T00:33:00.752+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:33:00.752630287Z 2024-04-05T00:33:00.752635848Z 2024-04-05T00:33:00.752639916Z 2024-04-05T00:33:00.756661449Z [2024-04-05T00:33:00.756+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:33:00.756709084Z [2024-04-05T00:33:00.756+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:33:00.757011134Z [2024-04-05T00:33:00.756+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:33:00.757157805Z [2024-04-05T00:33:00.756+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:33:00.757379317Z [2024-04-05T00:33:00.757+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:33:00.757485346Z [2024-04-05T00:33:00.757+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:33:01.022968189Z [2024-04-05T00:33:01.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:32:00+00:00 exited with status queued for try_number 1 2024-04-05T00:33:01.023057320Z [2024-04-05T00:33:01.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:32:00+00:00 exited with status queued for try_number 1 2024-04-05T00:33:01.023204347Z [2024-04-05T00:33:01.023+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:32:00+00:00 exited with status queued for try_number 1 2024-04-05T00:33:01.031322740Z [2024-04-05T00:33:01.030+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0b33a30-7640-40d2-a46c-e34deeb1561b 2024-04-05T00:33:01.031835721Z [2024-04-05T00:33:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51cd2c32-c2c1-4969-a181-068faa4c944e 2024-04-05T00:33:01.032044943Z [2024-04-05T00:33:01.031+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed1382d8-f6f2-4073-a36b-2c5fdf7a3862 2024-04-05T00:33:02.927668546Z [2024-04-05T00:33:02.923+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:33:02.927701165Z [2024-04-05T00:33:02.926+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:32:00+00:00, run_id=scheduled__2024-04-05T00:32:00+00:00, run_start_date=2024-04-05 00:33:00.695348+00:00, run_end_date=2024-04-05 00:33:02.926744+00:00, run_duration=2.231396, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:32:00+00:00, data_interval_end=2024-04-05 00:33:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:33:02.958068913Z [2024-04-05T00:33:02.957+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:33:00+00:00, run_after=2024-04-05T00:34:00+00:00 2024-04-05T00:33:03.068051884Z [2024-04-05T00:33:03.067+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:32:00+00:00 exited with status success for try_number 1 2024-04-05T00:33:03.076417679Z [2024-04-05T00:33:03.076+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:32:00+00:00, map_index=-1, run_start_date=2024-04-05 00:33:01.821240+00:00, run_end_date=2024-04-05 00:33:02.461993+00:00, run_duration=0.640753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=554, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:33:00.753297+00:00, queued_by_job_id=1, pid=8119 2024-04-05T00:33:05.243525204Z [2024-04-05T00:33:05.243+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:33:05.243649857Z [2024-04-05T00:33:05.243+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:32:00+00:00, run_id=scheduled__2024-04-05T00:32:00+00:00, run_start_date=2024-04-05 00:33:00.697547+00:00, run_end_date=2024-04-05 00:33:05.243343+00:00, run_duration=4.545796, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:32:00+00:00, data_interval_end=2024-04-05 00:33:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:33:05.252190520Z [2024-04-05T00:33:05.251+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:33:00+00:00, run_after=2024-04-05T00:34:00+00:00 2024-04-05T00:33:05.258639572Z [2024-04-05T00:33:05.258+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:33:05.258746075Z [2024-04-05T00:33:05.258+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:32:00+00:00, run_id=scheduled__2024-04-05T00:32:00+00:00, run_start_date=2024-04-05 00:33:00.699057+00:00, run_end_date=2024-04-05 00:33:05.258506+00:00, run_duration=4.559449, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:32:00+00:00, data_interval_end=2024-04-05 00:33:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:33:05.267642008Z [2024-04-05T00:33:05.267+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:33:00+00:00, run_after=2024-04-05T00:34:00+00:00 2024-04-05T00:33:05.310535628Z [2024-04-05T00:33:05.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:32:00+00:00 exited with status success for try_number 1 2024-04-05T00:33:05.310655017Z [2024-04-05T00:33:05.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:32:00+00:00 exited with status success for try_number 1 2024-04-05T00:33:05.317147817Z [2024-04-05T00:33:05.316+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:32:00+00:00, map_index=-1, run_start_date=2024-04-05 00:33:03.155755+00:00, run_end_date=2024-04-05 00:33:04.411741+00:00, run_duration=1.255986, state=success, executor_state=success, try_number=1, max_tries=1, job_id=555, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:33:00.753297+00:00, queued_by_job_id=1, pid=8132 2024-04-05T00:33:05.317272627Z [2024-04-05T00:33:05.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:32:00+00:00, map_index=-1, run_start_date=2024-04-05 00:33:03.467859+00:00, run_end_date=2024-04-05 00:33:05.077782+00:00, run_duration=1.609923, state=success, executor_state=success, try_number=1, max_tries=1, job_id=556, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:33:00.753297+00:00, queued_by_job_id=1, pid=8143 2024-04-05T00:34:00.923446295Z [2024-04-05T00:34:00.922+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:34:00.943672033Z [2024-04-05T00:34:00.943+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:34:00+00:00, run_after=2024-04-05T00:35:00+00:00 2024-04-05T00:34:00.954306869Z [2024-04-05T00:34:00.953+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:34:00.980521500Z [2024-04-05T00:34:00.979+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:34:00+00:00, run_after=2024-04-05T00:35:00+00:00 2024-04-05T00:34:01.113524443Z [2024-04-05T00:34:01.113+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:34:01.113562599Z 2024-04-05T00:34:01.113569457Z 2024-04-05T00:34:01.113574872Z 2024-04-05T00:34:01.113607641Z 2024-04-05T00:34:01.113641917Z [2024-04-05T00:34:01.113+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:34:01.113861869Z [2024-04-05T00:34:01.113+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:34:01.114016075Z [2024-04-05T00:34:01.113+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:34:01.114115468Z [2024-04-05T00:34:01.114+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:34:01.114757503Z [2024-04-05T00:34:01.114+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:34:01.114768096Z 2024-04-05T00:34:01.114772491Z 2024-04-05T00:34:01.114775860Z 2024-04-05T00:34:01.114779228Z 2024-04-05T00:34:01.119137940Z [2024-04-05T00:34:01.118+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:34:01.119193838Z [2024-04-05T00:34:01.119+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:34:01.119466280Z [2024-04-05T00:34:01.119+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:34:01.119614603Z [2024-04-05T00:34:01.119+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:34:01.119884937Z [2024-04-05T00:34:01.119+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:34:01.119984185Z [2024-04-05T00:34:01.119+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:34:01.120201923Z [2024-04-05T00:34:01.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:34:01.120296882Z [2024-04-05T00:34:01.120+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:34:01.997239845Z [2024-04-05T00:34:01.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:32:00+00:00 exited with status queued for try_number 1 2024-04-05T00:34:02.000131363Z [2024-04-05T00:34:01.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:33:00+00:00 exited with status queued for try_number 1 2024-04-05T00:34:02.000410511Z [2024-04-05T00:34:02.000+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:33:00+00:00 exited with status queued for try_number 1 2024-04-05T00:34:02.004144256Z [2024-04-05T00:34:02.003+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:33:00+00:00 exited with status queued for try_number 1 2024-04-05T00:34:02.053697761Z [2024-04-05T00:34:02.053+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0fa9858a-1818-4e16-9a33-2733a25684ec 2024-04-05T00:34:02.065477419Z [2024-04-05T00:34:02.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0acaf80f-4de6-46ef-9b89-2846050eefc1 2024-04-05T00:34:02.065509601Z [2024-04-05T00:34:02.064+0000] {scheduler_job.py:635} INFO - Setting external_id for to 669c8323-d4d2-4047-b8b7-54c7d01070c9 2024-04-05T00:34:02.065515977Z [2024-04-05T00:34:02.064+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9b0a7eaa-203f-49c9-b839-bbd029ca91d5 2024-04-05T00:34:03.320655926Z [2024-04-05T00:34:03.320+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:34:03.322596145Z [2024-04-05T00:34:03.322+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:32:00+00:00, run_id=scheduled__2024-04-05T00:32:00+00:00, run_start_date=2024-04-05 00:34:00.994654+00:00, run_end_date=2024-04-05 00:34:03.320536+00:00, run_duration=2.325882, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:32:00+00:00, data_interval_end=2024-04-05 00:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:34:03.361521768Z [2024-04-05T00:34:03.361+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:34:00+00:00, run_after=2024-04-05T00:36:00+00:00 2024-04-05T00:34:03.437770810Z [2024-04-05T00:34:03.437+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:32:00+00:00 exited with status success for try_number 1 2024-04-05T00:34:03.443833804Z [2024-04-05T00:34:03.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:32:00+00:00, map_index=-1, run_start_date=2024-04-05 00:34:02.549805+00:00, run_end_date=2024-04-05 00:34:03.077969+00:00, run_duration=0.528164, state=success, executor_state=success, try_number=1, max_tries=1, job_id=557, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:34:01.115651+00:00, queued_by_job_id=1, pid=8166 2024-04-05T00:34:03.860796958Z [2024-04-05T00:34:03.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:34:03.861332299Z [2024-04-05T00:34:03.861+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:33:00+00:00, run_id=scheduled__2024-04-05T00:33:00+00:00, run_start_date=2024-04-05 00:34:00.996092+00:00, run_end_date=2024-04-05 00:34:03.860918+00:00, run_duration=2.864826, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:33:00+00:00, data_interval_end=2024-04-05 00:34:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:34:03.880646660Z [2024-04-05T00:34:03.880+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:34:00+00:00, run_after=2024-04-05T00:35:00+00:00 2024-04-05T00:34:03.987442809Z [2024-04-05T00:34:03.987+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:33:00+00:00 exited with status success for try_number 1 2024-04-05T00:34:03.993525347Z [2024-04-05T00:34:03.993+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:33:00+00:00, map_index=-1, run_start_date=2024-04-05 00:34:03.015395+00:00, run_end_date=2024-04-05 00:34:03.547113+00:00, run_duration=0.531718, state=success, executor_state=success, try_number=1, max_tries=1, job_id=558, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:34:01.115651+00:00, queued_by_job_id=1, pid=8177 2024-04-05T00:34:06.172485321Z [2024-04-05T00:34:06.172+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:34:06.173527127Z [2024-04-05T00:34:06.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:33:00+00:00, run_id=scheduled__2024-04-05T00:33:00+00:00, run_start_date=2024-04-05 00:34:00.997304+00:00, run_end_date=2024-04-05 00:34:06.172422+00:00, run_duration=5.175118, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:33:00+00:00, data_interval_end=2024-04-05 00:34:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:34:06.182331076Z [2024-04-05T00:34:06.181+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:34:00+00:00, run_after=2024-04-05T00:35:00+00:00 2024-04-05T00:34:06.222265273Z [2024-04-05T00:34:06.221+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:33:00+00:00 exited with status success for try_number 1 2024-04-05T00:34:06.227318119Z [2024-04-05T00:34:06.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:33:00+00:00, map_index=-1, run_start_date=2024-04-05 00:34:04.102606+00:00, run_end_date=2024-04-05 00:34:06.020654+00:00, run_duration=1.918048, state=success, executor_state=success, try_number=1, max_tries=1, job_id=559, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:34:01.115651+00:00, queued_by_job_id=1, pid=8195 2024-04-05T00:34:07.376785679Z [2024-04-05T00:34:07.376+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:34:07.376944262Z [2024-04-05T00:34:07.376+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:33:00+00:00, run_id=scheduled__2024-04-05T00:33:00+00:00, run_start_date=2024-04-05 00:34:00.998305+00:00, run_end_date=2024-04-05 00:34:07.376690+00:00, run_duration=6.378385, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:33:00+00:00, data_interval_end=2024-04-05 00:34:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:34:07.386019689Z [2024-04-05T00:34:07.385+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:34:00+00:00, run_after=2024-04-05T00:35:00+00:00 2024-04-05T00:34:07.423313862Z [2024-04-05T00:34:07.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:33:00+00:00 exited with status success for try_number 1 2024-04-05T00:34:07.429770652Z [2024-04-05T00:34:07.429+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:33:00+00:00, map_index=-1, run_start_date=2024-04-05 00:34:04.246459+00:00, run_end_date=2024-04-05 00:34:06.566720+00:00, run_duration=2.320261, state=success, executor_state=success, try_number=1, max_tries=1, job_id=560, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:34:01.115651+00:00, queued_by_job_id=1, pid=8196 2024-04-05T00:35:00.802084893Z [2024-04-05T00:35:00.801+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:35:00+00:00, run_after=2024-04-05T00:36:00+00:00 2024-04-05T00:35:00.811668382Z [2024-04-05T00:35:00.811+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:35:00.833498351Z [2024-04-05T00:35:00.833+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:35:00+00:00, run_after=2024-04-05T00:36:00+00:00 2024-04-05T00:35:00.848691476Z [2024-04-05T00:35:00.848+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:35:00+00:00, run_after=2024-04-05T00:40:00+00:00 2024-04-05T00:35:00.941263165Z [2024-04-05T00:35:00.940+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:35:00.941308694Z 2024-04-05T00:35:00.941318496Z 2024-04-05T00:35:00.941340118Z 2024-04-05T00:35:00.941343626Z 2024-04-05T00:35:00.941395206Z [2024-04-05T00:35:00.941+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:35:00.941582961Z [2024-04-05T00:35:00.941+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:35:00.941737005Z [2024-04-05T00:35:00.941+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:35:00.941908753Z [2024-04-05T00:35:00.941+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:35:00.942898535Z [2024-04-05T00:35:00.942+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:35:00.942910732Z 2024-04-05T00:35:00.942914528Z 2024-04-05T00:35:00.942918436Z 2024-04-05T00:35:00.942921584Z 2024-04-05T00:35:00.947012296Z [2024-04-05T00:35:00.946+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T00:35:00.947126323Z [2024-04-05T00:35:00.946+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:35:00.947361435Z [2024-04-05T00:35:00.947+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:35:00.947462310Z [2024-04-05T00:35:00.947+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:35:00.947838698Z [2024-04-05T00:35:00.947+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:35:00.948016569Z [2024-04-05T00:35:00.947+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:35:00.948387071Z [2024-04-05T00:35:00.948+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:35:00.948610742Z [2024-04-05T00:35:00.948+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:35:01.382387331Z [2024-04-05T00:35:01.381+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:30:00+00:00 exited with status queued for try_number 1 2024-04-05T00:35:01.383986191Z [2024-04-05T00:35:01.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:34:00+00:00 exited with status queued for try_number 1 2024-04-05T00:35:01.384003921Z [2024-04-05T00:35:01.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:34:00+00:00 exited with status queued for try_number 1 2024-04-05T00:35:01.384007496Z [2024-04-05T00:35:01.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:34:00+00:00 exited with status queued for try_number 1 2024-04-05T00:35:01.392712564Z [2024-04-05T00:35:01.392+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8b6f7cd-1122-4efc-9f59-56e035fa84cf 2024-04-05T00:35:01.393046816Z [2024-04-05T00:35:01.392+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93451ebe-409d-40e5-af82-d34fac798ba8 2024-04-05T00:35:01.393268926Z [2024-04-05T00:35:01.393+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6c9a58b8-4fc8-48f9-8aa1-a2aa16168320 2024-04-05T00:35:01.393455977Z [2024-04-05T00:35:01.393+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6976942b-7ce1-4a17-933b-2d58f241ce05 2024-04-05T00:35:03.909002260Z [2024-04-05T00:35:03.908+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:35:03.909678722Z [2024-04-05T00:35:03.909+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:34:00+00:00, run_id=scheduled__2024-04-05T00:34:00+00:00, run_start_date=2024-04-05 00:35:00.864095+00:00, run_end_date=2024-04-05 00:35:03.909049+00:00, run_duration=3.044954, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:34:00+00:00, data_interval_end=2024-04-05 00:35:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:35:03.943936835Z [2024-04-05T00:35:03.943+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:35:00+00:00, run_after=2024-04-05T00:36:00+00:00 2024-04-05T00:35:04.055365610Z [2024-04-05T00:35:04.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:34:00+00:00 exited with status success for try_number 1 2024-04-05T00:35:04.060878727Z [2024-04-05T00:35:04.060+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:34:00+00:00, map_index=-1, run_start_date=2024-04-05 00:35:02.212690+00:00, run_end_date=2024-04-05 00:35:02.894577+00:00, run_duration=0.681887, state=success, executor_state=success, try_number=1, max_tries=1, job_id=561, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:35:00.943873+00:00, queued_by_job_id=1, pid=8229 2024-04-05T00:35:04.915379864Z [2024-04-05T00:35:04.914+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:35:04.915415631Z 2024-04-05T00:35:04.915816547Z [2024-04-05T00:35:04.915+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:35:04.917120694Z [2024-04-05T00:35:04.916+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:35:04.917143020Z 2024-04-05T00:35:04.921560186Z [2024-04-05T00:35:04.921+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T00:35:04.922016697Z [2024-04-05T00:35:04.921+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:35:05.015001470Z [2024-04-05T00:35:05.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:30:00+00:00 exited with status queued for try_number 1 2024-04-05T00:35:05.015106092Z [2024-04-05T00:35:05.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:30:00+00:00 exited with status success for try_number 1 2024-04-05T00:35:05.022556656Z [2024-04-05T00:35:05.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c90e01d-6148-464f-8a3d-e2241457a8d9 2024-04-05T00:35:05.022802668Z [2024-04-05T00:35:05.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T00:30:00+00:00, map_index=-1, run_start_date=2024-04-05 00:35:04.071602+00:00, run_end_date=2024-04-05 00:35:04.466357+00:00, run_duration=0.394755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=563, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:35:00.943873+00:00, queued_by_job_id=1, pid=8254 2024-04-05T00:35:06.214763138Z [2024-04-05T00:35:06.214+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:35:06.215042776Z [2024-04-05T00:35:06.214+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:34:00+00:00, run_id=scheduled__2024-04-05T00:34:00+00:00, run_start_date=2024-04-05 00:35:00.867854+00:00, run_end_date=2024-04-05 00:35:06.214610+00:00, run_duration=5.346756, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:34:00+00:00, data_interval_end=2024-04-05 00:35:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:35:06.227495967Z [2024-04-05T00:35:06.226+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:35:00+00:00, run_after=2024-04-05T00:36:00+00:00 2024-04-05T00:35:06.236620086Z [2024-04-05T00:35:06.236+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:35:06.237180696Z [2024-04-05T00:35:06.236+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:34:00+00:00, run_id=scheduled__2024-04-05T00:34:00+00:00, run_start_date=2024-04-05 00:35:00.872115+00:00, run_end_date=2024-04-05 00:35:06.236461+00:00, run_duration=5.364346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:34:00+00:00, data_interval_end=2024-04-05 00:35:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:35:06.260987947Z [2024-04-05T00:35:06.260+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:35:00+00:00, run_after=2024-04-05T00:36:00+00:00 2024-04-05T00:35:06.353859525Z [2024-04-05T00:35:06.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:34:00+00:00 exited with status success for try_number 1 2024-04-05T00:35:06.360092536Z [2024-04-05T00:35:06.353+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:34:00+00:00 exited with status success for try_number 1 2024-04-05T00:35:06.371485931Z [2024-04-05T00:35:06.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:34:00+00:00, map_index=-1, run_start_date=2024-04-05 00:35:04.066289+00:00, run_end_date=2024-04-05 00:35:05.332574+00:00, run_duration=1.266285, state=success, executor_state=success, try_number=1, max_tries=1, job_id=564, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:35:00.943873+00:00, queued_by_job_id=1, pid=8255 2024-04-05T00:35:06.371765692Z [2024-04-05T00:35:06.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:34:00+00:00, map_index=-1, run_start_date=2024-04-05 00:35:03.978410+00:00, run_end_date=2024-04-05 00:35:05.570152+00:00, run_duration=1.591742, state=success, executor_state=success, try_number=1, max_tries=1, job_id=562, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:35:00.943873+00:00, queued_by_job_id=1, pid=8253 2024-04-05T00:35:07.772958409Z [2024-04-05T00:35:07.772+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:35:07.772985713Z 2024-04-05T00:35:07.773264344Z [2024-04-05T00:35:07.772+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:35:07.774334382Z [2024-04-05T00:35:07.774+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:35:07.774347881Z 2024-04-05T00:35:07.778117855Z [2024-04-05T00:35:07.777+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T00:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T00:35:07.778375122Z [2024-04-05T00:35:07.778+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T00:35:07.829398681Z [2024-04-05T00:35:07.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:30:00+00:00 exited with status queued for try_number 1 2024-04-05T00:35:07.830969128Z [2024-04-05T00:35:07.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:30:00+00:00 exited with status success for try_number 1 2024-04-05T00:35:07.839008467Z [2024-04-05T00:35:07.838+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7dc246c-c3ed-4bc9-ab6f-ddd11e5770c1 2024-04-05T00:35:07.839654348Z [2024-04-05T00:35:07.839+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T00:30:00+00:00, map_index=-1, run_start_date=2024-04-05 00:35:06.772274+00:00, run_end_date=2024-04-05 00:35:07.156118+00:00, run_duration=0.383844, state=success, executor_state=success, try_number=1, max_tries=1, job_id=565, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:35:04.917849+00:00, queued_by_job_id=1, pid=8278 2024-04-05T00:35:10.114716605Z [2024-04-05T00:35:10.114+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:35:10.114764046Z 2024-04-05T00:35:10.114775979Z [2024-04-05T00:35:10.114+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:35:10.115497390Z [2024-04-05T00:35:10.115+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:35:10.115522616Z 2024-04-05T00:35:10.118196958Z [2024-04-05T00:35:10.117+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T00:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:35:10.118457428Z [2024-04-05T00:35:10.118+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:35:10.170019774Z [2024-04-05T00:35:10.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:30:00+00:00 exited with status queued for try_number 1 2024-04-05T00:35:10.170440483Z [2024-04-05T00:35:10.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:30:00+00:00 exited with status success for try_number 1 2024-04-05T00:35:10.177936405Z [2024-04-05T00:35:10.177+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c7a24cc-6086-412d-98de-91b719c9313e 2024-04-05T00:35:10.178293102Z [2024-04-05T00:35:10.178+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T00:30:00+00:00, map_index=0, run_start_date=2024-04-05 00:35:09.432293+00:00, run_end_date=2024-04-05 00:35:09.788117+00:00, run_duration=0.355824, state=success, executor_state=success, try_number=1, max_tries=1, job_id=566, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:35:07.774918+00:00, queued_by_job_id=1, pid=8296 2024-04-05T00:35:12.445153678Z [2024-04-05T00:35:12.444+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:35:12.445562104Z [2024-04-05T00:35:12.445+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:30:00+00:00, run_id=scheduled__2024-04-05T00:30:00+00:00, run_start_date=2024-04-05 00:35:00.860662+00:00, run_end_date=2024-04-05 00:35:12.445176+00:00, run_duration=11.584514, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:30:00+00:00, data_interval_end=2024-04-05 00:35:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T00:35:12.451759113Z [2024-04-05T00:35:12.451+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:35:00+00:00, run_after=2024-04-05T00:40:00+00:00 2024-04-05T00:35:13.558187375Z [2024-04-05T00:35:13.557+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:30:00+00:00 exited with status success for try_number 1 2024-04-05T00:35:13.566555546Z [2024-04-05T00:35:13.565+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T00:30:00+00:00, map_index=-1, run_start_date=2024-04-05 00:35:11.988696+00:00, run_end_date=2024-04-05 00:35:12.400769+00:00, run_duration=0.412073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=567, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:35:10.115966+00:00, queued_by_job_id=1, pid=8307 2024-04-05T00:35:40.566586983Z [2024-04-05T00:35:40.566+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T00:36:00.298932572Z [2024-04-05T00:36:00.298+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:36:00.317190823Z [2024-04-05T00:36:00.316+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:36:00+00:00, run_after=2024-04-05T00:37:00+00:00 2024-04-05T00:36:00.349443763Z [2024-04-05T00:36:00.349+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:36:00+00:00, run_after=2024-04-05T00:37:00+00:00 2024-04-05T00:36:00.364123789Z [2024-04-05T00:36:00.363+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:36:00.439110528Z [2024-04-05T00:36:00.438+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:36:00.439172339Z 2024-04-05T00:36:00.439179742Z 2024-04-05T00:36:00.439183279Z 2024-04-05T00:36:00.439186404Z 2024-04-05T00:36:00.439499304Z [2024-04-05T00:36:00.439+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:36:00.439807205Z [2024-04-05T00:36:00.439+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:36:00.440005215Z [2024-04-05T00:36:00.439+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:36:00.440216611Z [2024-04-05T00:36:00.440+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:36:00.440938389Z [2024-04-05T00:36:00.440+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:36:00.440956988Z 2024-04-05T00:36:00.440963096Z 2024-04-05T00:36:00.440968076Z 2024-04-05T00:36:00.440973090Z 2024-04-05T00:36:00.445215540Z [2024-04-05T00:36:00.444+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:36:00.445449047Z [2024-04-05T00:36:00.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:36:00.445823002Z [2024-04-05T00:36:00.445+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:36:00.446105011Z [2024-04-05T00:36:00.445+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:36:00.446493410Z [2024-04-05T00:36:00.446+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:36:00.446653229Z [2024-04-05T00:36:00.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:36:00.446909989Z [2024-04-05T00:36:00.446+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:36:00.447060990Z [2024-04-05T00:36:00.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:36:01.158333018Z [2024-04-05T00:36:01.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:34:00+00:00 exited with status queued for try_number 1 2024-04-05T00:36:01.158368245Z [2024-04-05T00:36:01.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:35:00+00:00 exited with status queued for try_number 1 2024-04-05T00:36:01.158372027Z [2024-04-05T00:36:01.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:35:00+00:00 exited with status queued for try_number 1 2024-04-05T00:36:01.158375325Z [2024-04-05T00:36:01.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:35:00+00:00 exited with status queued for try_number 1 2024-04-05T00:36:01.204776475Z [2024-04-05T00:36:01.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17d798ac-18f6-414c-9183-b176f1515633 2024-04-05T00:36:01.204808514Z [2024-04-05T00:36:01.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to cbf9c4e7-711f-49b0-8dc2-e8c89ffc696e 2024-04-05T00:36:01.204816970Z [2024-04-05T00:36:01.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to 241b404f-eaf8-4473-b63c-6d595390f096 2024-04-05T00:36:01.204832186Z [2024-04-05T00:36:01.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to e26978c5-d4c5-465a-8cad-0d5828af25c2 2024-04-05T00:36:02.710255653Z [2024-04-05T00:36:02.709+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:36:02.712189976Z [2024-04-05T00:36:02.711+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:34:00+00:00, run_id=scheduled__2024-04-05T00:34:00+00:00, run_start_date=2024-04-05 00:36:00.374817+00:00, run_end_date=2024-04-05 00:36:02.710137+00:00, run_duration=2.33532, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:34:00+00:00, data_interval_end=2024-04-05 00:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:36:02.720764508Z [2024-04-05T00:36:02.720+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:36:00+00:00, run_after=2024-04-05T00:38:00+00:00 2024-04-05T00:36:03.897210678Z [2024-04-05T00:36:03.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:36:03.897698966Z [2024-04-05T00:36:03.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:35:00+00:00, run_id=scheduled__2024-04-05T00:35:00+00:00, run_start_date=2024-04-05 00:36:00.376280+00:00, run_end_date=2024-04-05 00:36:03.897185+00:00, run_duration=3.520905, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:35:00+00:00, data_interval_end=2024-04-05 00:36:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:36:03.919596976Z [2024-04-05T00:36:03.919+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:36:00+00:00, run_after=2024-04-05T00:37:00+00:00 2024-04-05T00:36:04.036638003Z [2024-04-05T00:36:04.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:34:00+00:00 exited with status success for try_number 1 2024-04-05T00:36:04.036733146Z [2024-04-05T00:36:04.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:35:00+00:00 exited with status success for try_number 1 2024-04-05T00:36:04.053061895Z [2024-04-05T00:36:04.052+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:35:00+00:00, map_index=-1, run_start_date=2024-04-05 00:36:02.233918+00:00, run_end_date=2024-04-05 00:36:02.858710+00:00, run_duration=0.624792, state=success, executor_state=success, try_number=1, max_tries=1, job_id=569, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:36:00.442410+00:00, queued_by_job_id=1, pid=8318 2024-04-05T00:36:04.053720314Z [2024-04-05T00:36:04.053+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:34:00+00:00, map_index=-1, run_start_date=2024-04-05 00:36:01.988059+00:00, run_end_date=2024-04-05 00:36:02.593164+00:00, run_duration=0.605105, state=success, executor_state=success, try_number=1, max_tries=1, job_id=568, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:36:00.442410+00:00, queued_by_job_id=1, pid=8317 2024-04-05T00:36:05.103670100Z [2024-04-05T00:36:05.103+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:36:05.104455253Z [2024-04-05T00:36:05.104+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:35:00+00:00, run_id=scheduled__2024-04-05T00:35:00+00:00, run_start_date=2024-04-05 00:36:00.377353+00:00, run_end_date=2024-04-05 00:36:05.103980+00:00, run_duration=4.726627, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:35:00+00:00, data_interval_end=2024-04-05 00:36:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:36:05.121122865Z [2024-04-05T00:36:05.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:36:00+00:00, run_after=2024-04-05T00:37:00+00:00 2024-04-05T00:36:05.173836128Z [2024-04-05T00:36:05.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:35:00+00:00 exited with status success for try_number 1 2024-04-05T00:36:05.180724655Z [2024-04-05T00:36:05.180+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:35:00+00:00, map_index=-1, run_start_date=2024-04-05 00:36:03.720985+00:00, run_end_date=2024-04-05 00:36:04.955124+00:00, run_duration=1.234139, state=success, executor_state=success, try_number=1, max_tries=1, job_id=571, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:36:00.442410+00:00, queued_by_job_id=1, pid=8342 2024-04-05T00:36:06.220950127Z [2024-04-05T00:36:06.220+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:36:06.221665783Z [2024-04-05T00:36:06.221+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:35:00+00:00, run_id=scheduled__2024-04-05T00:35:00+00:00, run_start_date=2024-04-05 00:36:00.378621+00:00, run_end_date=2024-04-05 00:36:06.220829+00:00, run_duration=5.842208, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:35:00+00:00, data_interval_end=2024-04-05 00:36:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:36:06.230562559Z [2024-04-05T00:36:06.230+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:36:00+00:00, run_after=2024-04-05T00:37:00+00:00 2024-04-05T00:36:06.266491488Z [2024-04-05T00:36:06.264+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:35:00+00:00 exited with status success for try_number 1 2024-04-05T00:36:06.270308240Z [2024-04-05T00:36:06.269+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:35:00+00:00, map_index=-1, run_start_date=2024-04-05 00:36:03.580196+00:00, run_end_date=2024-04-05 00:36:05.335661+00:00, run_duration=1.755465, state=success, executor_state=success, try_number=1, max_tries=1, job_id=570, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:36:00.442410+00:00, queued_by_job_id=1, pid=8341 2024-04-05T00:37:00.527431245Z [2024-04-05T00:37:00.526+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:37:00.539647606Z [2024-04-05T00:37:00.539+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:37:00+00:00, run_after=2024-04-05T00:38:00+00:00 2024-04-05T00:37:00.552077368Z [2024-04-05T00:37:00.551+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:37:00+00:00, run_after=2024-04-05T00:38:00+00:00 2024-04-05T00:37:00.614564107Z [2024-04-05T00:37:00.614+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:37:00.614590363Z 2024-04-05T00:37:00.614594402Z 2024-04-05T00:37:00.614597784Z 2024-04-05T00:37:00.614662411Z [2024-04-05T00:37:00.614+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:37:00.614836113Z [2024-04-05T00:37:00.614+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:37:00.614949949Z [2024-04-05T00:37:00.614+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:37:00.615622894Z [2024-04-05T00:37:00.615+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:37:00.615631944Z 2024-04-05T00:37:00.615635450Z 2024-04-05T00:37:00.615638608Z 2024-04-05T00:37:00.618963598Z [2024-04-05T00:37:00.618+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:37:00.619114380Z [2024-04-05T00:37:00.618+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:37:00.619362607Z [2024-04-05T00:37:00.619+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:37:00.619491568Z [2024-04-05T00:37:00.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:37:00.619732628Z [2024-04-05T00:37:00.619+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:37:00.619858080Z [2024-04-05T00:37:00.619+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:37:01.139493089Z [2024-04-05T00:37:01.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:36:00+00:00 exited with status queued for try_number 1 2024-04-05T00:37:01.139734723Z [2024-04-05T00:37:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:36:00+00:00 exited with status queued for try_number 1 2024-04-05T00:37:01.139867257Z [2024-04-05T00:37:01.139+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:36:00+00:00 exited with status queued for try_number 1 2024-04-05T00:37:01.163651764Z [2024-04-05T00:37:01.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to 88055514-74a6-4b7a-98ee-afcb2f798571 2024-04-05T00:37:01.163683384Z [2024-04-05T00:37:01.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0667c04c-6a66-4ff5-8163-a7723090c1c8 2024-04-05T00:37:01.163689365Z [2024-04-05T00:37:01.154+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75e37fc0-4b7d-4526-834b-cd7157e46eac 2024-04-05T00:37:03.177195344Z [2024-04-05T00:37:03.176+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:37:03.177655374Z [2024-04-05T00:37:03.177+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:36:00+00:00, run_id=scheduled__2024-04-05T00:36:00+00:00, run_start_date=2024-04-05 00:37:00.563712+00:00, run_end_date=2024-04-05 00:37:03.177126+00:00, run_duration=2.613414, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:36:00+00:00, data_interval_end=2024-04-05 00:37:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:37:03.195134267Z [2024-04-05T00:37:03.194+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:37:00+00:00, run_after=2024-04-05T00:38:00+00:00 2024-04-05T00:37:03.288345226Z [2024-04-05T00:37:03.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:36:00+00:00 exited with status success for try_number 1 2024-04-05T00:37:03.297934221Z [2024-04-05T00:37:03.297+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:36:00+00:00, map_index=-1, run_start_date=2024-04-05 00:37:02.047263+00:00, run_end_date=2024-04-05 00:37:02.688336+00:00, run_duration=0.641073, state=success, executor_state=success, try_number=1, max_tries=1, job_id=572, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:37:00.616305+00:00, queued_by_job_id=1, pid=8374 2024-04-05T00:37:05.464525890Z [2024-04-05T00:37:05.463+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:37:05.464946563Z [2024-04-05T00:37:05.464+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:36:00+00:00, run_id=scheduled__2024-04-05T00:36:00+00:00, run_start_date=2024-04-05 00:37:00.565025+00:00, run_end_date=2024-04-05 00:37:05.464381+00:00, run_duration=4.899356, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:36:00+00:00, data_interval_end=2024-04-05 00:37:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:37:05.480359195Z [2024-04-05T00:37:05.479+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:37:00+00:00, run_after=2024-04-05T00:38:00+00:00 2024-04-05T00:37:05.528278989Z [2024-04-05T00:37:05.527+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:36:00+00:00 exited with status success for try_number 1 2024-04-05T00:37:05.534947110Z [2024-04-05T00:37:05.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:36:00+00:00, map_index=-1, run_start_date=2024-04-05 00:37:03.208938+00:00, run_end_date=2024-04-05 00:37:05.012995+00:00, run_duration=1.804057, state=success, executor_state=success, try_number=1, max_tries=1, job_id=573, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:37:00.616305+00:00, queued_by_job_id=1, pid=8392 2024-04-05T00:37:06.589839952Z [2024-04-05T00:37:06.589+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:37:06.593139769Z [2024-04-05T00:37:06.589+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:36:00+00:00, run_id=scheduled__2024-04-05T00:36:00+00:00, run_start_date=2024-04-05 00:37:00.566147+00:00, run_end_date=2024-04-05 00:37:06.589680+00:00, run_duration=6.023533, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:36:00+00:00, data_interval_end=2024-04-05 00:37:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:37:06.602753578Z [2024-04-05T00:37:06.602+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:37:00+00:00, run_after=2024-04-05T00:38:00+00:00 2024-04-05T00:37:06.643374731Z [2024-04-05T00:37:06.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:36:00+00:00 exited with status success for try_number 1 2024-04-05T00:37:06.649188227Z [2024-04-05T00:37:06.648+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:36:00+00:00, map_index=-1, run_start_date=2024-04-05 00:37:03.267333+00:00, run_end_date=2024-04-05 00:37:05.636648+00:00, run_duration=2.369315, state=success, executor_state=success, try_number=1, max_tries=1, job_id=574, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:37:00.616305+00:00, queued_by_job_id=1, pid=8393 2024-04-05T00:38:00.770735983Z [2024-04-05T00:38:00.770+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:38:00+00:00, run_after=2024-04-05T00:39:00+00:00 2024-04-05T00:38:00.790521680Z [2024-04-05T00:38:00.790+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:38:00+00:00, run_after=2024-04-05T00:39:00+00:00 2024-04-05T00:38:00.802171957Z [2024-04-05T00:38:00.801+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:38:00.813562724Z [2024-04-05T00:38:00.813+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:38:00.909517992Z [2024-04-05T00:38:00.909+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:38:00.909556885Z 2024-04-05T00:38:00.909562753Z 2024-04-05T00:38:00.909567441Z 2024-04-05T00:38:00.909572384Z 2024-04-05T00:38:00.909739291Z [2024-04-05T00:38:00.909+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:38:00.909992967Z [2024-04-05T00:38:00.909+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:38:00.910193012Z [2024-04-05T00:38:00.910+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:38:00.910460881Z [2024-04-05T00:38:00.910+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:38:00.911289449Z [2024-04-05T00:38:00.911+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:38:00.911302231Z 2024-04-05T00:38:00.911306221Z 2024-04-05T00:38:00.911309600Z 2024-04-05T00:38:00.911312988Z 2024-04-05T00:38:00.915248092Z [2024-04-05T00:38:00.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:38:00.915445346Z [2024-04-05T00:38:00.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:38:00.915744708Z [2024-04-05T00:38:00.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:38:00.915883582Z [2024-04-05T00:38:00.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:38:00.916152983Z [2024-04-05T00:38:00.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:38:00.916196411Z [2024-04-05T00:38:00.916+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:38:00.916473441Z [2024-04-05T00:38:00.916+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:38:00.916575840Z [2024-04-05T00:38:00.916+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:38:01.502627579Z [2024-04-05T00:38:01.501+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:36:00+00:00 exited with status queued for try_number 1 2024-04-05T00:38:01.502700976Z [2024-04-05T00:38:01.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:37:00+00:00 exited with status queued for try_number 1 2024-04-05T00:38:01.508066243Z [2024-04-05T00:38:01.502+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:37:00+00:00 exited with status queued for try_number 1 2024-04-05T00:38:01.508345851Z [2024-04-05T00:38:01.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:37:00+00:00 exited with status queued for try_number 1 2024-04-05T00:38:01.539055206Z [2024-04-05T00:38:01.538+0000] {scheduler_job.py:635} INFO - Setting external_id for to 123c4926-50e7-4c5b-b4e7-c1c50e4c559a 2024-04-05T00:38:01.544198933Z [2024-04-05T00:38:01.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5dec0d7-945c-4e37-893b-13f5b83d957c 2024-04-05T00:38:01.544489179Z [2024-04-05T00:38:01.544+0000] {scheduler_job.py:635} INFO - Setting external_id for to fbf22b07-aa90-4b01-bb53-eddd8c8300ce 2024-04-05T00:38:01.544696155Z [2024-04-05T00:38:01.544+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f441238-7dff-4861-a57c-a2f764f645f4 2024-04-05T00:38:04.150666816Z [2024-04-05T00:38:04.149+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:38:04.151357849Z [2024-04-05T00:38:04.150+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:36:00+00:00, run_id=scheduled__2024-04-05T00:36:00+00:00, run_start_date=2024-04-05 00:38:00.828654+00:00, run_end_date=2024-04-05 00:38:04.150600+00:00, run_duration=3.321946, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:36:00+00:00, data_interval_end=2024-04-05 00:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:38:04.167882548Z [2024-04-05T00:38:04.165+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:38:00+00:00, run_after=2024-04-05T00:40:00+00:00 2024-04-05T00:38:04.186623965Z [2024-04-05T00:38:04.186+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:38:04.187504982Z [2024-04-05T00:38:04.187+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:37:00+00:00, run_id=scheduled__2024-04-05T00:37:00+00:00, run_start_date=2024-04-05 00:38:00.830256+00:00, run_end_date=2024-04-05 00:38:04.186521+00:00, run_duration=3.356265, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:37:00+00:00, data_interval_end=2024-04-05 00:38:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:38:04.205189133Z [2024-04-05T00:38:04.204+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:38:00+00:00, run_after=2024-04-05T00:39:00+00:00 2024-04-05T00:38:04.283677155Z [2024-04-05T00:38:04.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:36:00+00:00 exited with status success for try_number 1 2024-04-05T00:38:04.284024550Z [2024-04-05T00:38:04.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:37:00+00:00 exited with status success for try_number 1 2024-04-05T00:38:04.291940841Z [2024-04-05T00:38:04.291+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:36:00+00:00, map_index=-1, run_start_date=2024-04-05 00:38:02.429822+00:00, run_end_date=2024-04-05 00:38:03.177575+00:00, run_duration=0.747753, state=success, executor_state=success, try_number=1, max_tries=1, job_id=575, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:38:00.912312+00:00, queued_by_job_id=1, pid=8426 2024-04-05T00:38:04.292420322Z [2024-04-05T00:38:04.292+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:37:00+00:00, map_index=-1, run_start_date=2024-04-05 00:38:02.501519+00:00, run_end_date=2024-04-05 00:38:03.187891+00:00, run_duration=0.686372, state=success, executor_state=success, try_number=1, max_tries=1, job_id=576, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:38:00.912312+00:00, queued_by_job_id=1, pid=8427 2024-04-05T00:38:06.428338317Z [2024-04-05T00:38:06.427+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:38:06.428738511Z [2024-04-05T00:38:06.428+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:37:00+00:00, run_id=scheduled__2024-04-05T00:37:00+00:00, run_start_date=2024-04-05 00:38:00.831449+00:00, run_end_date=2024-04-05 00:38:06.428223+00:00, run_duration=5.596774, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:37:00+00:00, data_interval_end=2024-04-05 00:38:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:38:06.437827870Z [2024-04-05T00:38:06.437+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:38:00+00:00, run_after=2024-04-05T00:39:00+00:00 2024-04-05T00:38:06.444639575Z [2024-04-05T00:38:06.444+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:38:06.446291272Z [2024-04-05T00:38:06.445+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:37:00+00:00, run_id=scheduled__2024-04-05T00:37:00+00:00, run_start_date=2024-04-05 00:38:00.833033+00:00, run_end_date=2024-04-05 00:38:06.444485+00:00, run_duration=5.611452, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:37:00+00:00, data_interval_end=2024-04-05 00:38:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:38:06.455717390Z [2024-04-05T00:38:06.455+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:38:00+00:00, run_after=2024-04-05T00:39:00+00:00 2024-04-05T00:38:06.493444369Z [2024-04-05T00:38:06.492+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:37:00+00:00 exited with status success for try_number 1 2024-04-05T00:38:06.493819839Z [2024-04-05T00:38:06.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:37:00+00:00 exited with status success for try_number 1 2024-04-05T00:38:06.505007765Z [2024-04-05T00:38:06.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:37:00+00:00, map_index=-1, run_start_date=2024-04-05 00:38:04.021548+00:00, run_end_date=2024-04-05 00:38:06.187140+00:00, run_duration=2.165592, state=success, executor_state=success, try_number=1, max_tries=1, job_id=578, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:38:00.912312+00:00, queued_by_job_id=1, pid=8451 2024-04-05T00:38:06.505437408Z [2024-04-05T00:38:06.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:37:00+00:00, map_index=-1, run_start_date=2024-04-05 00:38:03.949563+00:00, run_end_date=2024-04-05 00:38:05.636090+00:00, run_duration=1.686527, state=success, executor_state=success, try_number=1, max_tries=1, job_id=577, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:38:00.912312+00:00, queued_by_job_id=1, pid=8450 2024-04-05T00:39:00.924907234Z [2024-04-05T00:39:00.924+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:39:00+00:00, run_after=2024-04-05T00:40:00+00:00 2024-04-05T00:39:00.939757422Z [2024-04-05T00:39:00.939+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:39:00+00:00, run_after=2024-04-05T00:40:00+00:00 2024-04-05T00:39:00.948834026Z [2024-04-05T00:39:00.948+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:39:01.028972362Z [2024-04-05T00:39:01.028+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:39:01.028999382Z 2024-04-05T00:39:01.029002865Z 2024-04-05T00:39:01.029006331Z 2024-04-05T00:39:01.029015083Z [2024-04-05T00:39:01.028+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:39:01.029086424Z [2024-04-05T00:39:01.028+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:39:01.029163594Z [2024-04-05T00:39:01.029+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:39:01.030055533Z [2024-04-05T00:39:01.029+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:39:01.030069144Z 2024-04-05T00:39:01.030073001Z 2024-04-05T00:39:01.030076341Z 2024-04-05T00:39:01.033503237Z [2024-04-05T00:39:01.033+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:39:01.033611785Z [2024-04-05T00:39:01.033+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:39:01.033823456Z [2024-04-05T00:39:01.033+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:39:01.033901001Z [2024-04-05T00:39:01.033+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:39:01.034058902Z [2024-04-05T00:39:01.033+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:39:01.034126618Z [2024-04-05T00:39:01.034+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:39:01.389607030Z [2024-04-05T00:39:01.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:38:00+00:00 exited with status queued for try_number 1 2024-04-05T00:39:01.391188462Z [2024-04-05T00:39:01.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:38:00+00:00 exited with status queued for try_number 1 2024-04-05T00:39:01.391435554Z [2024-04-05T00:39:01.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:38:00+00:00 exited with status queued for try_number 1 2024-04-05T00:39:01.409822819Z [2024-04-05T00:39:01.409+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe309b3d-a23a-40fc-b269-36a4e61ab79d 2024-04-05T00:39:01.410445196Z [2024-04-05T00:39:01.410+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7b532d6c-bff1-4a99-af95-dc533c49d16e 2024-04-05T00:39:01.410878394Z [2024-04-05T00:39:01.410+0000] {scheduler_job.py:635} INFO - Setting external_id for to 43efb571-9fe7-4ad0-9ad9-dc06c1b869f4 2024-04-05T00:39:03.798102161Z [2024-04-05T00:39:03.797+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:39:03.798864073Z [2024-04-05T00:39:03.798+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:38:00+00:00, run_id=scheduled__2024-04-05T00:38:00+00:00, run_start_date=2024-04-05 00:39:00.960866+00:00, run_end_date=2024-04-05 00:39:03.798329+00:00, run_duration=2.837463, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:38:00+00:00, data_interval_end=2024-04-05 00:39:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:39:03.809227479Z [2024-04-05T00:39:03.808+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:39:00+00:00, run_after=2024-04-05T00:40:00+00:00 2024-04-05T00:39:03.882595546Z [2024-04-05T00:39:03.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:38:00+00:00 exited with status success for try_number 1 2024-04-05T00:39:03.891198840Z [2024-04-05T00:39:03.890+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:38:00+00:00, map_index=-1, run_start_date=2024-04-05 00:39:02.188154+00:00, run_end_date=2024-04-05 00:39:02.797830+00:00, run_duration=0.609676, state=success, executor_state=success, try_number=1, max_tries=1, job_id=579, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:39:01.030916+00:00, queued_by_job_id=1, pid=8483 2024-04-05T00:39:06.073363514Z [2024-04-05T00:39:06.072+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:39:06.073737183Z [2024-04-05T00:39:06.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:38:00+00:00, run_id=scheduled__2024-04-05T00:38:00+00:00, run_start_date=2024-04-05 00:39:00.962117+00:00, run_end_date=2024-04-05 00:39:06.073321+00:00, run_duration=5.111204, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:38:00+00:00, data_interval_end=2024-04-05 00:39:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:39:06.085465747Z [2024-04-05T00:39:06.085+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:39:00+00:00, run_after=2024-04-05T00:40:00+00:00 2024-04-05T00:39:06.172885026Z [2024-04-05T00:39:06.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:38:00+00:00 exited with status success for try_number 1 2024-04-05T00:39:06.179722006Z [2024-04-05T00:39:06.177+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:38:00+00:00, map_index=-1, run_start_date=2024-04-05 00:39:03.312033+00:00, run_end_date=2024-04-05 00:39:05.104457+00:00, run_duration=1.792424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=580, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:39:01.030916+00:00, queued_by_job_id=1, pid=8501 2024-04-05T00:39:07.235492008Z [2024-04-05T00:39:07.234+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:39:07.235837196Z [2024-04-05T00:39:07.235+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:38:00+00:00, run_id=scheduled__2024-04-05T00:38:00+00:00, run_start_date=2024-04-05 00:39:00.963155+00:00, run_end_date=2024-04-05 00:39:07.235273+00:00, run_duration=6.272118, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:38:00+00:00, data_interval_end=2024-04-05 00:39:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:39:07.245504494Z [2024-04-05T00:39:07.245+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:39:00+00:00, run_after=2024-04-05T00:40:00+00:00 2024-04-05T00:39:07.287507456Z [2024-04-05T00:39:07.287+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:38:00+00:00 exited with status success for try_number 1 2024-04-05T00:39:07.294506411Z [2024-04-05T00:39:07.294+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:38:00+00:00, map_index=-1, run_start_date=2024-04-05 00:39:03.519677+00:00, run_end_date=2024-04-05 00:39:06.910320+00:00, run_duration=3.390643, state=success, executor_state=success, try_number=1, max_tries=1, job_id=581, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:39:01.030916+00:00, queued_by_job_id=1, pid=8502 2024-04-05T00:40:00.094671205Z [2024-04-05T00:40:00.094+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:40:00+00:00, run_after=2024-04-05T00:41:00+00:00 2024-04-05T00:40:00.105545982Z [2024-04-05T00:40:00.105+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:40:00.123011865Z [2024-04-05T00:40:00.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:40:00+00:00, run_after=2024-04-05T00:41:00+00:00 2024-04-05T00:40:00.131442799Z [2024-04-05T00:40:00.131+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:40:00.144755928Z [2024-04-05T00:40:00.144+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:40:00+00:00, run_after=2024-04-05T00:45:00+00:00 2024-04-05T00:40:00.291423740Z [2024-04-05T00:40:00.291+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T00:40:00.291451701Z 2024-04-05T00:40:00.291456483Z 2024-04-05T00:40:00.291461864Z 2024-04-05T00:40:00.291466379Z 2024-04-05T00:40:00.291470869Z 2024-04-05T00:40:00.291885530Z [2024-04-05T00:40:00.291+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:40:00.292135502Z [2024-04-05T00:40:00.291+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:40:00.292320551Z [2024-04-05T00:40:00.292+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:40:00.292472691Z [2024-04-05T00:40:00.292+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:40:00.292661817Z [2024-04-05T00:40:00.292+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:40:00.293596731Z [2024-04-05T00:40:00.293+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:40:00.293606860Z 2024-04-05T00:40:00.293611187Z 2024-04-05T00:40:00.293614563Z 2024-04-05T00:40:00.293617679Z 2024-04-05T00:40:00.293620704Z 2024-04-05T00:40:00.298747435Z [2024-04-05T00:40:00.298+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T00:40:00.298934015Z [2024-04-05T00:40:00.298+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:40:00.299193136Z [2024-04-05T00:40:00.299+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:40:00.299296330Z [2024-04-05T00:40:00.299+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:40:00.299539181Z [2024-04-05T00:40:00.299+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:40:00.299703944Z [2024-04-05T00:40:00.299+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:40:00.299952389Z [2024-04-05T00:40:00.299+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:40:00.300114352Z [2024-04-05T00:40:00.299+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:40:00.300371083Z [2024-04-05T00:40:00.300+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:40:00.300627632Z [2024-04-05T00:40:00.300+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:40:01.020873718Z [2024-04-05T00:40:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:35:00+00:00 exited with status queued for try_number 1 2024-04-05T00:40:01.021108677Z [2024-04-05T00:40:01.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:38:00+00:00 exited with status queued for try_number 1 2024-04-05T00:40:01.021333630Z [2024-04-05T00:40:01.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:39:00+00:00 exited with status queued for try_number 1 2024-04-05T00:40:01.021473672Z [2024-04-05T00:40:01.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:39:00+00:00 exited with status queued for try_number 1 2024-04-05T00:40:01.021577336Z [2024-04-05T00:40:01.021+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:39:00+00:00 exited with status queued for try_number 1 2024-04-05T00:40:01.057537560Z [2024-04-05T00:40:01.057+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7c0a8dcc-4ca9-41ce-92ac-431223160156 2024-04-05T00:40:01.057633345Z [2024-04-05T00:40:01.057+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4de7db56-82eb-4437-a5c6-8fff037297ad 2024-04-05T00:40:01.064158160Z [2024-04-05T00:40:01.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3f006f5-b502-4f4a-a8c0-9954dbc6a9b1 2024-04-05T00:40:01.064322633Z [2024-04-05T00:40:01.064+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b6fa6f7-dad3-4076-afc0-1da34d4fa214 2024-04-05T00:40:01.064522977Z [2024-04-05T00:40:01.064+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8033550-e607-4d2b-a0f2-7637c1a27f99 2024-04-05T00:40:03.668826590Z [2024-04-05T00:40:03.668+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:40:03.669202126Z [2024-04-05T00:40:03.668+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:38:00+00:00, run_id=scheduled__2024-04-05T00:38:00+00:00, run_start_date=2024-04-05 00:40:00.164286+00:00, run_end_date=2024-04-05 00:40:03.668699+00:00, run_duration=3.504413, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:38:00+00:00, data_interval_end=2024-04-05 00:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:40:03.685566542Z [2024-04-05T00:40:03.681+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:40:00+00:00, run_after=2024-04-05T00:42:00+00:00 2024-04-05T00:40:03.701840771Z [2024-04-05T00:40:03.701+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:40:03.702328328Z [2024-04-05T00:40:03.702+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:39:00+00:00, run_id=scheduled__2024-04-05T00:39:00+00:00, run_start_date=2024-04-05 00:40:00.165707+00:00, run_end_date=2024-04-05 00:40:03.701961+00:00, run_duration=3.536254, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:39:00+00:00, data_interval_end=2024-04-05 00:40:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:40:03.720620583Z [2024-04-05T00:40:03.718+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:40:00+00:00, run_after=2024-04-05T00:41:00+00:00 2024-04-05T00:40:03.818647756Z [2024-04-05T00:40:03.818+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:38:00+00:00 exited with status success for try_number 1 2024-04-05T00:40:03.821323532Z [2024-04-05T00:40:03.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:39:00+00:00 exited with status success for try_number 1 2024-04-05T00:40:03.829191003Z [2024-04-05T00:40:03.828+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:39:00+00:00, map_index=-1, run_start_date=2024-04-05 00:40:02.491541+00:00, run_end_date=2024-04-05 00:40:03.038393+00:00, run_duration=0.546852, state=success, executor_state=success, try_number=1, max_tries=1, job_id=583, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:40:00.295279+00:00, queued_by_job_id=1, pid=8542 2024-04-05T00:40:03.829613233Z [2024-04-05T00:40:03.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:38:00+00:00, map_index=-1, run_start_date=2024-04-05 00:40:02.002025+00:00, run_end_date=2024-04-05 00:40:02.571330+00:00, run_duration=0.569305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=582, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:40:00.295279+00:00, queued_by_job_id=1, pid=8532 2024-04-05T00:40:04.744147450Z [2024-04-05T00:40:04.743+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:40:04.744190473Z 2024-04-05T00:40:04.744704593Z [2024-04-05T00:40:04.744+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:40:04.745859078Z [2024-04-05T00:40:04.745+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:40:04.745898199Z 2024-04-05T00:40:04.750291646Z [2024-04-05T00:40:04.749+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T00:40:04.750776689Z [2024-04-05T00:40:04.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:40:04.813353163Z [2024-04-05T00:40:04.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:35:00+00:00 exited with status queued for try_number 1 2024-04-05T00:40:04.813709276Z [2024-04-05T00:40:04.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:35:00+00:00 exited with status success for try_number 1 2024-04-05T00:40:04.821386434Z [2024-04-05T00:40:04.820+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9c72f42d-9716-4add-b2a4-b63b2c612b36 2024-04-05T00:40:04.821989831Z [2024-04-05T00:40:04.821+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T00:35:00+00:00, map_index=-1, run_start_date=2024-04-05 00:40:03.621020+00:00, run_end_date=2024-04-05 00:40:04.056185+00:00, run_duration=0.435165, state=success, executor_state=success, try_number=1, max_tries=1, job_id=585, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:40:00.295279+00:00, queued_by_job_id=1, pid=8567 2024-04-05T00:40:06.030713868Z [2024-04-05T00:40:06.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:40:06.031149388Z [2024-04-05T00:40:06.030+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:39:00+00:00, run_id=scheduled__2024-04-05T00:39:00+00:00, run_start_date=2024-04-05 00:40:00.167028+00:00, run_end_date=2024-04-05 00:40:06.030606+00:00, run_duration=5.863578, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:39:00+00:00, data_interval_end=2024-04-05 00:40:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:40:06.042141939Z [2024-04-05T00:40:06.041+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:40:00+00:00, run_after=2024-04-05T00:41:00+00:00 2024-04-05T00:40:06.052842657Z [2024-04-05T00:40:06.052+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:40:06.053188873Z [2024-04-05T00:40:06.052+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:39:00+00:00, run_id=scheduled__2024-04-05T00:39:00+00:00, run_start_date=2024-04-05 00:40:00.168401+00:00, run_end_date=2024-04-05 00:40:06.052727+00:00, run_duration=5.884326, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:39:00+00:00, data_interval_end=2024-04-05 00:40:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:40:06.065155827Z [2024-04-05T00:40:06.064+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:40:00+00:00, run_after=2024-04-05T00:41:00+00:00 2024-04-05T00:40:06.151248728Z [2024-04-05T00:40:06.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:39:00+00:00 exited with status success for try_number 1 2024-04-05T00:40:06.151785536Z [2024-04-05T00:40:06.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:39:00+00:00 exited with status success for try_number 1 2024-04-05T00:40:06.165987549Z [2024-04-05T00:40:06.165+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:39:00+00:00, map_index=-1, run_start_date=2024-04-05 00:40:03.551839+00:00, run_end_date=2024-04-05 00:40:05.083987+00:00, run_duration=1.532148, state=success, executor_state=success, try_number=1, max_tries=1, job_id=584, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:40:00.295279+00:00, queued_by_job_id=1, pid=8561 2024-04-05T00:40:06.166589111Z [2024-04-05T00:40:06.166+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:39:00+00:00, map_index=-1, run_start_date=2024-04-05 00:40:03.855179+00:00, run_end_date=2024-04-05 00:40:05.800437+00:00, run_duration=1.945258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=586, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:40:00.295279+00:00, queued_by_job_id=1, pid=8568 2024-04-05T00:40:07.235699322Z [2024-04-05T00:40:07.235+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:40:07.235733941Z 2024-04-05T00:40:07.235965260Z [2024-04-05T00:40:07.235+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:40:07.236498313Z [2024-04-05T00:40:07.236+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:40:07.236507475Z 2024-04-05T00:40:07.239126857Z [2024-04-05T00:40:07.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T00:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T00:40:07.239167027Z [2024-04-05T00:40:07.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T00:40:07.312100615Z [2024-04-05T00:40:07.309+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:35:00+00:00 exited with status queued for try_number 1 2024-04-05T00:40:07.312377584Z [2024-04-05T00:40:07.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:35:00+00:00 exited with status success for try_number 1 2024-04-05T00:40:07.320033921Z [2024-04-05T00:40:07.319+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5b72c0f9-a1c4-4ed8-83dd-6ecd35f2ef57 2024-04-05T00:40:07.320200382Z [2024-04-05T00:40:07.319+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T00:35:00+00:00, map_index=-1, run_start_date=2024-04-05 00:40:06.585680+00:00, run_end_date=2024-04-05 00:40:06.931439+00:00, run_duration=0.345759, state=success, executor_state=success, try_number=1, max_tries=1, job_id=587, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:40:04.746564+00:00, queued_by_job_id=1, pid=8591 2024-04-05T00:40:09.531214221Z [2024-04-05T00:40:09.530+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:40:09.531251979Z 2024-04-05T00:40:09.531789119Z [2024-04-05T00:40:09.531+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:40:09.533058866Z [2024-04-05T00:40:09.532+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:40:09.533076785Z 2024-04-05T00:40:09.536837865Z [2024-04-05T00:40:09.536+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T00:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:40:09.537275446Z [2024-04-05T00:40:09.536+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:40:09.591552185Z [2024-04-05T00:40:09.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:35:00+00:00 exited with status queued for try_number 1 2024-04-05T00:40:09.594085481Z [2024-04-05T00:40:09.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:35:00+00:00 exited with status success for try_number 1 2024-04-05T00:40:09.600474419Z [2024-04-05T00:40:09.600+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ba5352a-8e91-413a-aa10-3e496703b304 2024-04-05T00:40:09.600991454Z [2024-04-05T00:40:09.600+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T00:35:00+00:00, map_index=0, run_start_date=2024-04-05 00:40:08.898360+00:00, run_end_date=2024-04-05 00:40:09.213760+00:00, run_duration=0.3154, state=success, executor_state=success, try_number=1, max_tries=1, job_id=588, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:40:07.236874+00:00, queued_by_job_id=1, pid=8599 2024-04-05T00:40:12.073550374Z [2024-04-05T00:40:12.073+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:40:12.073635716Z [2024-04-05T00:40:12.073+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:35:00+00:00, run_id=scheduled__2024-04-05T00:35:00+00:00, run_start_date=2024-04-05 00:40:00.162818+00:00, run_end_date=2024-04-05 00:40:12.073352+00:00, run_duration=11.910534, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:35:00+00:00, data_interval_end=2024-04-05 00:40:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T00:40:12.080648985Z [2024-04-05T00:40:12.080+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:40:00+00:00, run_after=2024-04-05T00:45:00+00:00 2024-04-05T00:40:12.114210479Z [2024-04-05T00:40:12.113+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:35:00+00:00 exited with status success for try_number 1 2024-04-05T00:40:12.122632432Z [2024-04-05T00:40:12.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T00:35:00+00:00, map_index=-1, run_start_date=2024-04-05 00:40:11.315492+00:00, run_end_date=2024-04-05 00:40:11.716534+00:00, run_duration=0.401042, state=success, executor_state=success, try_number=1, max_tries=1, job_id=589, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:40:09.533888+00:00, queued_by_job_id=1, pid=8617 2024-04-05T00:40:40.625227621Z [2024-04-05T00:40:40.624+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T00:41:00.538015052Z [2024-04-05T00:41:00.537+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:41:00+00:00, run_after=2024-04-05T00:42:00+00:00 2024-04-05T00:41:00.551868756Z [2024-04-05T00:41:00.551+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:41:00+00:00, run_after=2024-04-05T00:42:00+00:00 2024-04-05T00:41:00.559128412Z [2024-04-05T00:41:00.558+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:41:00.636519048Z [2024-04-05T00:41:00.636+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:41:00.636542096Z 2024-04-05T00:41:00.636545798Z 2024-04-05T00:41:00.636549111Z 2024-04-05T00:41:00.636634981Z [2024-04-05T00:41:00.636+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:41:00.636987906Z [2024-04-05T00:41:00.636+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:41:00.637187109Z [2024-04-05T00:41:00.637+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:41:00.638138869Z [2024-04-05T00:41:00.637+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:41:00.638194968Z 2024-04-05T00:41:00.638199757Z 2024-04-05T00:41:00.638202997Z 2024-04-05T00:41:00.645388658Z [2024-04-05T00:41:00.644+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:41:00.645549780Z [2024-04-05T00:41:00.645+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:41:00.645989854Z [2024-04-05T00:41:00.645+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:41:00.646190777Z [2024-04-05T00:41:00.645+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:41:00.646659045Z [2024-04-05T00:41:00.646+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:41:00.646819624Z [2024-04-05T00:41:00.646+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:41:01.055874865Z [2024-04-05T00:41:01.054+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:40:00+00:00 exited with status queued for try_number 1 2024-04-05T00:41:01.056030063Z [2024-04-05T00:41:01.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:40:00+00:00 exited with status queued for try_number 1 2024-04-05T00:41:01.056169105Z [2024-04-05T00:41:01.055+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:40:00+00:00 exited with status queued for try_number 1 2024-04-05T00:41:01.077608188Z [2024-04-05T00:41:01.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to 02cce8d4-d339-4cee-9d4a-ed66ac41331b 2024-04-05T00:41:01.077637576Z [2024-04-05T00:41:01.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6c2f0d0-bb3d-4789-bc04-c42e1e9c105d 2024-04-05T00:41:01.077698738Z [2024-04-05T00:41:01.077+0000] {scheduler_job.py:635} INFO - Setting external_id for to b56b08bf-b9bf-4ffa-94c8-7f6498a6eda3 2024-04-05T00:41:03.664948525Z [2024-04-05T00:41:03.664+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:41:03.665584548Z [2024-04-05T00:41:03.665+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:40:00+00:00, run_id=scheduled__2024-04-05T00:40:00+00:00, run_start_date=2024-04-05 00:41:00.569464+00:00, run_end_date=2024-04-05 00:41:03.665098+00:00, run_duration=3.095634, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:40:00+00:00, data_interval_end=2024-04-05 00:41:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:41:03.680070313Z [2024-04-05T00:41:03.679+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:41:00+00:00, run_after=2024-04-05T00:42:00+00:00 2024-04-05T00:41:03.751403321Z [2024-04-05T00:41:03.751+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:40:00+00:00 exited with status success for try_number 1 2024-04-05T00:41:03.766418355Z [2024-04-05T00:41:03.764+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:40:00+00:00, map_index=-1, run_start_date=2024-04-05 00:41:02.080468+00:00, run_end_date=2024-04-05 00:41:02.938153+00:00, run_duration=0.857685, state=success, executor_state=success, try_number=1, max_tries=1, job_id=590, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:41:00.640330+00:00, queued_by_job_id=1, pid=8629 2024-04-05T00:41:05.910633138Z [2024-04-05T00:41:05.910+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:41:05.911197019Z [2024-04-05T00:41:05.910+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:40:00+00:00, run_id=scheduled__2024-04-05T00:40:00+00:00, run_start_date=2024-04-05 00:41:00.570710+00:00, run_end_date=2024-04-05 00:41:05.910736+00:00, run_duration=5.340026, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:40:00+00:00, data_interval_end=2024-04-05 00:41:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:41:05.924041016Z [2024-04-05T00:41:05.923+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:41:00+00:00, run_after=2024-04-05T00:42:00+00:00 2024-04-05T00:41:05.964561375Z [2024-04-05T00:41:05.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:40:00+00:00 exited with status success for try_number 1 2024-04-05T00:41:05.973251649Z [2024-04-05T00:41:05.972+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:40:00+00:00, map_index=-1, run_start_date=2024-04-05 00:41:03.579985+00:00, run_end_date=2024-04-05 00:41:05.181431+00:00, run_duration=1.601446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=591, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:41:00.640330+00:00, queued_by_job_id=1, pid=8642 2024-04-05T00:41:06.183740608Z [2024-04-05T00:41:06.182+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:41:06.183785055Z [2024-04-05T00:41:06.183+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:40:00+00:00, run_id=scheduled__2024-04-05T00:40:00+00:00, run_start_date=2024-04-05 00:41:00.572126+00:00, run_end_date=2024-04-05 00:41:06.183168+00:00, run_duration=5.611042, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:40:00+00:00, data_interval_end=2024-04-05 00:41:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:41:06.191667607Z [2024-04-05T00:41:06.191+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:41:00+00:00, run_after=2024-04-05T00:42:00+00:00 2024-04-05T00:41:06.226981514Z [2024-04-05T00:41:06.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:40:00+00:00 exited with status success for try_number 1 2024-04-05T00:41:06.232565070Z [2024-04-05T00:41:06.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:40:00+00:00, map_index=-1, run_start_date=2024-04-05 00:41:03.911207+00:00, run_end_date=2024-04-05 00:41:06.040298+00:00, run_duration=2.129091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=592, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:41:00.640330+00:00, queued_by_job_id=1, pid=8653 2024-04-05T00:42:00.156154205Z [2024-04-05T00:42:00.155+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:42:00+00:00, run_after=2024-04-05T00:43:00+00:00 2024-04-05T00:42:00.163053827Z [2024-04-05T00:42:00.162+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:42:00.169440588Z [2024-04-05T00:42:00.169+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:42:00.182645362Z [2024-04-05T00:42:00.182+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:42:00+00:00, run_after=2024-04-05T00:43:00+00:00 2024-04-05T00:42:00.254307870Z [2024-04-05T00:42:00.253+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:42:00.254332294Z 2024-04-05T00:42:00.254336150Z 2024-04-05T00:42:00.254339098Z 2024-04-05T00:42:00.254342102Z 2024-04-05T00:42:00.254687743Z [2024-04-05T00:42:00.254+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:42:00.254699358Z [2024-04-05T00:42:00.254+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:42:00.254702927Z [2024-04-05T00:42:00.254+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:42:00.254808949Z [2024-04-05T00:42:00.254+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:42:00.255417755Z [2024-04-05T00:42:00.255+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:42:00.255428771Z 2024-04-05T00:42:00.255432227Z 2024-04-05T00:42:00.255435269Z 2024-04-05T00:42:00.255438467Z 2024-04-05T00:42:00.258654838Z [2024-04-05T00:42:00.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:42:00.258754404Z [2024-04-05T00:42:00.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:42:00.258956293Z [2024-04-05T00:42:00.258+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:42:00.259103205Z [2024-04-05T00:42:00.258+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:42:00.259374173Z [2024-04-05T00:42:00.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:42:00.259467940Z [2024-04-05T00:42:00.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:42:00.259711368Z [2024-04-05T00:42:00.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:42:00.259860954Z [2024-04-05T00:42:00.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:42:00.748623959Z [2024-04-05T00:42:00.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:40:00+00:00 exited with status queued for try_number 1 2024-04-05T00:42:00.748655620Z [2024-04-05T00:42:00.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:41:00+00:00 exited with status queued for try_number 1 2024-04-05T00:42:00.748697005Z [2024-04-05T00:42:00.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:41:00+00:00 exited with status queued for try_number 1 2024-04-05T00:42:00.748880263Z [2024-04-05T00:42:00.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:41:00+00:00 exited with status queued for try_number 1 2024-04-05T00:42:00.757459318Z [2024-04-05T00:42:00.757+0000] {scheduler_job.py:635} INFO - Setting external_id for to 762cbc91-a10b-4c86-91ca-8d2a3b3f7545 2024-04-05T00:42:00.757671249Z [2024-04-05T00:42:00.757+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4a8ce703-7bee-4a2e-8a0f-a0f473507ee5 2024-04-05T00:42:00.757920298Z [2024-04-05T00:42:00.757+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd7d869b-f9f6-4d6b-b06c-be93daaf433b 2024-04-05T00:42:00.758161207Z [2024-04-05T00:42:00.757+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53127437-0663-4579-819b-6437bbe3dded 2024-04-05T00:42:03.217447203Z [2024-04-05T00:42:03.216+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:42:03.217594928Z [2024-04-05T00:42:03.217+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:40:00+00:00, run_id=scheduled__2024-04-05T00:40:00+00:00, run_start_date=2024-04-05 00:42:00.193478+00:00, run_end_date=2024-04-05 00:42:03.217270+00:00, run_duration=3.023792, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:40:00+00:00, data_interval_end=2024-04-05 00:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:42:03.225730321Z [2024-04-05T00:42:03.225+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:42:00+00:00, run_after=2024-04-05T00:44:00+00:00 2024-04-05T00:42:03.232706478Z [2024-04-05T00:42:03.232+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:42:03.232819091Z [2024-04-05T00:42:03.232+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:41:00+00:00, run_id=scheduled__2024-04-05T00:41:00+00:00, run_start_date=2024-04-05 00:42:00.194613+00:00, run_end_date=2024-04-05 00:42:03.232565+00:00, run_duration=3.037952, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:41:00+00:00, data_interval_end=2024-04-05 00:42:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:42:03.242769529Z [2024-04-05T00:42:03.242+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:42:00+00:00, run_after=2024-04-05T00:43:00+00:00 2024-04-05T00:42:03.313165727Z [2024-04-05T00:42:03.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:40:00+00:00 exited with status success for try_number 1 2024-04-05T00:42:03.317371559Z [2024-04-05T00:42:03.316+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:41:00+00:00 exited with status success for try_number 1 2024-04-05T00:42:03.329106475Z [2024-04-05T00:42:03.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:41:00+00:00, map_index=-1, run_start_date=2024-04-05 00:42:02.070654+00:00, run_end_date=2024-04-05 00:42:02.522731+00:00, run_duration=0.452077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=594, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:42:00.256294+00:00, queued_by_job_id=1, pid=8687 2024-04-05T00:42:03.329521883Z [2024-04-05T00:42:03.329+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:40:00+00:00, map_index=-1, run_start_date=2024-04-05 00:42:01.563294+00:00, run_end_date=2024-04-05 00:42:02.031307+00:00, run_duration=0.468013, state=success, executor_state=success, try_number=1, max_tries=1, job_id=593, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:42:00.256294+00:00, queued_by_job_id=1, pid=8676 2024-04-05T00:42:04.387361909Z [2024-04-05T00:42:04.386+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:42:04.387697414Z [2024-04-05T00:42:04.387+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:41:00+00:00, run_id=scheduled__2024-04-05T00:41:00+00:00, run_start_date=2024-04-05 00:42:00.195707+00:00, run_end_date=2024-04-05 00:42:04.387182+00:00, run_duration=4.191475, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:41:00+00:00, data_interval_end=2024-04-05 00:42:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:42:04.403863803Z [2024-04-05T00:42:04.403+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:42:00+00:00, run_after=2024-04-05T00:43:00+00:00 2024-04-05T00:42:04.461716143Z [2024-04-05T00:42:04.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:41:00+00:00 exited with status success for try_number 1 2024-04-05T00:42:04.472562101Z [2024-04-05T00:42:04.472+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:41:00+00:00, map_index=-1, run_start_date=2024-04-05 00:42:02.953180+00:00, run_end_date=2024-04-05 00:42:04.225810+00:00, run_duration=1.27263, state=success, executor_state=success, try_number=1, max_tries=1, job_id=595, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:42:00.256294+00:00, queued_by_job_id=1, pid=8702 2024-04-05T00:42:05.529835361Z [2024-04-05T00:42:05.529+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:42:05.530118931Z [2024-04-05T00:42:05.529+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:41:00+00:00, run_id=scheduled__2024-04-05T00:41:00+00:00, run_start_date=2024-04-05 00:42:00.196905+00:00, run_end_date=2024-04-05 00:42:05.529746+00:00, run_duration=5.332841, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:41:00+00:00, data_interval_end=2024-04-05 00:42:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:42:05.541004915Z [2024-04-05T00:42:05.540+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:42:00+00:00, run_after=2024-04-05T00:43:00+00:00 2024-04-05T00:42:05.573796459Z [2024-04-05T00:42:05.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:41:00+00:00 exited with status success for try_number 1 2024-04-05T00:42:05.582960219Z [2024-04-05T00:42:05.582+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:41:00+00:00, map_index=-1, run_start_date=2024-04-05 00:42:03.200263+00:00, run_end_date=2024-04-05 00:42:04.906703+00:00, run_duration=1.70644, state=success, executor_state=success, try_number=1, max_tries=1, job_id=596, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:42:00.256294+00:00, queued_by_job_id=1, pid=8706 2024-04-05T00:43:00.570782592Z [2024-04-05T00:43:00.570+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:43:00+00:00, run_after=2024-04-05T00:44:00+00:00 2024-04-05T00:43:00.585879055Z [2024-04-05T00:43:00.585+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:43:00+00:00, run_after=2024-04-05T00:44:00+00:00 2024-04-05T00:43:00.596878031Z [2024-04-05T00:43:00.596+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:43:00.675475076Z [2024-04-05T00:43:00.674+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:43:00.675516471Z 2024-04-05T00:43:00.675551596Z 2024-04-05T00:43:00.675555574Z 2024-04-05T00:43:00.675876345Z [2024-04-05T00:43:00.675+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:43:00.676258377Z [2024-04-05T00:43:00.676+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:43:00.676489896Z [2024-04-05T00:43:00.676+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:43:00.677179043Z [2024-04-05T00:43:00.676+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:43:00.677191407Z 2024-04-05T00:43:00.677195132Z 2024-04-05T00:43:00.677198348Z 2024-04-05T00:43:00.681233571Z [2024-04-05T00:43:00.680+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:43:00.681520703Z [2024-04-05T00:43:00.681+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:43:00.681939246Z [2024-04-05T00:43:00.681+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:43:00.682212392Z [2024-04-05T00:43:00.681+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:43:00.682556939Z [2024-04-05T00:43:00.682+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:43:00.682790393Z [2024-04-05T00:43:00.682+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:43:01.219758996Z [2024-04-05T00:43:01.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:42:00+00:00 exited with status queued for try_number 1 2024-04-05T00:43:01.219821736Z [2024-04-05T00:43:01.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:42:00+00:00 exited with status queued for try_number 1 2024-04-05T00:43:01.219828663Z [2024-04-05T00:43:01.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:42:00+00:00 exited with status queued for try_number 1 2024-04-05T00:43:01.263703366Z [2024-04-05T00:43:01.260+0000] {scheduler_job.py:635} INFO - Setting external_id for to 810f1ecc-eb5d-4984-a0ba-75bc16d258d6 2024-04-05T00:43:01.263735144Z [2024-04-05T00:43:01.260+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60bfcaf5-8950-41ec-a163-176b70cf781b 2024-04-05T00:43:01.263739379Z [2024-04-05T00:43:01.260+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ff25698-45f5-400b-adac-c7423c424110 2024-04-05T00:43:04.219461936Z [2024-04-05T00:43:04.218+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:43:04.220018200Z [2024-04-05T00:43:04.219+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:42:00+00:00, run_id=scheduled__2024-04-05T00:42:00+00:00, run_start_date=2024-04-05 00:43:00.613729+00:00, run_end_date=2024-04-05 00:43:04.219396+00:00, run_duration=3.605667, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:42:00+00:00, data_interval_end=2024-04-05 00:43:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:43:04.232256973Z [2024-04-05T00:43:04.231+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:43:00+00:00, run_after=2024-04-05T00:44:00+00:00 2024-04-05T00:43:04.279948587Z [2024-04-05T00:43:04.279+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:42:00+00:00 exited with status success for try_number 1 2024-04-05T00:43:04.287578926Z [2024-04-05T00:43:04.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:42:00+00:00, map_index=-1, run_start_date=2024-04-05 00:43:02.705858+00:00, run_end_date=2024-04-05 00:43:03.112155+00:00, run_duration=0.406297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=597, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:43:00.678132+00:00, queued_by_job_id=1, pid=8740 2024-04-05T00:43:05.326798992Z [2024-04-05T00:43:05.326+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:43:05.327126512Z [2024-04-05T00:43:05.326+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:42:00+00:00, run_id=scheduled__2024-04-05T00:42:00+00:00, run_start_date=2024-04-05 00:43:00.616692+00:00, run_end_date=2024-04-05 00:43:05.326587+00:00, run_duration=4.709895, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:42:00+00:00, data_interval_end=2024-04-05 00:43:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:43:05.336952606Z [2024-04-05T00:43:05.336+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:43:00+00:00, run_after=2024-04-05T00:44:00+00:00 2024-04-05T00:43:05.344335383Z [2024-04-05T00:43:05.343+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:43:05.344648546Z [2024-04-05T00:43:05.344+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:42:00+00:00, run_id=scheduled__2024-04-05T00:42:00+00:00, run_start_date=2024-04-05 00:43:00.615277+00:00, run_end_date=2024-04-05 00:43:05.344210+00:00, run_duration=4.728933, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:42:00+00:00, data_interval_end=2024-04-05 00:43:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:43:05.354444826Z [2024-04-05T00:43:05.354+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:43:00+00:00, run_after=2024-04-05T00:44:00+00:00 2024-04-05T00:43:05.393625521Z [2024-04-05T00:43:05.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:42:00+00:00 exited with status success for try_number 1 2024-04-05T00:43:05.393864263Z [2024-04-05T00:43:05.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:42:00+00:00 exited with status success for try_number 1 2024-04-05T00:43:05.401439762Z [2024-04-05T00:43:05.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:42:00+00:00, map_index=-1, run_start_date=2024-04-05 00:43:03.366096+00:00, run_end_date=2024-04-05 00:43:04.712061+00:00, run_duration=1.345965, state=success, executor_state=success, try_number=1, max_tries=1, job_id=599, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:43:00.678132+00:00, queued_by_job_id=1, pid=8757 2024-04-05T00:43:05.401708954Z [2024-04-05T00:43:05.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:42:00+00:00, map_index=-1, run_start_date=2024-04-05 00:43:03.100556+00:00, run_end_date=2024-04-05 00:43:05.013967+00:00, run_duration=1.913411, state=success, executor_state=success, try_number=1, max_tries=1, job_id=598, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:43:00.678132+00:00, queued_by_job_id=1, pid=8753 2024-04-05T00:44:00.951785506Z [2024-04-05T00:44:00.950+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:44:00.967204839Z [2024-04-05T00:44:00.966+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:44:00+00:00, run_after=2024-04-05T00:45:00+00:00 2024-04-05T00:44:00.977115776Z [2024-04-05T00:44:00.976+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:44:00.999331037Z [2024-04-05T00:44:00.998+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:44:00+00:00, run_after=2024-04-05T00:45:00+00:00 2024-04-05T00:44:01.121992425Z [2024-04-05T00:44:01.121+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:44:01.122019336Z 2024-04-05T00:44:01.122023698Z 2024-04-05T00:44:01.122027026Z 2024-04-05T00:44:01.122030422Z 2024-04-05T00:44:01.122068624Z [2024-04-05T00:44:01.121+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:44:01.122275501Z [2024-04-05T00:44:01.122+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:44:01.122486507Z [2024-04-05T00:44:01.122+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:44:01.122660762Z [2024-04-05T00:44:01.122+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:44:01.123776162Z [2024-04-05T00:44:01.123+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:44:01.123790433Z 2024-04-05T00:44:01.123794337Z 2024-04-05T00:44:01.123798065Z 2024-04-05T00:44:01.123801424Z 2024-04-05T00:44:01.129534663Z [2024-04-05T00:44:01.129+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:44:01.129727620Z [2024-04-05T00:44:01.129+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:44:01.130092684Z [2024-04-05T00:44:01.129+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:44:01.130255148Z [2024-04-05T00:44:01.130+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:44:01.130594534Z [2024-04-05T00:44:01.130+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:44:01.130803361Z [2024-04-05T00:44:01.130+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:44:01.131080901Z [2024-04-05T00:44:01.130+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:44:01.131203502Z [2024-04-05T00:44:01.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:44:01.895723023Z [2024-04-05T00:44:01.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:42:00+00:00 exited with status queued for try_number 1 2024-04-05T00:44:01.895749953Z [2024-04-05T00:44:01.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:43:00+00:00 exited with status queued for try_number 1 2024-04-05T00:44:01.895754228Z [2024-04-05T00:44:01.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:43:00+00:00 exited with status queued for try_number 1 2024-04-05T00:44:01.895757743Z [2024-04-05T00:44:01.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:43:00+00:00 exited with status queued for try_number 1 2024-04-05T00:44:01.913875784Z [2024-04-05T00:44:01.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6844a939-a462-4310-81f4-311dec5ad970 2024-04-05T00:44:01.914203234Z [2024-04-05T00:44:01.913+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7b3e766-6ea4-433a-b334-a4ab874fb0ad 2024-04-05T00:44:01.914430208Z [2024-04-05T00:44:01.914+0000] {scheduler_job.py:635} INFO - Setting external_id for to df207225-019e-4d99-9170-677bef4161ee 2024-04-05T00:44:01.914689238Z [2024-04-05T00:44:01.914+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5dbd2d43-1b47-4f54-bb51-2ad2661080cb 2024-04-05T00:44:03.793553617Z [2024-04-05T00:44:03.792+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:44:03.794323468Z [2024-04-05T00:44:03.793+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:42:00+00:00, run_id=scheduled__2024-04-05T00:42:00+00:00, run_start_date=2024-04-05 00:44:01.018031+00:00, run_end_date=2024-04-05 00:44:03.793762+00:00, run_duration=2.775731, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:42:00+00:00, data_interval_end=2024-04-05 00:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:44:03.810769909Z [2024-04-05T00:44:03.810+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:44:00+00:00, run_after=2024-04-05T00:46:00+00:00 2024-04-05T00:44:03.824030541Z [2024-04-05T00:44:03.823+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:44:03.824763960Z [2024-04-05T00:44:03.824+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:43:00+00:00, run_id=scheduled__2024-04-05T00:43:00+00:00, run_start_date=2024-04-05 00:44:01.020209+00:00, run_end_date=2024-04-05 00:44:03.824177+00:00, run_duration=2.803968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:43:00+00:00, data_interval_end=2024-04-05 00:44:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:44:03.844463577Z [2024-04-05T00:44:03.843+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:44:00+00:00, run_after=2024-04-05T00:45:00+00:00 2024-04-05T00:44:03.919854815Z [2024-04-05T00:44:03.919+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:42:00+00:00 exited with status success for try_number 1 2024-04-05T00:44:03.920814822Z [2024-04-05T00:44:03.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:43:00+00:00 exited with status success for try_number 1 2024-04-05T00:44:03.930665024Z [2024-04-05T00:44:03.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:42:00+00:00, map_index=-1, run_start_date=2024-04-05 00:44:02.430625+00:00, run_end_date=2024-04-05 00:44:02.915126+00:00, run_duration=0.484501, state=success, executor_state=success, try_number=1, max_tries=1, job_id=600, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:44:01.125301+00:00, queued_by_job_id=1, pid=8790 2024-04-05T00:44:03.930850873Z [2024-04-05T00:44:03.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:43:00+00:00, map_index=-1, run_start_date=2024-04-05 00:44:02.762544+00:00, run_end_date=2024-04-05 00:44:03.451097+00:00, run_duration=0.688553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=601, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:44:01.125301+00:00, queued_by_job_id=1, pid=8793 2024-04-05T00:44:06.267151480Z [2024-04-05T00:44:06.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:44:06.267799438Z [2024-04-05T00:44:06.267+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:43:00+00:00, run_id=scheduled__2024-04-05T00:43:00+00:00, run_start_date=2024-04-05 00:44:01.022212+00:00, run_end_date=2024-04-05 00:44:06.266997+00:00, run_duration=5.244785, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:43:00+00:00, data_interval_end=2024-04-05 00:44:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:44:06.276976155Z [2024-04-05T00:44:06.276+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:44:00+00:00, run_after=2024-04-05T00:45:00+00:00 2024-04-05T00:44:06.354302082Z [2024-04-05T00:44:06.351+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:43:00+00:00 exited with status success for try_number 1 2024-04-05T00:44:06.369307690Z [2024-04-05T00:44:06.368+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:43:00+00:00, map_index=-1, run_start_date=2024-04-05 00:44:04.075977+00:00, run_end_date=2024-04-05 00:44:05.611068+00:00, run_duration=1.535091, state=success, executor_state=success, try_number=1, max_tries=1, job_id=602, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:44:01.125301+00:00, queued_by_job_id=1, pid=8814 2024-04-05T00:44:07.429821681Z [2024-04-05T00:44:07.429+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:44:07.430516525Z [2024-04-05T00:44:07.430+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:43:00+00:00, run_id=scheduled__2024-04-05T00:43:00+00:00, run_start_date=2024-04-05 00:44:01.024186+00:00, run_end_date=2024-04-05 00:44:07.429927+00:00, run_duration=6.405741, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:43:00+00:00, data_interval_end=2024-04-05 00:44:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:44:07.446147154Z [2024-04-05T00:44:07.445+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:44:00+00:00, run_after=2024-04-05T00:45:00+00:00 2024-04-05T00:44:07.494973578Z [2024-04-05T00:44:07.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:43:00+00:00 exited with status success for try_number 1 2024-04-05T00:44:07.502866725Z [2024-04-05T00:44:07.502+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:43:00+00:00, map_index=-1, run_start_date=2024-04-05 00:44:04.242841+00:00, run_end_date=2024-04-05 00:44:06.377670+00:00, run_duration=2.134829, state=success, executor_state=success, try_number=1, max_tries=1, job_id=603, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:44:01.125301+00:00, queued_by_job_id=1, pid=8815 2024-04-05T00:45:00.333049376Z [2024-04-05T00:45:00.332+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:45:00+00:00, run_after=2024-04-05T00:50:00+00:00 2024-04-05T00:45:00.353515726Z [2024-04-05T00:45:00.353+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:45:00+00:00, run_after=2024-04-05T00:46:00+00:00 2024-04-05T00:45:00.362508192Z [2024-04-05T00:45:00.362+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:45:00.376203452Z [2024-04-05T00:45:00.375+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:45:00+00:00, run_after=2024-04-05T00:46:00+00:00 2024-04-05T00:45:00.487668348Z [2024-04-05T00:45:00.487+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:45:00.487697428Z 2024-04-05T00:45:00.487703458Z 2024-04-05T00:45:00.487707645Z 2024-04-05T00:45:00.487711790Z 2024-04-05T00:45:00.487952788Z [2024-04-05T00:45:00.487+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:45:00.488177873Z [2024-04-05T00:45:00.488+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:45:00.488378399Z [2024-04-05T00:45:00.488+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:45:00.488588325Z [2024-04-05T00:45:00.488+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:45:00.489517496Z [2024-04-05T00:45:00.489+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:45:00.489531920Z 2024-04-05T00:45:00.489536536Z 2024-04-05T00:45:00.489540459Z 2024-04-05T00:45:00.489544289Z 2024-04-05T00:45:00.495360368Z [2024-04-05T00:45:00.494+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T00:45:00.495736326Z [2024-04-05T00:45:00.495+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:45:00.496212415Z [2024-04-05T00:45:00.495+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:45:00.496520958Z [2024-04-05T00:45:00.496+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:45:00.497000569Z [2024-04-05T00:45:00.496+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:45:00.497275353Z [2024-04-05T00:45:00.497+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:45:00.497734972Z [2024-04-05T00:45:00.497+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:45:00.501677524Z [2024-04-05T00:45:00.500+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:45:01.030267748Z [2024-04-05T00:45:01.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:40:00+00:00 exited with status queued for try_number 1 2024-04-05T00:45:01.036004161Z [2024-04-05T00:45:01.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:44:00+00:00 exited with status queued for try_number 1 2024-04-05T00:45:01.036169011Z [2024-04-05T00:45:01.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:44:00+00:00 exited with status queued for try_number 1 2024-04-05T00:45:01.036357551Z [2024-04-05T00:45:01.036+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:44:00+00:00 exited with status queued for try_number 1 2024-04-05T00:45:01.061595732Z [2024-04-05T00:45:01.061+0000] {scheduler_job.py:635} INFO - Setting external_id for to a5db5248-3de2-46bd-bd5e-3ff5052e333a 2024-04-05T00:45:01.061715232Z [2024-04-05T00:45:01.061+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1be01c1a-4059-463a-9d83-4b781bf2da8a 2024-04-05T00:45:01.061876658Z [2024-04-05T00:45:01.061+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4098296a-06ea-44fd-ae3d-cd933dc99375 2024-04-05T00:45:01.062028705Z [2024-04-05T00:45:01.061+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8667636-5933-4cfe-bf3c-c834d3662fd4 2024-04-05T00:45:04.267818647Z [2024-04-05T00:45:04.265+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:45:04.267868914Z [2024-04-05T00:45:04.266+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:44:00+00:00, run_id=scheduled__2024-04-05T00:44:00+00:00, run_start_date=2024-04-05 00:45:00.388841+00:00, run_end_date=2024-04-05 00:45:04.266058+00:00, run_duration=3.877217, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:44:00+00:00, data_interval_end=2024-04-05 00:45:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:45:04.282620509Z [2024-04-05T00:45:04.282+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:45:00+00:00, run_after=2024-04-05T00:46:00+00:00 2024-04-05T00:45:04.440646797Z [2024-04-05T00:45:04.440+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:44:00+00:00 exited with status success for try_number 1 2024-04-05T00:45:04.447848913Z [2024-04-05T00:45:04.447+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:44:00+00:00, map_index=-1, run_start_date=2024-04-05 00:45:02.444243+00:00, run_end_date=2024-04-05 00:45:03.255399+00:00, run_duration=0.811156, state=success, executor_state=success, try_number=1, max_tries=1, job_id=604, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:45:00.490689+00:00, queued_by_job_id=1, pid=8848 2024-04-05T00:45:05.071891288Z [2024-04-05T00:45:05.071+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:45:05.071920746Z 2024-04-05T00:45:05.072055983Z [2024-04-05T00:45:05.071+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:45:05.072784992Z [2024-04-05T00:45:05.072+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:45:05.072790276Z 2024-04-05T00:45:05.075389535Z [2024-04-05T00:45:05.075+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T00:45:05.075708596Z [2024-04-05T00:45:05.075+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:45:05.131288429Z [2024-04-05T00:45:05.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:40:00+00:00 exited with status queued for try_number 1 2024-04-05T00:45:05.131514390Z [2024-04-05T00:45:05.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:40:00+00:00 exited with status success for try_number 1 2024-04-05T00:45:05.142927888Z [2024-04-05T00:45:05.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8047f9ed-fb02-4ab6-a1e2-3fcd83083309 2024-04-05T00:45:05.143257261Z [2024-04-05T00:45:05.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T00:40:00+00:00, map_index=-1, run_start_date=2024-04-05 00:45:04.319965+00:00, run_end_date=2024-04-05 00:45:04.791024+00:00, run_duration=0.471059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=607, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:45:00.490689+00:00, queued_by_job_id=1, pid=8874 2024-04-05T00:45:06.375633478Z [2024-04-05T00:45:06.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:45:06.375665083Z [2024-04-05T00:45:06.372+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:44:00+00:00, run_id=scheduled__2024-04-05T00:44:00+00:00, run_start_date=2024-04-05 00:45:00.389930+00:00, run_end_date=2024-04-05 00:45:06.372303+00:00, run_duration=5.982373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:44:00+00:00, data_interval_end=2024-04-05 00:45:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:45:06.383662048Z [2024-04-05T00:45:06.382+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:45:00+00:00, run_after=2024-04-05T00:46:00+00:00 2024-04-05T00:45:06.395683741Z [2024-04-05T00:45:06.395+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:45:06.400443869Z [2024-04-05T00:45:06.399+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:44:00+00:00, run_id=scheduled__2024-04-05T00:44:00+00:00, run_start_date=2024-04-05 00:45:00.390935+00:00, run_end_date=2024-04-05 00:45:06.395550+00:00, run_duration=6.004615, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:44:00+00:00, data_interval_end=2024-04-05 00:45:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:45:06.411604033Z [2024-04-05T00:45:06.411+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:45:00+00:00, run_after=2024-04-05T00:46:00+00:00 2024-04-05T00:45:06.466044843Z [2024-04-05T00:45:06.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:44:00+00:00 exited with status success for try_number 1 2024-04-05T00:45:06.466269425Z [2024-04-05T00:45:06.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:44:00+00:00 exited with status success for try_number 1 2024-04-05T00:45:06.477509875Z [2024-04-05T00:45:06.476+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:44:00+00:00, map_index=-1, run_start_date=2024-04-05 00:45:03.975248+00:00, run_end_date=2024-04-05 00:45:05.750737+00:00, run_duration=1.775489, state=success, executor_state=success, try_number=1, max_tries=1, job_id=605, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:45:00.490689+00:00, queued_by_job_id=1, pid=8867 2024-04-05T00:45:06.477915636Z [2024-04-05T00:45:06.477+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:44:00+00:00, map_index=-1, run_start_date=2024-04-05 00:45:04.106977+00:00, run_end_date=2024-04-05 00:45:05.826946+00:00, run_duration=1.719969, state=success, executor_state=success, try_number=1, max_tries=1, job_id=606, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:45:00.490689+00:00, queued_by_job_id=1, pid=8873 2024-04-05T00:45:07.544773143Z [2024-04-05T00:45:07.544+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:45:07.544807810Z 2024-04-05T00:45:07.545162674Z [2024-04-05T00:45:07.544+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:45:07.546300972Z [2024-04-05T00:45:07.545+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:45:07.546326951Z 2024-04-05T00:45:07.550438952Z [2024-04-05T00:45:07.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T00:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T00:45:07.551625566Z [2024-04-05T00:45:07.551+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T00:45:07.629934369Z [2024-04-05T00:45:07.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:40:00+00:00 exited with status queued for try_number 1 2024-04-05T00:45:07.630089562Z [2024-04-05T00:45:07.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:40:00+00:00 exited with status success for try_number 1 2024-04-05T00:45:07.639213117Z [2024-04-05T00:45:07.638+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07cbbb8f-684b-47af-adc1-9243f83a1eb2 2024-04-05T00:45:07.639651713Z [2024-04-05T00:45:07.639+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T00:40:00+00:00, map_index=-1, run_start_date=2024-04-05 00:45:06.836922+00:00, run_end_date=2024-04-05 00:45:07.187101+00:00, run_duration=0.350179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=608, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:45:05.073239+00:00, queued_by_job_id=1, pid=8897 2024-04-05T00:45:09.911787344Z [2024-04-05T00:45:09.911+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:45:09.911866418Z 2024-04-05T00:45:09.911933012Z [2024-04-05T00:45:09.911+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:45:09.912582255Z [2024-04-05T00:45:09.912+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:45:09.912612641Z 2024-04-05T00:45:09.915499676Z [2024-04-05T00:45:09.915+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T00:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:45:09.915778522Z [2024-04-05T00:45:09.915+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:45:10.005394050Z [2024-04-05T00:45:10.004+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:40:00+00:00 exited with status queued for try_number 1 2024-04-05T00:45:10.005466263Z [2024-04-05T00:45:10.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:40:00+00:00 exited with status success for try_number 1 2024-04-05T00:45:10.014033716Z [2024-04-05T00:45:10.013+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1412f535-a690-491e-b421-c73b119c09ca 2024-04-05T00:45:10.014141903Z [2024-04-05T00:45:10.013+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T00:40:00+00:00, map_index=0, run_start_date=2024-04-05 00:45:09.228021+00:00, run_end_date=2024-04-05 00:45:09.602279+00:00, run_duration=0.374258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=609, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:45:07.547001+00:00, queued_by_job_id=1, pid=8905 2024-04-05T00:45:12.371053480Z [2024-04-05T00:45:12.370+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:45:12.371228564Z [2024-04-05T00:45:12.371+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:40:00+00:00, run_id=scheduled__2024-04-05T00:40:00+00:00, run_start_date=2024-04-05 00:45:00.387407+00:00, run_end_date=2024-04-05 00:45:12.370943+00:00, run_duration=11.983536, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:40:00+00:00, data_interval_end=2024-04-05 00:45:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T00:45:12.377884103Z [2024-04-05T00:45:12.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:45:00+00:00, run_after=2024-04-05T00:50:00+00:00 2024-04-05T00:45:12.415329421Z [2024-04-05T00:45:12.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:40:00+00:00 exited with status success for try_number 1 2024-04-05T00:45:12.421516208Z [2024-04-05T00:45:12.421+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T00:40:00+00:00, map_index=-1, run_start_date=2024-04-05 00:45:11.751608+00:00, run_end_date=2024-04-05 00:45:12.137390+00:00, run_duration=0.385782, state=success, executor_state=success, try_number=1, max_tries=1, job_id=610, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:45:09.913126+00:00, queued_by_job_id=1, pid=8926 2024-04-05T00:45:40.656415700Z [2024-04-05T00:45:40.656+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T00:46:00.081912488Z [2024-04-05T00:46:00.081+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:46:00+00:00, run_after=2024-04-05T00:47:00+00:00 2024-04-05T00:46:00.088888868Z [2024-04-05T00:46:00.088+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:46:00.100377142Z [2024-04-05T00:46:00.100+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:46:00+00:00, run_after=2024-04-05T00:47:00+00:00 2024-04-05T00:46:00.107454575Z [2024-04-05T00:46:00.107+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:46:00.198448489Z [2024-04-05T00:46:00.197+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:46:00.198479591Z 2024-04-05T00:46:00.198486599Z 2024-04-05T00:46:00.198491358Z 2024-04-05T00:46:00.198496393Z 2024-04-05T00:46:00.198501960Z [2024-04-05T00:46:00.198+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:46:00.198583267Z [2024-04-05T00:46:00.198+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:46:00.198763770Z [2024-04-05T00:46:00.198+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:46:00.198915846Z [2024-04-05T00:46:00.198+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:46:00.199680847Z [2024-04-05T00:46:00.199+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:46:00.199696646Z 2024-04-05T00:46:00.199702221Z 2024-04-05T00:46:00.199722242Z 2024-04-05T00:46:00.199725527Z 2024-04-05T00:46:00.203652344Z [2024-04-05T00:46:00.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:46:00.203807048Z [2024-04-05T00:46:00.203+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:46:00.204054932Z [2024-04-05T00:46:00.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:46:00.204191187Z [2024-04-05T00:46:00.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:46:00.204411146Z [2024-04-05T00:46:00.204+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:46:00.204586226Z [2024-04-05T00:46:00.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:46:00.204842869Z [2024-04-05T00:46:00.204+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:46:00.204958800Z [2024-04-05T00:46:00.204+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:46:00.763784502Z [2024-04-05T00:46:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:44:00+00:00 exited with status queued for try_number 1 2024-04-05T00:46:00.763964866Z [2024-04-05T00:46:00.763+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:45:00+00:00 exited with status queued for try_number 1 2024-04-05T00:46:00.764127758Z [2024-04-05T00:46:00.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:45:00+00:00 exited with status queued for try_number 1 2024-04-05T00:46:00.764342565Z [2024-04-05T00:46:00.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:45:00+00:00 exited with status queued for try_number 1 2024-04-05T00:46:00.774994558Z [2024-04-05T00:46:00.774+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9a8950b4-27c6-4029-98b0-784e19f92e37 2024-04-05T00:46:00.775377703Z [2024-04-05T00:46:00.775+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b719a9d-985d-4cae-b101-e3d9081a7b34 2024-04-05T00:46:00.775713518Z [2024-04-05T00:46:00.775+0000] {scheduler_job.py:635} INFO - Setting external_id for to d030cfcd-a61b-448e-9b44-576153d9ed76 2024-04-05T00:46:00.775986850Z [2024-04-05T00:46:00.775+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5281103c-e9a9-4b1d-9398-8c0970de0a1c 2024-04-05T00:46:02.986638676Z [2024-04-05T00:46:02.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:46:02.987332580Z [2024-04-05T00:46:02.986+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:45:00+00:00, run_id=scheduled__2024-04-05T00:45:00+00:00, run_start_date=2024-04-05 00:46:00.122272+00:00, run_end_date=2024-04-05 00:46:02.986692+00:00, run_duration=2.86442, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:45:00+00:00, data_interval_end=2024-04-05 00:46:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:46:03.017289585Z [2024-04-05T00:46:03.016+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:46:00+00:00, run_after=2024-04-05T00:47:00+00:00 2024-04-05T00:46:03.089948938Z [2024-04-05T00:46:03.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:44:00+00:00 exited with status success for try_number 1 2024-04-05T00:46:03.093064613Z [2024-04-05T00:46:03.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:45:00+00:00 exited with status success for try_number 1 2024-04-05T00:46:03.104303232Z [2024-04-05T00:46:03.103+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:44:00+00:00, map_index=-1, run_start_date=2024-04-05 00:46:02.469310+00:00, run_end_date=2024-04-05 00:46:02.881483+00:00, run_duration=0.412173, state=success, executor_state=success, try_number=1, max_tries=1, job_id=612, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:46:00.200663+00:00, queued_by_job_id=1, pid=8944 2024-04-05T00:46:03.104710518Z [2024-04-05T00:46:03.104+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:45:00+00:00, map_index=-1, run_start_date=2024-04-05 00:46:01.827048+00:00, run_end_date=2024-04-05 00:46:02.341786+00:00, run_duration=0.514738, state=success, executor_state=success, try_number=1, max_tries=1, job_id=611, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:46:00.200663+00:00, queued_by_job_id=1, pid=8936 2024-04-05T00:46:03.405528743Z [2024-04-05T00:46:03.405+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:46:03.405662760Z [2024-04-05T00:46:03.405+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:44:00+00:00, run_id=scheduled__2024-04-05T00:44:00+00:00, run_start_date=2024-04-05 00:46:00.121051+00:00, run_end_date=2024-04-05 00:46:03.405391+00:00, run_duration=3.28434, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:44:00+00:00, data_interval_end=2024-04-05 00:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:46:03.415907626Z [2024-04-05T00:46:03.415+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:46:00+00:00, run_after=2024-04-05T00:48:00+00:00 2024-04-05T00:46:05.610681340Z [2024-04-05T00:46:05.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:46:05.610834413Z [2024-04-05T00:46:05.610+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:45:00+00:00, run_id=scheduled__2024-04-05T00:45:00+00:00, run_start_date=2024-04-05 00:46:00.124333+00:00, run_end_date=2024-04-05 00:46:05.610587+00:00, run_duration=5.486254, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:45:00+00:00, data_interval_end=2024-04-05 00:46:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:46:05.619839203Z [2024-04-05T00:46:05.619+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:46:00+00:00, run_after=2024-04-05T00:47:00+00:00 2024-04-05T00:46:05.626189195Z [2024-04-05T00:46:05.625+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:46:05.626361367Z [2024-04-05T00:46:05.626+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:45:00+00:00, run_id=scheduled__2024-04-05T00:45:00+00:00, run_start_date=2024-04-05 00:46:00.123297+00:00, run_end_date=2024-04-05 00:46:05.626062+00:00, run_duration=5.502765, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:45:00+00:00, data_interval_end=2024-04-05 00:46:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:46:05.637320377Z [2024-04-05T00:46:05.636+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:46:00+00:00, run_after=2024-04-05T00:47:00+00:00 2024-04-05T00:46:05.665726332Z [2024-04-05T00:46:05.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:45:00+00:00 exited with status success for try_number 1 2024-04-05T00:46:05.665756223Z [2024-04-05T00:46:05.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:45:00+00:00 exited with status success for try_number 1 2024-04-05T00:46:05.671617238Z [2024-04-05T00:46:05.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:45:00+00:00, map_index=-1, run_start_date=2024-04-05 00:46:03.326417+00:00, run_end_date=2024-04-05 00:46:04.639545+00:00, run_duration=1.313128, state=success, executor_state=success, try_number=1, max_tries=1, job_id=614, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:46:00.200663+00:00, queued_by_job_id=1, pid=8961 2024-04-05T00:46:05.671756677Z [2024-04-05T00:46:05.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:45:00+00:00, map_index=-1, run_start_date=2024-04-05 00:46:03.200326+00:00, run_end_date=2024-04-05 00:46:05.113268+00:00, run_duration=1.912942, state=success, executor_state=success, try_number=1, max_tries=1, job_id=613, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:46:00.200663+00:00, queued_by_job_id=1, pid=8960 2024-04-05T00:47:00.851781344Z [2024-04-05T00:47:00.851+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:47:00.865567483Z [2024-04-05T00:47:00.865+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:47:00+00:00, run_after=2024-04-05T00:48:00+00:00 2024-04-05T00:47:00.894117726Z [2024-04-05T00:47:00.893+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:47:00+00:00, run_after=2024-04-05T00:48:00+00:00 2024-04-05T00:47:00.993956473Z [2024-04-05T00:47:00.993+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:47:00.993983946Z 2024-04-05T00:47:00.993987571Z 2024-04-05T00:47:00.993991104Z 2024-04-05T00:47:00.994035669Z [2024-04-05T00:47:00.993+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:47:00.994185689Z [2024-04-05T00:47:00.994+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:47:00.994315340Z [2024-04-05T00:47:00.994+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:47:00.994909326Z [2024-04-05T00:47:00.994+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:47:00.994916635Z 2024-04-05T00:47:00.994920015Z 2024-04-05T00:47:00.994923138Z 2024-04-05T00:47:00.998321428Z [2024-04-05T00:47:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:47:00.998461979Z [2024-04-05T00:47:00.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:47:00.998743898Z [2024-04-05T00:47:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:47:00.998883826Z [2024-04-05T00:47:00.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:47:00.999112464Z [2024-04-05T00:47:00.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:47:00.999234295Z [2024-04-05T00:47:00.999+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:47:01.669326449Z [2024-04-05T00:47:01.668+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:46:00+00:00 exited with status queued for try_number 1 2024-04-05T00:47:01.671985758Z [2024-04-05T00:47:01.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:46:00+00:00 exited with status queued for try_number 1 2024-04-05T00:47:01.672016200Z [2024-04-05T00:47:01.671+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:46:00+00:00 exited with status queued for try_number 1 2024-04-05T00:47:01.700225998Z [2024-04-05T00:47:01.699+0000] {scheduler_job.py:635} INFO - Setting external_id for to a198e2c0-18e2-4e98-8ee7-2efe37f54301 2024-04-05T00:47:01.700275452Z [2024-04-05T00:47:01.700+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3fb18ec2-cd5c-4a69-982c-93a5774714fa 2024-04-05T00:47:01.700404910Z [2024-04-05T00:47:01.700+0000] {scheduler_job.py:635} INFO - Setting external_id for to 00a2b543-35a7-4570-a8d0-ed1d55b83abf 2024-04-05T00:47:03.558771493Z [2024-04-05T00:47:03.558+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:47:03.559665938Z [2024-04-05T00:47:03.559+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:46:00+00:00, run_id=scheduled__2024-04-05T00:46:00+00:00, run_start_date=2024-04-05 00:47:00.914248+00:00, run_end_date=2024-04-05 00:47:03.559158+00:00, run_duration=2.64491, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:46:00+00:00, data_interval_end=2024-04-05 00:47:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:47:03.571466867Z [2024-04-05T00:47:03.571+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:47:00+00:00, run_after=2024-04-05T00:48:00+00:00 2024-04-05T00:47:03.623409786Z [2024-04-05T00:47:03.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:46:00+00:00 exited with status success for try_number 1 2024-04-05T00:47:03.631293903Z [2024-04-05T00:47:03.630+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:46:00+00:00, map_index=-1, run_start_date=2024-04-05 00:47:02.908256+00:00, run_end_date=2024-04-05 00:47:03.311530+00:00, run_duration=0.403274, state=success, executor_state=success, try_number=1, max_tries=1, job_id=615, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:47:00.995659+00:00, queued_by_job_id=1, pid=8994 2024-04-05T00:47:05.932508627Z [2024-04-05T00:47:05.932+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:47:05.932697144Z [2024-04-05T00:47:05.932+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:46:00+00:00, run_id=scheduled__2024-04-05T00:46:00+00:00, run_start_date=2024-04-05 00:47:00.925568+00:00, run_end_date=2024-04-05 00:47:05.932394+00:00, run_duration=5.006826, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:46:00+00:00, data_interval_end=2024-04-05 00:47:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:47:05.942819881Z [2024-04-05T00:47:05.942+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:47:00+00:00, run_after=2024-04-05T00:48:00+00:00 2024-04-05T00:47:05.950015262Z [2024-04-05T00:47:05.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:47:05.950170945Z [2024-04-05T00:47:05.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:46:00+00:00, run_id=scheduled__2024-04-05T00:46:00+00:00, run_start_date=2024-04-05 00:47:00.924015+00:00, run_end_date=2024-04-05 00:47:05.949881+00:00, run_duration=5.025866, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:46:00+00:00, data_interval_end=2024-04-05 00:47:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:47:05.962330460Z [2024-04-05T00:47:05.961+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:47:00+00:00, run_after=2024-04-05T00:48:00+00:00 2024-04-05T00:47:05.996395901Z [2024-04-05T00:47:05.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:46:00+00:00 exited with status success for try_number 1 2024-04-05T00:47:05.996464420Z [2024-04-05T00:47:05.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:46:00+00:00 exited with status success for try_number 1 2024-04-05T00:47:06.005831210Z [2024-04-05T00:47:06.005+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:46:00+00:00, map_index=-1, run_start_date=2024-04-05 00:47:03.610003+00:00, run_end_date=2024-04-05 00:47:05.235511+00:00, run_duration=1.625508, state=success, executor_state=success, try_number=1, max_tries=1, job_id=616, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:47:00.995659+00:00, queued_by_job_id=1, pid=9006 2024-04-05T00:47:06.005962066Z [2024-04-05T00:47:06.005+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:46:00+00:00, map_index=-1, run_start_date=2024-04-05 00:47:04.172929+00:00, run_end_date=2024-04-05 00:47:05.634707+00:00, run_duration=1.461778, state=success, executor_state=success, try_number=1, max_tries=1, job_id=617, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:47:00.995659+00:00, queued_by_job_id=1, pid=9017 2024-04-05T00:48:00.633657652Z [2024-04-05T00:48:00.633+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:48:00+00:00, run_after=2024-04-05T00:49:00+00:00 2024-04-05T00:48:00.641798761Z [2024-04-05T00:48:00.641+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:48:00.653843629Z [2024-04-05T00:48:00.653+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:48:00+00:00, run_after=2024-04-05T00:49:00+00:00 2024-04-05T00:48:00.666463309Z [2024-04-05T00:48:00.666+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:48:00.739044885Z [2024-04-05T00:48:00.738+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:48:00.739088982Z 2024-04-05T00:48:00.739095744Z 2024-04-05T00:48:00.739101148Z 2024-04-05T00:48:00.739106682Z 2024-04-05T00:48:00.739147561Z [2024-04-05T00:48:00.738+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:48:00.739451418Z [2024-04-05T00:48:00.739+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:48:00.739709864Z [2024-04-05T00:48:00.739+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:48:00.739788936Z [2024-04-05T00:48:00.739+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:48:00.740447423Z [2024-04-05T00:48:00.740+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:48:00.740460076Z 2024-04-05T00:48:00.740465658Z 2024-04-05T00:48:00.740470833Z 2024-04-05T00:48:00.740476119Z 2024-04-05T00:48:00.744645742Z [2024-04-05T00:48:00.744+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:48:00.744802200Z [2024-04-05T00:48:00.744+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:48:00.745181838Z [2024-04-05T00:48:00.745+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:48:00.745319645Z [2024-04-05T00:48:00.745+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:48:00.745534892Z [2024-04-05T00:48:00.745+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:48:00.745663515Z [2024-04-05T00:48:00.745+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:48:00.746020918Z [2024-04-05T00:48:00.745+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:48:00.746195789Z [2024-04-05T00:48:00.746+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:48:01.171696159Z [2024-04-05T00:48:01.170+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:46:00+00:00 exited with status queued for try_number 1 2024-04-05T00:48:01.171743618Z [2024-04-05T00:48:01.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:47:00+00:00 exited with status queued for try_number 1 2024-04-05T00:48:01.171747711Z [2024-04-05T00:48:01.171+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:47:00+00:00 exited with status queued for try_number 1 2024-04-05T00:48:01.173658186Z [2024-04-05T00:48:01.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:47:00+00:00 exited with status queued for try_number 1 2024-04-05T00:48:01.204914830Z [2024-04-05T00:48:01.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30fc8330-b57a-4524-b812-591b967267b4 2024-04-05T00:48:01.204945120Z [2024-04-05T00:48:01.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ae365e3-ff41-4953-aad8-ab92d4f1aef5 2024-04-05T00:48:01.204949344Z [2024-04-05T00:48:01.201+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa01f4c5-2d65-46fb-abf2-2feb87225b27 2024-04-05T00:48:01.204954303Z [2024-04-05T00:48:01.201+0000] {scheduler_job.py:635} INFO - Setting external_id for to 93ed59eb-2c4e-4d9a-9f51-293b3cb245b7 2024-04-05T00:48:02.693708501Z [2024-04-05T00:48:02.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:47:00+00:00 exited with status success for try_number 1 2024-04-05T00:48:02.702715783Z [2024-04-05T00:48:02.702+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:47:00+00:00, map_index=-1, run_start_date=2024-04-05 00:48:01.973787+00:00, run_end_date=2024-04-05 00:48:02.475621+00:00, run_duration=0.501834, state=success, executor_state=success, try_number=1, max_tries=1, job_id=618, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:48:00.741845+00:00, queued_by_job_id=1, pid=9045 2024-04-05T00:48:02.856793750Z [2024-04-05T00:48:02.856+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:48:02.857609898Z [2024-04-05T00:48:02.857+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:47:00+00:00, run_id=scheduled__2024-04-05T00:47:00+00:00, run_start_date=2024-04-05 00:48:00.680271+00:00, run_end_date=2024-04-05 00:48:02.857012+00:00, run_duration=2.176741, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:47:00+00:00, data_interval_end=2024-04-05 00:48:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:48:02.875237751Z [2024-04-05T00:48:02.874+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:48:00+00:00, run_after=2024-04-05T00:49:00+00:00 2024-04-05T00:48:03.926922643Z [2024-04-05T00:48:03.926+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:48:03.927383013Z [2024-04-05T00:48:03.927+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:46:00+00:00, run_id=scheduled__2024-04-05T00:46:00+00:00, run_start_date=2024-04-05 00:48:00.678886+00:00, run_end_date=2024-04-05 00:48:03.926823+00:00, run_duration=3.247937, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:46:00+00:00, data_interval_end=2024-04-05 00:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:48:03.936458823Z [2024-04-05T00:48:03.936+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:48:00+00:00, run_after=2024-04-05T00:50:00+00:00 2024-04-05T00:48:04.005814143Z [2024-04-05T00:48:04.005+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:46:00+00:00 exited with status success for try_number 1 2024-04-05T00:48:04.012912912Z [2024-04-05T00:48:04.012+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:46:00+00:00, map_index=-1, run_start_date=2024-04-05 00:48:02.528202+00:00, run_end_date=2024-04-05 00:48:02.958480+00:00, run_duration=0.430278, state=success, executor_state=success, try_number=1, max_tries=1, job_id=619, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:48:00.741845+00:00, queued_by_job_id=1, pid=9051 2024-04-05T00:48:06.142043825Z [2024-04-05T00:48:06.141+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:48:06.142244251Z [2024-04-05T00:48:06.142+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:47:00+00:00, run_id=scheduled__2024-04-05T00:47:00+00:00, run_start_date=2024-04-05 00:48:00.681389+00:00, run_end_date=2024-04-05 00:48:06.141962+00:00, run_duration=5.460573, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:47:00+00:00, data_interval_end=2024-04-05 00:48:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:48:06.152396974Z [2024-04-05T00:48:06.152+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:48:00+00:00, run_after=2024-04-05T00:49:00+00:00 2024-04-05T00:48:06.164037507Z [2024-04-05T00:48:06.163+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:48:06.164192273Z [2024-04-05T00:48:06.164+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:47:00+00:00, run_id=scheduled__2024-04-05T00:47:00+00:00, run_start_date=2024-04-05 00:48:00.682424+00:00, run_end_date=2024-04-05 00:48:06.163929+00:00, run_duration=5.481505, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:47:00+00:00, data_interval_end=2024-04-05 00:48:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:48:06.174000136Z [2024-04-05T00:48:06.173+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:48:00+00:00, run_after=2024-04-05T00:49:00+00:00 2024-04-05T00:48:06.215115173Z [2024-04-05T00:48:06.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:47:00+00:00 exited with status success for try_number 1 2024-04-05T00:48:06.215664006Z [2024-04-05T00:48:06.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:47:00+00:00 exited with status success for try_number 1 2024-04-05T00:48:06.227090248Z [2024-04-05T00:48:06.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:47:00+00:00, map_index=-1, run_start_date=2024-04-05 00:48:03.788540+00:00, run_end_date=2024-04-05 00:48:05.338516+00:00, run_duration=1.549976, state=success, executor_state=success, try_number=1, max_tries=1, job_id=621, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:48:00.741845+00:00, queued_by_job_id=1, pid=9070 2024-04-05T00:48:06.227344714Z [2024-04-05T00:48:06.227+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:47:00+00:00, map_index=-1, run_start_date=2024-04-05 00:48:03.526254+00:00, run_end_date=2024-04-05 00:48:05.880033+00:00, run_duration=2.353779, state=success, executor_state=success, try_number=1, max_tries=1, job_id=620, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:48:00.741845+00:00, queued_by_job_id=1, pid=9069 2024-04-05T00:49:00.504516758Z [2024-04-05T00:49:00.502+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:49:00+00:00, run_after=2024-04-05T00:50:00+00:00 2024-04-05T00:49:00.519622657Z [2024-04-05T00:49:00.519+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:49:00.538509472Z [2024-04-05T00:49:00.538+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:49:00+00:00, run_after=2024-04-05T00:50:00+00:00 2024-04-05T00:49:00.652318588Z [2024-04-05T00:49:00.651+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:49:00.652347882Z 2024-04-05T00:49:00.652351547Z 2024-04-05T00:49:00.652354804Z 2024-04-05T00:49:00.652371078Z [2024-04-05T00:49:00.652+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:49:00.652594914Z [2024-04-05T00:49:00.652+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:49:00.652683710Z [2024-04-05T00:49:00.652+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:49:00.653615281Z [2024-04-05T00:49:00.653+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:49:00.653696121Z 2024-04-05T00:49:00.653706244Z 2024-04-05T00:49:00.653715110Z 2024-04-05T00:49:00.660029213Z [2024-04-05T00:49:00.659+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:49:00.660117311Z [2024-04-05T00:49:00.659+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:49:00.660362280Z [2024-04-05T00:49:00.660+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:49:00.660471218Z [2024-04-05T00:49:00.660+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:49:00.660713748Z [2024-04-05T00:49:00.660+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:49:00.660881963Z [2024-04-05T00:49:00.660+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:49:01.207742125Z [2024-04-05T00:49:01.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:48:00+00:00 exited with status queued for try_number 1 2024-04-05T00:49:01.207775125Z [2024-04-05T00:49:01.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:48:00+00:00 exited with status queued for try_number 1 2024-04-05T00:49:01.211700344Z [2024-04-05T00:49:01.207+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:48:00+00:00 exited with status queued for try_number 1 2024-04-05T00:49:01.241097794Z [2024-04-05T00:49:01.240+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0473b079-8382-4c9e-a4ad-e7e703acf8d5 2024-04-05T00:49:01.241121069Z [2024-04-05T00:49:01.240+0000] {scheduler_job.py:635} INFO - Setting external_id for to 291cc238-7639-40a9-9aab-f1e96cc9c0ac 2024-04-05T00:49:01.241136737Z [2024-04-05T00:49:01.240+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78a6d25c-c9b5-4242-b0e3-0aa9aa632e26 2024-04-05T00:49:02.564153926Z [2024-04-05T00:49:02.563+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:49:02.564650928Z [2024-04-05T00:49:02.564+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:48:00+00:00, run_id=scheduled__2024-04-05T00:48:00+00:00, run_start_date=2024-04-05 00:49:00.555528+00:00, run_end_date=2024-04-05 00:49:02.564141+00:00, run_duration=2.008613, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:48:00+00:00, data_interval_end=2024-04-05 00:49:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:49:02.577981424Z [2024-04-05T00:49:02.577+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:49:00+00:00, run_after=2024-04-05T00:50:00+00:00 2024-04-05T00:49:02.700527395Z [2024-04-05T00:49:02.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:48:00+00:00 exited with status success for try_number 1 2024-04-05T00:49:02.707112740Z [2024-04-05T00:49:02.706+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:48:00+00:00, map_index=-1, run_start_date=2024-04-05 00:49:01.685033+00:00, run_end_date=2024-04-05 00:49:02.174338+00:00, run_duration=0.489305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=622, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:49:00.654653+00:00, queued_by_job_id=1, pid=9101 2024-04-05T00:49:05.317449533Z [2024-04-05T00:49:05.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:49:05.317736766Z [2024-04-05T00:49:05.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:48:00+00:00, run_id=scheduled__2024-04-05T00:48:00+00:00, run_start_date=2024-04-05 00:49:00.558627+00:00, run_end_date=2024-04-05 00:49:05.317353+00:00, run_duration=4.758726, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:48:00+00:00, data_interval_end=2024-04-05 00:49:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:49:05.338037530Z [2024-04-05T00:49:05.337+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:49:00+00:00, run_after=2024-04-05T00:50:00+00:00 2024-04-05T00:49:06.438681659Z [2024-04-05T00:49:06.438+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:49:06.439096207Z [2024-04-05T00:49:06.438+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:48:00+00:00, run_id=scheduled__2024-04-05T00:48:00+00:00, run_start_date=2024-04-05 00:49:00.560693+00:00, run_end_date=2024-04-05 00:49:06.438737+00:00, run_duration=5.878044, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:48:00+00:00, data_interval_end=2024-04-05 00:49:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:49:06.456375936Z [2024-04-05T00:49:06.455+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:49:00+00:00, run_after=2024-04-05T00:50:00+00:00 2024-04-05T00:49:06.490709978Z [2024-04-05T00:49:06.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:48:00+00:00 exited with status success for try_number 1 2024-04-05T00:49:06.490954338Z [2024-04-05T00:49:06.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:48:00+00:00 exited with status success for try_number 1 2024-04-05T00:49:06.501453957Z [2024-04-05T00:49:06.500+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:48:00+00:00, map_index=-1, run_start_date=2024-04-05 00:49:02.963388+00:00, run_end_date=2024-04-05 00:49:05.580967+00:00, run_duration=2.617579, state=success, executor_state=success, try_number=1, max_tries=1, job_id=623, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:49:00.654653+00:00, queued_by_job_id=1, pid=9119 2024-04-05T00:49:06.501704135Z [2024-04-05T00:49:06.501+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:48:00+00:00, map_index=-1, run_start_date=2024-04-05 00:49:03.136166+00:00, run_end_date=2024-04-05 00:49:05.270012+00:00, run_duration=2.133846, state=success, executor_state=success, try_number=1, max_tries=1, job_id=624, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:49:00.654653+00:00, queued_by_job_id=1, pid=9120 2024-04-05T00:50:00.252840866Z [2024-04-05T00:50:00.252+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:50:00.264608772Z [2024-04-05T00:50:00.264+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:50:00+00:00, run_after=2024-04-05T00:55:00+00:00 2024-04-05T00:50:00.280897051Z [2024-04-05T00:50:00.280+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:50:00+00:00, run_after=2024-04-05T00:51:00+00:00 2024-04-05T00:50:00.287985128Z [2024-04-05T00:50:00.287+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:50:00.300151706Z [2024-04-05T00:50:00.299+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:50:00+00:00, run_after=2024-04-05T00:51:00+00:00 2024-04-05T00:50:00.431291695Z [2024-04-05T00:50:00.430+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T00:50:00.431319630Z 2024-04-05T00:50:00.431337274Z 2024-04-05T00:50:00.431341224Z 2024-04-05T00:50:00.431344308Z 2024-04-05T00:50:00.431347375Z 2024-04-05T00:50:00.431513207Z [2024-04-05T00:50:00.431+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:50:00.431996435Z [2024-04-05T00:50:00.431+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:50:00.432186440Z [2024-04-05T00:50:00.432+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:50:00.432426430Z [2024-04-05T00:50:00.432+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:50:00.432633141Z [2024-04-05T00:50:00.432+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:50:00.433486984Z [2024-04-05T00:50:00.433+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:50:00.433499774Z 2024-04-05T00:50:00.433507733Z 2024-04-05T00:50:00.433511922Z 2024-04-05T00:50:00.433519511Z 2024-04-05T00:50:00.433522714Z 2024-04-05T00:50:00.438051562Z [2024-04-05T00:50:00.437+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T00:50:00.438263138Z [2024-04-05T00:50:00.437+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:50:00.438605913Z [2024-04-05T00:50:00.438+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:50:00.438814662Z [2024-04-05T00:50:00.438+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:50:00.439159423Z [2024-04-05T00:50:00.439+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:50:00.439392637Z [2024-04-05T00:50:00.439+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:50:00.439883327Z [2024-04-05T00:50:00.439+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:50:00.440179843Z [2024-04-05T00:50:00.439+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:50:00.440595805Z [2024-04-05T00:50:00.440+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:50:00.440817199Z [2024-04-05T00:50:00.440+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:50:00.814157914Z [2024-04-05T00:50:00.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:45:00+00:00 exited with status queued for try_number 1 2024-04-05T00:50:00.814186094Z [2024-04-05T00:50:00.814+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:48:00+00:00 exited with status queued for try_number 1 2024-04-05T00:50:00.834966947Z [2024-04-05T00:50:00.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:49:00+00:00 exited with status queued for try_number 1 2024-04-05T00:50:00.835009910Z [2024-04-05T00:50:00.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:49:00+00:00 exited with status queued for try_number 1 2024-04-05T00:50:00.835057311Z [2024-04-05T00:50:00.834+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:49:00+00:00 exited with status queued for try_number 1 2024-04-05T00:50:00.853760720Z [2024-04-05T00:50:00.853+0000] {scheduler_job.py:635} INFO - Setting external_id for to 083da1f4-6beb-4183-9719-48977fe70e44 2024-04-05T00:50:00.853812259Z [2024-04-05T00:50:00.853+0000] {scheduler_job.py:635} INFO - Setting external_id for to 26a339ef-1feb-4377-94dd-f48d07737f20 2024-04-05T00:50:00.853923081Z [2024-04-05T00:50:00.853+0000] {scheduler_job.py:635} INFO - Setting external_id for to 153c34e5-fcb0-4e09-bd4b-3963e8f815d2 2024-04-05T00:50:00.854039227Z [2024-04-05T00:50:00.853+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a46e460-008c-48d8-8e80-bb4a0c16c62f 2024-04-05T00:50:00.854107652Z [2024-04-05T00:50:00.854+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5921e50-66e8-4868-86f9-adb20216bca0 2024-04-05T00:50:03.383424742Z [2024-04-05T00:50:03.382+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:50:03.388018747Z [2024-04-05T00:50:03.383+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:48:00+00:00, run_id=scheduled__2024-04-05T00:48:00+00:00, run_start_date=2024-04-05 00:50:00.312956+00:00, run_end_date=2024-04-05 00:50:03.383296+00:00, run_duration=3.07034, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:48:00+00:00, data_interval_end=2024-04-05 00:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:50:03.407436489Z [2024-04-05T00:50:03.407+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:50:00+00:00, run_after=2024-04-05T00:52:00+00:00 2024-04-05T00:50:03.418535375Z [2024-04-05T00:50:03.418+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:50:03.419003456Z [2024-04-05T00:50:03.418+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:49:00+00:00, run_id=scheduled__2024-04-05T00:49:00+00:00, run_start_date=2024-04-05 00:50:00.314124+00:00, run_end_date=2024-04-05 00:50:03.418399+00:00, run_duration=3.104275, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:49:00+00:00, data_interval_end=2024-04-05 00:50:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:50:03.438245893Z [2024-04-05T00:50:03.437+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:50:00+00:00, run_after=2024-04-05T00:51:00+00:00 2024-04-05T00:50:03.533332553Z [2024-04-05T00:50:03.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:49:00+00:00 exited with status success for try_number 1 2024-04-05T00:50:03.548621354Z [2024-04-05T00:50:03.548+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:49:00+00:00, map_index=-1, run_start_date=2024-04-05 00:50:02.141293+00:00, run_end_date=2024-04-05 00:50:02.947330+00:00, run_duration=0.806037, state=success, executor_state=success, try_number=1, max_tries=1, job_id=625, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:50:00.434599+00:00, queued_by_job_id=1, pid=9155 2024-04-05T00:50:03.830948138Z [2024-04-05T00:50:03.830+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:50:03.830979203Z 2024-04-05T00:50:03.831051606Z [2024-04-05T00:50:03.830+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:50:03.832705143Z [2024-04-05T00:50:03.832+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:50:03.832727732Z 2024-04-05T00:50:03.836931396Z [2024-04-05T00:50:03.836+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T00:50:03.837393212Z [2024-04-05T00:50:03.836+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:50:03.931540850Z [2024-04-05T00:50:03.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:45:00+00:00 exited with status queued for try_number 1 2024-04-05T00:50:03.932786434Z [2024-04-05T00:50:03.931+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:48:00+00:00 exited with status success for try_number 1 2024-04-05T00:50:03.949648836Z [2024-04-05T00:50:03.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8514ec34-f4f0-4a38-a2f8-2410773bb270 2024-04-05T00:50:03.949914952Z [2024-04-05T00:50:03.949+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:48:00+00:00, map_index=-1, run_start_date=2024-04-05 00:50:02.590196+00:00, run_end_date=2024-04-05 00:50:03.247880+00:00, run_duration=0.657684, state=success, executor_state=success, try_number=1, max_tries=1, job_id=626, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:50:00.434599+00:00, queued_by_job_id=1, pid=9157 2024-04-05T00:50:04.150277680Z [2024-04-05T00:50:04.146+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:45:00+00:00 exited with status success for try_number 1 2024-04-05T00:50:04.159157891Z [2024-04-05T00:50:04.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T00:45:00+00:00, map_index=-1, run_start_date=2024-04-05 00:50:03.271057+00:00, run_end_date=2024-04-05 00:50:03.731076+00:00, run_duration=0.460019, state=success, executor_state=success, try_number=1, max_tries=1, job_id=627, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:50:00.434599+00:00, queued_by_job_id=1, pid=9174 2024-04-05T00:50:05.642538250Z [2024-04-05T00:50:05.641+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:50:05.643101806Z [2024-04-05T00:50:05.642+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:49:00+00:00, run_id=scheduled__2024-04-05T00:49:00+00:00, run_start_date=2024-04-05 00:50:00.315184+00:00, run_end_date=2024-04-05 00:50:05.642579+00:00, run_duration=5.327395, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:49:00+00:00, data_interval_end=2024-04-05 00:50:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:50:05.660810834Z [2024-04-05T00:50:05.660+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:50:00+00:00, run_after=2024-04-05T00:51:00+00:00 2024-04-05T00:50:05.726947318Z [2024-04-05T00:50:05.726+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:49:00+00:00 exited with status success for try_number 1 2024-04-05T00:50:05.735021807Z [2024-04-05T00:50:05.734+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:49:00+00:00, map_index=-1, run_start_date=2024-04-05 00:50:03.682606+00:00, run_end_date=2024-04-05 00:50:05.017012+00:00, run_duration=1.334406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=628, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:50:00.434599+00:00, queued_by_job_id=1, pid=9190 2024-04-05T00:50:06.776801159Z [2024-04-05T00:50:06.776+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:50:06.777093754Z [2024-04-05T00:50:06.776+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:49:00+00:00, run_id=scheduled__2024-04-05T00:49:00+00:00, run_start_date=2024-04-05 00:50:00.316235+00:00, run_end_date=2024-04-05 00:50:06.776672+00:00, run_duration=6.460437, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:49:00+00:00, data_interval_end=2024-04-05 00:50:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:50:06.787125132Z [2024-04-05T00:50:06.786+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:50:00+00:00, run_after=2024-04-05T00:51:00+00:00 2024-04-05T00:50:06.823949550Z [2024-04-05T00:50:06.823+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:50:06.823987106Z 2024-04-05T00:50:06.824126051Z [2024-04-05T00:50:06.823+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:50:06.825393964Z [2024-04-05T00:50:06.825+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:50:06.825405299Z 2024-04-05T00:50:06.829532085Z [2024-04-05T00:50:06.829+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T00:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T00:50:06.829680396Z [2024-04-05T00:50:06.829+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T00:50:06.904559511Z [2024-04-05T00:50:06.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:45:00+00:00 exited with status queued for try_number 1 2024-04-05T00:50:06.904867600Z [2024-04-05T00:50:06.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:49:00+00:00 exited with status success for try_number 1 2024-04-05T00:50:06.905048743Z [2024-04-05T00:50:06.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:45:00+00:00 exited with status success for try_number 1 2024-04-05T00:50:06.917114551Z [2024-04-05T00:50:06.916+0000] {scheduler_job.py:635} INFO - Setting external_id for to 784de8f3-b722-465d-9141-0753ff62e37a 2024-04-05T00:50:06.917431917Z [2024-04-05T00:50:06.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:49:00+00:00, map_index=-1, run_start_date=2024-04-05 00:50:04.035504+00:00, run_end_date=2024-04-05 00:50:05.728248+00:00, run_duration=1.692744, state=success, executor_state=success, try_number=1, max_tries=1, job_id=629, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:50:00.434599+00:00, queued_by_job_id=1, pid=9197 2024-04-05T00:50:06.917775702Z [2024-04-05T00:50:06.917+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T00:45:00+00:00, map_index=-1, run_start_date=2024-04-05 00:50:05.619482+00:00, run_end_date=2024-04-05 00:50:05.964231+00:00, run_duration=0.344749, state=success, executor_state=success, try_number=1, max_tries=1, job_id=630, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:50:03.833379+00:00, queued_by_job_id=1, pid=9209 2024-04-05T00:50:09.168890343Z [2024-04-05T00:50:09.168+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:50:09.168932645Z 2024-04-05T00:50:09.169292872Z [2024-04-05T00:50:09.168+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:50:09.170178005Z [2024-04-05T00:50:09.169+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:50:09.170192760Z 2024-04-05T00:50:09.173624103Z [2024-04-05T00:50:09.173+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T00:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:50:09.173936786Z [2024-04-05T00:50:09.173+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:50:09.236642311Z [2024-04-05T00:50:09.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:45:00+00:00 exited with status queued for try_number 1 2024-04-05T00:50:09.236748625Z [2024-04-05T00:50:09.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:45:00+00:00 exited with status success for try_number 1 2024-04-05T00:50:09.244960308Z [2024-04-05T00:50:09.244+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5093dae-628d-40fe-9b39-db1138e1b6bc 2024-04-05T00:50:09.245285994Z [2024-04-05T00:50:09.244+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T00:45:00+00:00, map_index=0, run_start_date=2024-04-05 00:50:08.483723+00:00, run_end_date=2024-04-05 00:50:08.774684+00:00, run_duration=0.290961, state=success, executor_state=success, try_number=1, max_tries=1, job_id=631, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:50:06.826048+00:00, queued_by_job_id=1, pid=9217 2024-04-05T00:50:11.639242308Z [2024-04-05T00:50:11.638+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:50:11.639830792Z [2024-04-05T00:50:11.639+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:45:00+00:00, run_id=scheduled__2024-04-05T00:45:00+00:00, run_start_date=2024-04-05 00:50:00.311684+00:00, run_end_date=2024-04-05 00:50:11.639356+00:00, run_duration=11.327672, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:45:00+00:00, data_interval_end=2024-04-05 00:50:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T00:50:11.645804532Z [2024-04-05T00:50:11.645+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:50:00+00:00, run_after=2024-04-05T00:55:00+00:00 2024-04-05T00:50:11.686091423Z [2024-04-05T00:50:11.685+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:45:00+00:00 exited with status success for try_number 1 2024-04-05T00:50:11.693910970Z [2024-04-05T00:50:11.693+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T00:45:00+00:00, map_index=-1, run_start_date=2024-04-05 00:50:10.945095+00:00, run_end_date=2024-04-05 00:50:11.487710+00:00, run_duration=0.542615, state=success, executor_state=success, try_number=1, max_tries=1, job_id=632, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:50:09.170861+00:00, queued_by_job_id=1, pid=9235 2024-04-05T00:50:40.724413582Z [2024-04-05T00:50:40.723+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T00:51:00.136361767Z [2024-04-05T00:51:00.135+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:51:00+00:00, run_after=2024-04-05T00:52:00+00:00 2024-04-05T00:51:00.149530388Z [2024-04-05T00:51:00.149+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:51:00+00:00, run_after=2024-04-05T00:52:00+00:00 2024-04-05T00:51:00.156610782Z [2024-04-05T00:51:00.156+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:51:00.234669640Z [2024-04-05T00:51:00.234+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:51:00.234699228Z 2024-04-05T00:51:00.234703253Z 2024-04-05T00:51:00.234706471Z 2024-04-05T00:51:00.234816186Z [2024-04-05T00:51:00.234+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:51:00.235078535Z [2024-04-05T00:51:00.234+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:51:00.235318252Z [2024-04-05T00:51:00.235+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:51:00.236031919Z [2024-04-05T00:51:00.235+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:51:00.236044463Z 2024-04-05T00:51:00.236048128Z 2024-04-05T00:51:00.236051621Z 2024-04-05T00:51:00.239131310Z [2024-04-05T00:51:00.238+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:51:00.239385726Z [2024-04-05T00:51:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:51:00.239729294Z [2024-04-05T00:51:00.239+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:51:00.240037034Z [2024-04-05T00:51:00.239+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:51:00.240302784Z [2024-04-05T00:51:00.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:51:00.240454880Z [2024-04-05T00:51:00.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:51:00.548714639Z [2024-04-05T00:51:00.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:50:00+00:00 exited with status queued for try_number 1 2024-04-05T00:51:00.548920002Z [2024-04-05T00:51:00.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:50:00+00:00 exited with status queued for try_number 1 2024-04-05T00:51:00.549070996Z [2024-04-05T00:51:00.548+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:50:00+00:00 exited with status queued for try_number 1 2024-04-05T00:51:00.572754604Z [2024-04-05T00:51:00.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ab0daf6-7616-40e8-bbf2-8fdd0cbada8b 2024-04-05T00:51:00.573007560Z [2024-04-05T00:51:00.572+0000] {scheduler_job.py:635} INFO - Setting external_id for to 066e765d-1622-4e26-a54e-544a2c183f19 2024-04-05T00:51:00.573198014Z [2024-04-05T00:51:00.573+0000] {scheduler_job.py:635} INFO - Setting external_id for to 198957a8-efd9-4a3f-9f75-9e4c09034e1d 2024-04-05T00:51:03.203552616Z [2024-04-05T00:51:03.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:51:03.203784393Z [2024-04-05T00:51:03.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:50:00+00:00, run_id=scheduled__2024-04-05T00:50:00+00:00, run_start_date=2024-04-05 00:51:00.167893+00:00, run_end_date=2024-04-05 00:51:03.203403+00:00, run_duration=3.03551, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:50:00+00:00, data_interval_end=2024-04-05 00:51:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:51:03.215905185Z [2024-04-05T00:51:03.215+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:51:00+00:00, run_after=2024-04-05T00:52:00+00:00 2024-04-05T00:51:03.274954266Z [2024-04-05T00:51:03.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:50:00+00:00 exited with status success for try_number 1 2024-04-05T00:51:03.280537069Z [2024-04-05T00:51:03.280+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:50:00+00:00, map_index=-1, run_start_date=2024-04-05 00:51:02.107418+00:00, run_end_date=2024-04-05 00:51:02.606807+00:00, run_duration=0.499389, state=success, executor_state=success, try_number=1, max_tries=1, job_id=633, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:51:00.236799+00:00, queued_by_job_id=1, pid=9248 2024-04-05T00:51:04.313639326Z [2024-04-05T00:51:04.313+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:51:04.313776447Z [2024-04-05T00:51:04.313+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:50:00+00:00, run_id=scheduled__2024-04-05T00:50:00+00:00, run_start_date=2024-04-05 00:51:00.169122+00:00, run_end_date=2024-04-05 00:51:04.313490+00:00, run_duration=4.144368, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:50:00+00:00, data_interval_end=2024-04-05 00:51:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:51:04.323028009Z [2024-04-05T00:51:04.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:51:00+00:00, run_after=2024-04-05T00:52:00+00:00 2024-04-05T00:51:04.371130172Z [2024-04-05T00:51:04.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:50:00+00:00 exited with status success for try_number 1 2024-04-05T00:51:04.376408650Z [2024-04-05T00:51:04.376+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:50:00+00:00, map_index=-1, run_start_date=2024-04-05 00:51:02.787489+00:00, run_end_date=2024-04-05 00:51:04.086449+00:00, run_duration=1.29896, state=success, executor_state=success, try_number=1, max_tries=1, job_id=634, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:51:00.236799+00:00, queued_by_job_id=1, pid=9260 2024-04-05T00:51:04.769145714Z [2024-04-05T00:51:04.768+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:51:04.769320700Z [2024-04-05T00:51:04.769+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:50:00+00:00, run_id=scheduled__2024-04-05T00:50:00+00:00, run_start_date=2024-04-05 00:51:00.170086+00:00, run_end_date=2024-04-05 00:51:04.769039+00:00, run_duration=4.598953, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:50:00+00:00, data_interval_end=2024-04-05 00:51:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:51:04.777919118Z [2024-04-05T00:51:04.777+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:51:00+00:00, run_after=2024-04-05T00:52:00+00:00 2024-04-05T00:51:05.706751556Z [2024-04-05T00:51:05.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:50:00+00:00 exited with status success for try_number 1 2024-04-05T00:51:05.715248379Z [2024-04-05T00:51:05.714+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:50:00+00:00, map_index=-1, run_start_date=2024-04-05 00:51:03.009845+00:00, run_end_date=2024-04-05 00:51:04.735863+00:00, run_duration=1.726018, state=success, executor_state=success, try_number=1, max_tries=1, job_id=635, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:51:00.236799+00:00, queued_by_job_id=1, pid=9266 2024-04-05T00:52:00.648671098Z [2024-04-05T00:52:00.648+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:52:00.663069783Z [2024-04-05T00:52:00.662+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:52:00+00:00, run_after=2024-04-05T00:53:00+00:00 2024-04-05T00:52:00.676981762Z [2024-04-05T00:52:00.676+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:52:00+00:00, run_after=2024-04-05T00:53:00+00:00 2024-04-05T00:52:00.683928443Z [2024-04-05T00:52:00.683+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:52:00.755015953Z [2024-04-05T00:52:00.754+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:52:00.755039101Z 2024-04-05T00:52:00.755043592Z 2024-04-05T00:52:00.755046982Z 2024-04-05T00:52:00.755050474Z 2024-04-05T00:52:00.755273345Z [2024-04-05T00:52:00.754+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:52:00.755501938Z [2024-04-05T00:52:00.755+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:52:00.755719352Z [2024-04-05T00:52:00.755+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:52:00.756028507Z [2024-04-05T00:52:00.755+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:52:00.757163981Z [2024-04-05T00:52:00.756+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:52:00.757175965Z 2024-04-05T00:52:00.757180305Z 2024-04-05T00:52:00.757183838Z 2024-04-05T00:52:00.757187559Z 2024-04-05T00:52:00.762379710Z [2024-04-05T00:52:00.761+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:52:00.762395443Z [2024-04-05T00:52:00.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:52:00.762723333Z [2024-04-05T00:52:00.762+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:52:00.763016112Z [2024-04-05T00:52:00.762+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:52:00.763383863Z [2024-04-05T00:52:00.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:52:00.763742904Z [2024-04-05T00:52:00.763+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:52:00.764141901Z [2024-04-05T00:52:00.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:52:00.764593737Z [2024-04-05T00:52:00.764+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:52:01.156653340Z [2024-04-05T00:52:01.154+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:50:00+00:00 exited with status queued for try_number 1 2024-04-05T00:52:01.156792166Z [2024-04-05T00:52:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:51:00+00:00 exited with status queued for try_number 1 2024-04-05T00:52:01.156797255Z [2024-04-05T00:52:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:51:00+00:00 exited with status queued for try_number 1 2024-04-05T00:52:01.156800671Z [2024-04-05T00:52:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:51:00+00:00 exited with status queued for try_number 1 2024-04-05T00:52:01.166182137Z [2024-04-05T00:52:01.163+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71400fbd-c86e-422e-ba48-571034397e09 2024-04-05T00:52:01.166290874Z [2024-04-05T00:52:01.164+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a384fe0-118b-4779-984c-27d9e7cfd1c4 2024-04-05T00:52:01.166295151Z [2024-04-05T00:52:01.164+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69a27e8c-206b-4d99-96f1-9c0623075663 2024-04-05T00:52:01.166311835Z [2024-04-05T00:52:01.164+0000] {scheduler_job.py:635} INFO - Setting external_id for to 581e45d1-00d1-4fef-b7f7-eea3fa7a929a 2024-04-05T00:52:04.092562040Z [2024-04-05T00:52:04.091+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:52:04.093108025Z [2024-04-05T00:52:04.092+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:50:00+00:00, run_id=scheduled__2024-04-05T00:50:00+00:00, run_start_date=2024-04-05 00:52:00.692840+00:00, run_end_date=2024-04-05 00:52:04.092473+00:00, run_duration=3.399633, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:50:00+00:00, data_interval_end=2024-04-05 00:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:52:04.110803001Z [2024-04-05T00:52:04.110+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:52:00+00:00, run_after=2024-04-05T00:54:00+00:00 2024-04-05T00:52:04.122676476Z [2024-04-05T00:52:04.122+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:52:04.122978981Z [2024-04-05T00:52:04.122+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:51:00+00:00, run_id=scheduled__2024-04-05T00:51:00+00:00, run_start_date=2024-04-05 00:52:00.694002+00:00, run_end_date=2024-04-05 00:52:04.122535+00:00, run_duration=3.428533, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:51:00+00:00, data_interval_end=2024-04-05 00:52:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:52:04.144867687Z [2024-04-05T00:52:04.144+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:52:00+00:00, run_after=2024-04-05T00:53:00+00:00 2024-04-05T00:52:04.227461526Z [2024-04-05T00:52:04.226+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:50:00+00:00 exited with status success for try_number 1 2024-04-05T00:52:04.227529127Z [2024-04-05T00:52:04.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:51:00+00:00 exited with status success for try_number 1 2024-04-05T00:52:04.242752081Z [2024-04-05T00:52:04.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:51:00+00:00, map_index=-1, run_start_date=2024-04-05 00:52:02.210379+00:00, run_end_date=2024-04-05 00:52:03.118838+00:00, run_duration=0.908459, state=success, executor_state=success, try_number=1, max_tries=1, job_id=636, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:52:00.758887+00:00, queued_by_job_id=1, pid=9299 2024-04-05T00:52:04.246406731Z [2024-04-05T00:52:04.245+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:50:00+00:00, map_index=-1, run_start_date=2024-04-05 00:52:02.622330+00:00, run_end_date=2024-04-05 00:52:03.117212+00:00, run_duration=0.494882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=637, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:52:00.758887+00:00, queued_by_job_id=1, pid=9301 2024-04-05T00:52:06.109075396Z [2024-04-05T00:52:06.108+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:52:06.109235894Z [2024-04-05T00:52:06.109+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:51:00+00:00, run_id=scheduled__2024-04-05T00:51:00+00:00, run_start_date=2024-04-05 00:52:00.695103+00:00, run_end_date=2024-04-05 00:52:06.108971+00:00, run_duration=5.413868, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:51:00+00:00, data_interval_end=2024-04-05 00:52:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:52:06.118321549Z [2024-04-05T00:52:06.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:52:00+00:00, run_after=2024-04-05T00:53:00+00:00 2024-04-05T00:52:06.125579039Z [2024-04-05T00:52:06.125+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:52:06.125615483Z [2024-04-05T00:52:06.125+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:51:00+00:00, run_id=scheduled__2024-04-05T00:51:00+00:00, run_start_date=2024-04-05 00:52:00.696123+00:00, run_end_date=2024-04-05 00:52:06.125288+00:00, run_duration=5.429165, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:51:00+00:00, data_interval_end=2024-04-05 00:52:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:52:06.135092279Z [2024-04-05T00:52:06.134+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:52:00+00:00, run_after=2024-04-05T00:53:00+00:00 2024-04-05T00:52:06.182521848Z [2024-04-05T00:52:06.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:51:00+00:00 exited with status success for try_number 1 2024-04-05T00:52:06.182619598Z [2024-04-05T00:52:06.182+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:51:00+00:00 exited with status success for try_number 1 2024-04-05T00:52:06.191802063Z [2024-04-05T00:52:06.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:51:00+00:00, map_index=-1, run_start_date=2024-04-05 00:52:03.495669+00:00, run_end_date=2024-04-05 00:52:05.307972+00:00, run_duration=1.812303, state=success, executor_state=success, try_number=1, max_tries=1, job_id=638, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:52:00.758887+00:00, queued_by_job_id=1, pid=9318 2024-04-05T00:52:06.192247213Z [2024-04-05T00:52:06.191+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:51:00+00:00, map_index=-1, run_start_date=2024-04-05 00:52:03.992941+00:00, run_end_date=2024-04-05 00:52:05.378806+00:00, run_duration=1.385865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=639, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:52:00.758887+00:00, queued_by_job_id=1, pid=9329 2024-04-05T00:53:00.550909712Z [2024-04-05T00:53:00.550+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:53:00+00:00, run_after=2024-04-05T00:54:00+00:00 2024-04-05T00:53:00.560051040Z [2024-04-05T00:53:00.559+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:53:00.582901516Z [2024-04-05T00:53:00.582+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:53:00+00:00, run_after=2024-04-05T00:54:00+00:00 2024-04-05T00:53:00.652534316Z [2024-04-05T00:53:00.652+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:53:00.652559036Z 2024-04-05T00:53:00.652563083Z 2024-04-05T00:53:00.652566271Z 2024-04-05T00:53:00.652777950Z [2024-04-05T00:53:00.652+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:53:00.653002712Z [2024-04-05T00:53:00.652+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:53:00.653352930Z [2024-04-05T00:53:00.653+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:53:00.653991918Z [2024-04-05T00:53:00.653+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:53:00.653996699Z 2024-04-05T00:53:00.654000158Z 2024-04-05T00:53:00.654003361Z 2024-04-05T00:53:00.659762038Z [2024-04-05T00:53:00.659+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:53:00.660018497Z [2024-04-05T00:53:00.659+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:53:00.660328724Z [2024-04-05T00:53:00.660+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:53:00.660509297Z [2024-04-05T00:53:00.660+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:53:00.660793715Z [2024-04-05T00:53:00.660+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:53:00.660983966Z [2024-04-05T00:53:00.660+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:53:01.292842523Z [2024-04-05T00:53:01.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:52:00+00:00 exited with status queued for try_number 1 2024-04-05T00:53:01.295721035Z [2024-04-05T00:53:01.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:52:00+00:00 exited with status queued for try_number 1 2024-04-05T00:53:01.295925269Z [2024-04-05T00:53:01.295+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:52:00+00:00 exited with status queued for try_number 1 2024-04-05T00:53:01.333354735Z [2024-04-05T00:53:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to c53fca8b-76b1-43d0-bc90-1ce729350fd9 2024-04-05T00:53:01.333665367Z [2024-04-05T00:53:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to 069ffebc-dd70-48bc-b1f7-dea24fb0ed7a 2024-04-05T00:53:01.333908543Z [2024-04-05T00:53:01.333+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76c7a3b4-2169-4689-bd39-71001ea0d461 2024-04-05T00:53:03.603772126Z [2024-04-05T00:53:03.603+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:53:03.604295353Z [2024-04-05T00:53:03.603+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:52:00+00:00, run_id=scheduled__2024-04-05T00:52:00+00:00, run_start_date=2024-04-05 00:53:00.595072+00:00, run_end_date=2024-04-05 00:53:03.603675+00:00, run_duration=3.008603, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:52:00+00:00, data_interval_end=2024-04-05 00:53:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:53:03.621480679Z [2024-04-05T00:53:03.621+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:53:00+00:00, run_after=2024-04-05T00:54:00+00:00 2024-04-05T00:53:03.680333629Z [2024-04-05T00:53:03.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:52:00+00:00 exited with status success for try_number 1 2024-04-05T00:53:03.687966059Z [2024-04-05T00:53:03.687+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:52:00+00:00, map_index=-1, run_start_date=2024-04-05 00:53:02.174144+00:00, run_end_date=2024-04-05 00:53:02.637917+00:00, run_duration=0.463773, state=success, executor_state=success, try_number=1, max_tries=1, job_id=640, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:53:00.654998+00:00, queued_by_job_id=1, pid=9356 2024-04-05T00:53:06.396294079Z [2024-04-05T00:53:06.394+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:53:06.396321396Z [2024-04-05T00:53:06.395+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:52:00+00:00, run_id=scheduled__2024-04-05T00:52:00+00:00, run_start_date=2024-04-05 00:53:00.597855+00:00, run_end_date=2024-04-05 00:53:06.395106+00:00, run_duration=5.797251, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:52:00+00:00, data_interval_end=2024-04-05 00:53:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:53:06.404365067Z [2024-04-05T00:53:06.404+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:53:00+00:00, run_after=2024-04-05T00:54:00+00:00 2024-04-05T00:53:06.413208499Z [2024-04-05T00:53:06.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:53:06.413689684Z [2024-04-05T00:53:06.413+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:52:00+00:00, run_id=scheduled__2024-04-05T00:52:00+00:00, run_start_date=2024-04-05 00:53:00.596531+00:00, run_end_date=2024-04-05 00:53:06.413093+00:00, run_duration=5.816562, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:52:00+00:00, data_interval_end=2024-04-05 00:53:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:53:06.425692873Z [2024-04-05T00:53:06.425+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:53:00+00:00, run_after=2024-04-05T00:54:00+00:00 2024-04-05T00:53:06.459596884Z [2024-04-05T00:53:06.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:52:00+00:00 exited with status success for try_number 1 2024-04-05T00:53:06.459864604Z [2024-04-05T00:53:06.459+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:52:00+00:00 exited with status success for try_number 1 2024-04-05T00:53:06.473561880Z [2024-04-05T00:53:06.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:52:00+00:00, map_index=-1, run_start_date=2024-04-05 00:53:03.562481+00:00, run_end_date=2024-04-05 00:53:05.539527+00:00, run_duration=1.977046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=642, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:53:00.654998+00:00, queued_by_job_id=1, pid=9375 2024-04-05T00:53:06.473887297Z [2024-04-05T00:53:06.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:52:00+00:00, map_index=-1, run_start_date=2024-04-05 00:53:03.397113+00:00, run_end_date=2024-04-05 00:53:06.039102+00:00, run_duration=2.641989, state=success, executor_state=success, try_number=1, max_tries=1, job_id=641, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:53:00.654998+00:00, queued_by_job_id=1, pid=9374 2024-04-05T00:54:00.284411371Z [2024-04-05T00:54:00.283+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:54:00+00:00, run_after=2024-04-05T00:55:00+00:00 2024-04-05T00:54:00.297518655Z [2024-04-05T00:54:00.297+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:54:00+00:00, run_after=2024-04-05T00:55:00+00:00 2024-04-05T00:54:00.316348776Z [2024-04-05T00:54:00.308+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:54:00.330592914Z [2024-04-05T00:54:00.330+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:54:00.413572643Z [2024-04-05T00:54:00.413+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:54:00.413598362Z 2024-04-05T00:54:00.413602856Z 2024-04-05T00:54:00.413606345Z 2024-04-05T00:54:00.413610233Z 2024-04-05T00:54:00.413817379Z [2024-04-05T00:54:00.413+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:54:00.414100057Z [2024-04-05T00:54:00.413+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:54:00.414301418Z [2024-04-05T00:54:00.414+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:54:00.414563651Z [2024-04-05T00:54:00.414+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:54:00.415216950Z [2024-04-05T00:54:00.415+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:54:00.415228652Z 2024-04-05T00:54:00.415232433Z 2024-04-05T00:54:00.415236494Z 2024-04-05T00:54:00.415240156Z 2024-04-05T00:54:00.418748257Z [2024-04-05T00:54:00.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:54:00.418957368Z [2024-04-05T00:54:00.418+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:54:00.419249322Z [2024-04-05T00:54:00.419+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:54:00.419397645Z [2024-04-05T00:54:00.419+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:54:00.419645328Z [2024-04-05T00:54:00.419+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:54:00.419829830Z [2024-04-05T00:54:00.419+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:54:00.420091856Z [2024-04-05T00:54:00.419+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:54:00.420266467Z [2024-04-05T00:54:00.420+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:54:00.953167767Z [2024-04-05T00:54:00.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:52:00+00:00 exited with status queued for try_number 1 2024-04-05T00:54:00.955742890Z [2024-04-05T00:54:00.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:53:00+00:00 exited with status queued for try_number 1 2024-04-05T00:54:00.955992312Z [2024-04-05T00:54:00.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:53:00+00:00 exited with status queued for try_number 1 2024-04-05T00:54:00.956214947Z [2024-04-05T00:54:00.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:53:00+00:00 exited with status queued for try_number 1 2024-04-05T00:54:00.980065738Z [2024-04-05T00:54:00.975+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41fd7eb4-b566-4ed0-a0df-7c455b84e577 2024-04-05T00:54:00.980388787Z [2024-04-05T00:54:00.980+0000] {scheduler_job.py:635} INFO - Setting external_id for to bb485452-8fc6-400d-809d-dd9a782ed02f 2024-04-05T00:54:00.980561019Z [2024-04-05T00:54:00.980+0000] {scheduler_job.py:635} INFO - Setting external_id for to b3192c63-edbb-41a2-b73d-2bf06bc3e0f6 2024-04-05T00:54:00.980722750Z [2024-04-05T00:54:00.980+0000] {scheduler_job.py:635} INFO - Setting external_id for to ffe9c2c2-7d49-4472-83f1-bf78add8d95d 2024-04-05T00:54:02.298231822Z [2024-04-05T00:54:02.297+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:54:02.299074577Z [2024-04-05T00:54:02.298+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:53:00+00:00, run_id=scheduled__2024-04-05T00:53:00+00:00, run_start_date=2024-04-05 00:54:00.344212+00:00, run_end_date=2024-04-05 00:54:02.298251+00:00, run_duration=1.954039, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:53:00+00:00, data_interval_end=2024-04-05 00:54:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:54:02.345534856Z [2024-04-05T00:54:02.345+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:54:00+00:00, run_after=2024-04-05T00:55:00+00:00 2024-04-05T00:54:03.283193972Z [2024-04-05T00:54:03.282+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:54:03.283715834Z [2024-04-05T00:54:03.283+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:52:00+00:00, run_id=scheduled__2024-04-05T00:52:00+00:00, run_start_date=2024-04-05 00:54:00.342833+00:00, run_end_date=2024-04-05 00:54:03.283089+00:00, run_duration=2.940256, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:52:00+00:00, data_interval_end=2024-04-05 00:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:54:03.295685427Z [2024-04-05T00:54:03.295+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:54:00+00:00, run_after=2024-04-05T00:56:00+00:00 2024-04-05T00:54:03.370239960Z [2024-04-05T00:54:03.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:52:00+00:00 exited with status success for try_number 1 2024-04-05T00:54:03.371469291Z [2024-04-05T00:54:03.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:53:00+00:00 exited with status success for try_number 1 2024-04-05T00:54:03.381640871Z [2024-04-05T00:54:03.381+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:53:00+00:00, map_index=-1, run_start_date=2024-04-05 00:54:01.589110+00:00, run_end_date=2024-04-05 00:54:02.168909+00:00, run_duration=0.579799, state=success, executor_state=success, try_number=1, max_tries=1, job_id=643, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:54:00.416231+00:00, queued_by_job_id=1, pid=9408 2024-04-05T00:54:03.382126271Z [2024-04-05T00:54:03.381+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:52:00+00:00, map_index=-1, run_start_date=2024-04-05 00:54:01.909829+00:00, run_end_date=2024-04-05 00:54:02.465524+00:00, run_duration=0.555695, state=success, executor_state=success, try_number=1, max_tries=1, job_id=644, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:54:00.416231+00:00, queued_by_job_id=1, pid=9409 2024-04-05T00:54:05.500246070Z [2024-04-05T00:54:05.499+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:54:05.500421382Z [2024-04-05T00:54:05.500+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:53:00+00:00, run_id=scheduled__2024-04-05T00:53:00+00:00, run_start_date=2024-04-05 00:54:00.345514+00:00, run_end_date=2024-04-05 00:54:05.500157+00:00, run_duration=5.154643, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:53:00+00:00, data_interval_end=2024-04-05 00:54:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:54:05.509291558Z [2024-04-05T00:54:05.509+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:54:00+00:00, run_after=2024-04-05T00:55:00+00:00 2024-04-05T00:54:05.516003194Z [2024-04-05T00:54:05.515+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:54:05.516142182Z [2024-04-05T00:54:05.515+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:53:00+00:00, run_id=scheduled__2024-04-05T00:53:00+00:00, run_start_date=2024-04-05 00:54:00.346605+00:00, run_end_date=2024-04-05 00:54:05.515899+00:00, run_duration=5.169294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:53:00+00:00, data_interval_end=2024-04-05 00:54:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:54:05.524976894Z [2024-04-05T00:54:05.524+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:54:00+00:00, run_after=2024-04-05T00:55:00+00:00 2024-04-05T00:54:05.555499983Z [2024-04-05T00:54:05.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:53:00+00:00 exited with status success for try_number 1 2024-04-05T00:54:05.555551526Z [2024-04-05T00:54:05.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:53:00+00:00 exited with status success for try_number 1 2024-04-05T00:54:05.561609426Z [2024-04-05T00:54:05.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:53:00+00:00, map_index=-1, run_start_date=2024-04-05 00:54:03.343258+00:00, run_end_date=2024-04-05 00:54:04.770980+00:00, run_duration=1.427722, state=success, executor_state=success, try_number=1, max_tries=1, job_id=646, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:54:00.416231+00:00, queued_by_job_id=1, pid=9433 2024-04-05T00:54:05.561787624Z [2024-04-05T00:54:05.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:53:00+00:00, map_index=-1, run_start_date=2024-04-05 00:54:03.279691+00:00, run_end_date=2024-04-05 00:54:05.250616+00:00, run_duration=1.970925, state=success, executor_state=success, try_number=1, max_tries=1, job_id=645, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:54:00.416231+00:00, queued_by_job_id=1, pid=9432 2024-04-05T00:55:00.194784893Z [2024-04-05T00:55:00.194+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:55:00.212552713Z [2024-04-05T00:55:00.212+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:55:00+00:00, run_after=2024-04-05T00:56:00+00:00 2024-04-05T00:55:00.228199338Z [2024-04-05T00:55:00.227+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:55:00+00:00, run_after=2024-04-05T00:56:00+00:00 2024-04-05T00:55:00.242957927Z [2024-04-05T00:55:00.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:55:00+00:00, run_after=2024-04-05T01:00:00+00:00 2024-04-05T00:55:00.364075030Z [2024-04-05T00:55:00.363+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:55:00.364106692Z 2024-04-05T00:55:00.364112164Z 2024-04-05T00:55:00.364115654Z 2024-04-05T00:55:00.364119059Z 2024-04-05T00:55:00.364153664Z [2024-04-05T00:55:00.363+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:55:00.364292763Z [2024-04-05T00:55:00.364+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:55:00.364431826Z [2024-04-05T00:55:00.364+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:55:00.364544606Z [2024-04-05T00:55:00.364+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:55:00.365229036Z [2024-04-05T00:55:00.365+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:55:00.365240462Z 2024-04-05T00:55:00.365244185Z 2024-04-05T00:55:00.365247480Z 2024-04-05T00:55:00.365274093Z 2024-04-05T00:55:00.369439358Z [2024-04-05T00:55:00.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T00:55:00.369811638Z [2024-04-05T00:55:00.369+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:55:00.370143050Z [2024-04-05T00:55:00.369+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:55:00.370348508Z [2024-04-05T00:55:00.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:55:00.370659522Z [2024-04-05T00:55:00.370+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:55:00.370835763Z [2024-04-05T00:55:00.370+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:55:00.371262642Z [2024-04-05T00:55:00.371+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:55:00.371500214Z [2024-04-05T00:55:00.371+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:55:01.041897224Z [2024-04-05T00:55:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:50:00+00:00 exited with status queued for try_number 1 2024-04-05T00:55:01.041931736Z [2024-04-05T00:55:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:54:00+00:00 exited with status queued for try_number 1 2024-04-05T00:55:01.041975041Z [2024-04-05T00:55:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:54:00+00:00 exited with status queued for try_number 1 2024-04-05T00:55:01.042032101Z [2024-04-05T00:55:01.041+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:54:00+00:00 exited with status queued for try_number 1 2024-04-05T00:55:01.072094736Z [2024-04-05T00:55:01.068+0000] {scheduler_job.py:635} INFO - Setting external_id for to b4b45822-e0e2-4e48-ba8b-b2f6717a0da2 2024-04-05T00:55:01.072246708Z [2024-04-05T00:55:01.072+0000] {scheduler_job.py:635} INFO - Setting external_id for to eaa83fb1-c936-4568-a1ed-6e17633f35cd 2024-04-05T00:55:01.072360841Z [2024-04-05T00:55:01.072+0000] {scheduler_job.py:635} INFO - Setting external_id for to 64383043-137b-46cb-bd4f-929cf63a1b58 2024-04-05T00:55:01.072467747Z [2024-04-05T00:55:01.072+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf2469ee-b4d0-4a7e-8e9a-9a70ec802bf6 2024-04-05T00:55:03.770975020Z [2024-04-05T00:55:03.770+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:55:03.771375611Z [2024-04-05T00:55:03.771+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:54:00+00:00, run_id=scheduled__2024-04-05T00:54:00+00:00, run_start_date=2024-04-05 00:55:00.262083+00:00, run_end_date=2024-04-05 00:55:03.770884+00:00, run_duration=3.508801, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:54:00+00:00, data_interval_end=2024-04-05 00:55:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:55:03.784423152Z [2024-04-05T00:55:03.784+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:55:00+00:00, run_after=2024-04-05T00:56:00+00:00 2024-04-05T00:55:03.867494879Z [2024-04-05T00:55:03.866+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:55:03.867512736Z 2024-04-05T00:55:03.869127130Z [2024-04-05T00:55:03.868+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:55:03.870328370Z [2024-04-05T00:55:03.870+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:55:03.870348384Z 2024-04-05T00:55:03.875187827Z [2024-04-05T00:55:03.874+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T00:55:03.875898947Z [2024-04-05T00:55:03.875+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:55:03.993177974Z [2024-04-05T00:55:03.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:50:00+00:00 exited with status queued for try_number 1 2024-04-05T00:55:03.993588141Z [2024-04-05T00:55:03.993+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:50:00+00:00 exited with status success for try_number 1 2024-04-05T00:55:03.993796726Z [2024-04-05T00:55:03.993+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:54:00+00:00 exited with status success for try_number 1 2024-04-05T00:55:04.002347474Z [2024-04-05T00:55:04.001+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:54:00+00:00, map_index=-1, run_start_date=2024-04-05 00:55:02.520845+00:00, run_end_date=2024-04-05 00:55:03.061868+00:00, run_duration=0.541023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=647, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:55:00.366107+00:00, queued_by_job_id=1, pid=9468 2024-04-05T00:55:04.002691194Z [2024-04-05T00:55:04.002+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2f3a816-b3df-4c9b-a5de-ca3c278549bc 2024-04-05T00:55:04.003018902Z [2024-04-05T00:55:04.002+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T00:50:00+00:00, map_index=-1, run_start_date=2024-04-05 00:55:03.133805+00:00, run_end_date=2024-04-05 00:55:03.697070+00:00, run_duration=0.563265, state=success, executor_state=success, try_number=1, max_tries=1, job_id=648, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:55:00.366107+00:00, queued_by_job_id=1, pid=9489 2024-04-05T00:55:05.367133618Z [2024-04-05T00:55:05.366+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:55:05.367663913Z [2024-04-05T00:55:05.367+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:54:00+00:00, run_id=scheduled__2024-04-05T00:54:00+00:00, run_start_date=2024-04-05 00:55:00.263731+00:00, run_end_date=2024-04-05 00:55:05.367283+00:00, run_duration=5.103552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:54:00+00:00, data_interval_end=2024-04-05 00:55:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:55:05.381944774Z [2024-04-05T00:55:05.381+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:55:00+00:00, run_after=2024-04-05T00:56:00+00:00 2024-04-05T00:55:05.466112818Z [2024-04-05T00:55:05.465+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:54:00+00:00 exited with status success for try_number 1 2024-04-05T00:55:05.475952293Z [2024-04-05T00:55:05.475+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:54:00+00:00, map_index=-1, run_start_date=2024-04-05 00:55:03.403978+00:00, run_end_date=2024-04-05 00:55:04.932440+00:00, run_duration=1.528462, state=success, executor_state=success, try_number=1, max_tries=1, job_id=649, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:55:00.366107+00:00, queued_by_job_id=1, pid=9490 2024-04-05T00:55:06.938601185Z [2024-04-05T00:55:06.938+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:55:06.938985953Z [2024-04-05T00:55:06.938+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:54:00+00:00, run_id=scheduled__2024-04-05T00:54:00+00:00, run_start_date=2024-04-05 00:55:00.265556+00:00, run_end_date=2024-04-05 00:55:06.938566+00:00, run_duration=6.67301, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:54:00+00:00, data_interval_end=2024-04-05 00:55:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:55:06.955347178Z [2024-04-05T00:55:06.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:55:00+00:00, run_after=2024-04-05T00:56:00+00:00 2024-04-05T00:55:07.014611282Z [2024-04-05T00:55:07.014+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:55:07.014648838Z 2024-04-05T00:55:07.014985609Z [2024-04-05T00:55:07.014+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:55:07.016436409Z [2024-04-05T00:55:07.015+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:55:07.016456348Z 2024-04-05T00:55:07.019812710Z [2024-04-05T00:55:07.019+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T00:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T00:55:07.020036752Z [2024-04-05T00:55:07.019+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T00:55:07.089783813Z [2024-04-05T00:55:07.089+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:50:00+00:00 exited with status queued for try_number 1 2024-04-05T00:55:07.092048536Z [2024-04-05T00:55:07.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:54:00+00:00 exited with status success for try_number 1 2024-04-05T00:55:07.092322565Z [2024-04-05T00:55:07.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:50:00+00:00 exited with status success for try_number 1 2024-04-05T00:55:07.100683715Z [2024-04-05T00:55:07.100+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T00:50:00+00:00, map_index=-1, run_start_date=2024-04-05 00:55:05.707282+00:00, run_end_date=2024-04-05 00:55:06.116588+00:00, run_duration=0.409306, state=success, executor_state=success, try_number=1, max_tries=1, job_id=651, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:55:03.871096+00:00, queued_by_job_id=1, pid=9514 2024-04-05T00:55:07.101186786Z [2024-04-05T00:55:07.100+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:54:00+00:00, map_index=-1, run_start_date=2024-04-05 00:55:03.471397+00:00, run_end_date=2024-04-05 00:55:06.074715+00:00, run_duration=2.603318, state=success, executor_state=success, try_number=1, max_tries=1, job_id=650, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:55:00.366107+00:00, queued_by_job_id=1, pid=9491 2024-04-05T00:55:07.101530248Z [2024-04-05T00:55:07.101+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ca7f09d-f1da-4723-8452-29d03eb445ad 2024-04-05T00:55:09.376690286Z [2024-04-05T00:55:09.376+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T00:55:09.376726729Z 2024-04-05T00:55:09.376833811Z [2024-04-05T00:55:09.376+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:55:09.377512350Z [2024-04-05T00:55:09.377+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:55:09.377527606Z 2024-04-05T00:55:09.380030511Z [2024-04-05T00:55:09.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T00:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:55:09.380304328Z [2024-04-05T00:55:09.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T00:55:09.429700829Z [2024-04-05T00:55:09.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:50:00+00:00 exited with status queued for try_number 1 2024-04-05T00:55:09.429839912Z [2024-04-05T00:55:09.429+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:50:00+00:00 exited with status success for try_number 1 2024-04-05T00:55:09.437456904Z [2024-04-05T00:55:09.437+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7524fe93-2841-491e-96d7-a376a3ae9a27 2024-04-05T00:55:09.437771173Z [2024-04-05T00:55:09.437+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T00:50:00+00:00, map_index=0, run_start_date=2024-04-05 00:55:08.822685+00:00, run_end_date=2024-04-05 00:55:09.196496+00:00, run_duration=0.373811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=652, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:55:07.017034+00:00, queued_by_job_id=1, pid=9522 2024-04-05T00:55:11.674028161Z [2024-04-05T00:55:11.673+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:55:11.674319578Z [2024-04-05T00:55:11.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:50:00+00:00, run_id=scheduled__2024-04-05T00:50:00+00:00, run_start_date=2024-04-05 00:55:00.258497+00:00, run_end_date=2024-04-05 00:55:11.673904+00:00, run_duration=11.415407, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:50:00+00:00, data_interval_end=2024-04-05 00:55:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T00:55:11.681302402Z [2024-04-05T00:55:11.680+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:55:00+00:00, run_after=2024-04-05T01:00:00+00:00 2024-04-05T00:55:11.714030432Z [2024-04-05T00:55:11.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:50:00+00:00 exited with status success for try_number 1 2024-04-05T00:55:11.724582275Z [2024-04-05T00:55:11.723+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T00:50:00+00:00, map_index=-1, run_start_date=2024-04-05 00:55:11.020938+00:00, run_end_date=2024-04-05 00:55:11.447733+00:00, run_duration=0.426795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=653, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:55:09.377966+00:00, queued_by_job_id=1, pid=9540 2024-04-05T00:55:40.790421082Z [2024-04-05T00:55:40.789+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T00:56:00.066854439Z [2024-04-05T00:56:00.066+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:56:00.073514952Z [2024-04-05T00:56:00.073+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:56:00.086735651Z [2024-04-05T00:56:00.086+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:56:00+00:00, run_after=2024-04-05T00:57:00+00:00 2024-04-05T00:56:00.099709732Z [2024-04-05T00:56:00.099+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:56:00+00:00, run_after=2024-04-05T00:57:00+00:00 2024-04-05T00:56:00.185118017Z [2024-04-05T00:56:00.184+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:56:00.185140420Z 2024-04-05T00:56:00.185144656Z 2024-04-05T00:56:00.185148354Z 2024-04-05T00:56:00.185151598Z 2024-04-05T00:56:00.185382756Z [2024-04-05T00:56:00.185+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:56:00.185564818Z [2024-04-05T00:56:00.185+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:56:00.185738837Z [2024-04-05T00:56:00.185+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:56:00.185864185Z [2024-04-05T00:56:00.185+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:56:00.186439394Z [2024-04-05T00:56:00.186+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:56:00.186451881Z 2024-04-05T00:56:00.186456957Z 2024-04-05T00:56:00.186461582Z 2024-04-05T00:56:00.186466087Z 2024-04-05T00:56:00.190498619Z [2024-04-05T00:56:00.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:56:00.190536452Z [2024-04-05T00:56:00.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:56:00.190722916Z [2024-04-05T00:56:00.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:56:00.190788294Z [2024-04-05T00:56:00.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:56:00.190956920Z [2024-04-05T00:56:00.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:56:00.191032446Z [2024-04-05T00:56:00.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:56:00.191188995Z [2024-04-05T00:56:00.191+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:56:00.191255550Z [2024-04-05T00:56:00.191+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:56:00.692944013Z [2024-04-05T00:56:00.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:54:00+00:00 exited with status queued for try_number 1 2024-04-05T00:56:00.693020998Z [2024-04-05T00:56:00.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:55:00+00:00 exited with status queued for try_number 1 2024-04-05T00:56:00.693164716Z [2024-04-05T00:56:00.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:55:00+00:00 exited with status queued for try_number 1 2024-04-05T00:56:00.693262753Z [2024-04-05T00:56:00.693+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:55:00+00:00 exited with status queued for try_number 1 2024-04-05T00:56:00.703244604Z [2024-04-05T00:56:00.702+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7f9b58b6-681d-4f15-93a1-b028252f43ee 2024-04-05T00:56:00.703425892Z [2024-04-05T00:56:00.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to c68603cd-3ade-48dc-813f-86b2a21d6924 2024-04-05T00:56:00.703656027Z [2024-04-05T00:56:00.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9cc79200-e2ea-4fe7-8d30-57763ffdb6fc 2024-04-05T00:56:00.703810971Z [2024-04-05T00:56:00.703+0000] {scheduler_job.py:635} INFO - Setting external_id for to c1bc6b4f-603f-4c25-8624-ad35046bceb9 2024-04-05T00:56:03.218285799Z [2024-04-05T00:56:03.217+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:56:03.218710955Z [2024-04-05T00:56:03.218+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:54:00+00:00, run_id=scheduled__2024-04-05T00:54:00+00:00, run_start_date=2024-04-05 00:56:00.109044+00:00, run_end_date=2024-04-05 00:56:03.218175+00:00, run_duration=3.109131, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:54:00+00:00, data_interval_end=2024-04-05 00:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:56:03.228314121Z [2024-04-05T00:56:03.227+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:56:00+00:00, run_after=2024-04-05T00:58:00+00:00 2024-04-05T00:56:03.236808502Z [2024-04-05T00:56:03.236+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:56:03.237225167Z [2024-04-05T00:56:03.236+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:55:00+00:00, run_id=scheduled__2024-04-05T00:55:00+00:00, run_start_date=2024-04-05 00:56:00.110109+00:00, run_end_date=2024-04-05 00:56:03.236669+00:00, run_duration=3.12656, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:55:00+00:00, data_interval_end=2024-04-05 00:56:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:56:03.247208690Z [2024-04-05T00:56:03.246+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:56:00+00:00, run_after=2024-04-05T00:57:00+00:00 2024-04-05T00:56:03.331263628Z [2024-04-05T00:56:03.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:54:00+00:00 exited with status success for try_number 1 2024-04-05T00:56:03.331303220Z [2024-04-05T00:56:03.331+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:55:00+00:00 exited with status success for try_number 1 2024-04-05T00:56:03.344886222Z [2024-04-05T00:56:03.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:54:00+00:00, map_index=-1, run_start_date=2024-04-05 00:56:01.303264+00:00, run_end_date=2024-04-05 00:56:02.101775+00:00, run_duration=0.798511, state=success, executor_state=success, try_number=1, max_tries=1, job_id=654, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:56:00.187160+00:00, queued_by_job_id=1, pid=9553 2024-04-05T00:56:03.345182343Z [2024-04-05T00:56:03.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:55:00+00:00, map_index=-1, run_start_date=2024-04-05 00:56:01.812677+00:00, run_end_date=2024-04-05 00:56:02.430696+00:00, run_duration=0.618019, state=success, executor_state=success, try_number=1, max_tries=1, job_id=655, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:56:00.187160+00:00, queued_by_job_id=1, pid=9554 2024-04-05T00:56:05.497794514Z [2024-04-05T00:56:05.497+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:56:05.498141492Z [2024-04-05T00:56:05.497+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:55:00+00:00, run_id=scheduled__2024-04-05T00:55:00+00:00, run_start_date=2024-04-05 00:56:00.112203+00:00, run_end_date=2024-04-05 00:56:05.497789+00:00, run_duration=5.385586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:55:00+00:00, data_interval_end=2024-04-05 00:56:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:56:05.509754288Z [2024-04-05T00:56:05.509+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:56:00+00:00, run_after=2024-04-05T00:57:00+00:00 2024-04-05T00:56:05.519499256Z [2024-04-05T00:56:05.519+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:56:05.519849404Z [2024-04-05T00:56:05.519+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:55:00+00:00, run_id=scheduled__2024-04-05T00:55:00+00:00, run_start_date=2024-04-05 00:56:00.111110+00:00, run_end_date=2024-04-05 00:56:05.519509+00:00, run_duration=5.408399, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:55:00+00:00, data_interval_end=2024-04-05 00:56:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:56:05.532054934Z [2024-04-05T00:56:05.531+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:56:00+00:00, run_after=2024-04-05T00:57:00+00:00 2024-04-05T00:56:05.570747450Z [2024-04-05T00:56:05.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:55:00+00:00 exited with status success for try_number 1 2024-04-05T00:56:05.571070879Z [2024-04-05T00:56:05.570+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:55:00+00:00 exited with status success for try_number 1 2024-04-05T00:56:05.577970709Z [2024-04-05T00:56:05.577+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:55:00+00:00, map_index=-1, run_start_date=2024-04-05 00:56:03.196505+00:00, run_end_date=2024-04-05 00:56:04.829122+00:00, run_duration=1.632617, state=success, executor_state=success, try_number=1, max_tries=1, job_id=657, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:56:00.187160+00:00, queued_by_job_id=1, pid=9578 2024-04-05T00:56:05.578305787Z [2024-04-05T00:56:05.578+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:55:00+00:00, map_index=-1, run_start_date=2024-04-05 00:56:03.130111+00:00, run_end_date=2024-04-05 00:56:05.118988+00:00, run_duration=1.988877, state=success, executor_state=success, try_number=1, max_tries=1, job_id=656, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:56:00.187160+00:00, queued_by_job_id=1, pid=9577 2024-04-05T00:57:00.748896308Z [2024-04-05T00:57:00.748+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:57:00+00:00, run_after=2024-04-05T00:58:00+00:00 2024-04-05T00:57:00.768443974Z [2024-04-05T00:57:00.768+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:57:00.786619444Z [2024-04-05T00:57:00.786+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:57:00+00:00, run_after=2024-04-05T00:58:00+00:00 2024-04-05T00:57:00.887757815Z [2024-04-05T00:57:00.887+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:57:00.887796026Z 2024-04-05T00:57:00.887802550Z 2024-04-05T00:57:00.887807755Z 2024-04-05T00:57:00.887833112Z [2024-04-05T00:57:00.887+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:57:00.888066231Z [2024-04-05T00:57:00.887+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:57:00.888288107Z [2024-04-05T00:57:00.888+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:57:00.889122570Z [2024-04-05T00:57:00.888+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:57:00.889138516Z 2024-04-05T00:57:00.889143903Z 2024-04-05T00:57:00.889148825Z 2024-04-05T00:57:00.893128705Z [2024-04-05T00:57:00.892+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:57:00.893476964Z [2024-04-05T00:57:00.893+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:57:00.893803628Z [2024-04-05T00:57:00.893+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:57:00.894013614Z [2024-04-05T00:57:00.893+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:57:00.894282099Z [2024-04-05T00:57:00.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:57:00.894384095Z [2024-04-05T00:57:00.894+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:57:01.455415649Z [2024-04-05T00:57:01.454+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:56:00+00:00 exited with status queued for try_number 1 2024-04-05T00:57:01.459956873Z [2024-04-05T00:57:01.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:56:00+00:00 exited with status queued for try_number 1 2024-04-05T00:57:01.460265994Z [2024-04-05T00:57:01.460+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:56:00+00:00 exited with status queued for try_number 1 2024-04-05T00:57:01.468951994Z [2024-04-05T00:57:01.468+0000] {scheduler_job.py:635} INFO - Setting external_id for to 255e02d9-b7fb-4776-9bd3-32c9c909cee8 2024-04-05T00:57:01.471982551Z [2024-04-05T00:57:01.471+0000] {scheduler_job.py:635} INFO - Setting external_id for to b546dd60-3c53-40d7-b209-388c403c3bfd 2024-04-05T00:57:01.472161919Z [2024-04-05T00:57:01.471+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7dfd8cd5-629d-4850-b204-73943a39761b 2024-04-05T00:57:03.900184254Z [2024-04-05T00:57:03.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:57:03.900426422Z [2024-04-05T00:57:03.900+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:56:00+00:00, run_id=scheduled__2024-04-05T00:56:00+00:00, run_start_date=2024-04-05 00:57:00.806592+00:00, run_end_date=2024-04-05 00:57:03.899999+00:00, run_duration=3.093407, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:56:00+00:00, data_interval_end=2024-04-05 00:57:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:57:03.915656953Z [2024-04-05T00:57:03.915+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:57:00+00:00, run_after=2024-04-05T00:58:00+00:00 2024-04-05T00:57:03.980027480Z [2024-04-05T00:57:03.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:56:00+00:00 exited with status success for try_number 1 2024-04-05T00:57:03.989313121Z [2024-04-05T00:57:03.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:56:00+00:00, map_index=-1, run_start_date=2024-04-05 00:57:02.242585+00:00, run_end_date=2024-04-05 00:57:02.790714+00:00, run_duration=0.548129, state=success, executor_state=success, try_number=1, max_tries=1, job_id=658, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:57:00.890278+00:00, queued_by_job_id=1, pid=9611 2024-04-05T00:57:05.033625348Z [2024-04-05T00:57:05.032+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:57:05.034177380Z [2024-04-05T00:57:05.033+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:56:00+00:00, run_id=scheduled__2024-04-05T00:56:00+00:00, run_start_date=2024-04-05 00:57:00.810230+00:00, run_end_date=2024-04-05 00:57:05.033543+00:00, run_duration=4.223313, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:56:00+00:00, data_interval_end=2024-04-05 00:57:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:57:05.046873077Z [2024-04-05T00:57:05.046+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:57:00+00:00, run_after=2024-04-05T00:58:00+00:00 2024-04-05T00:57:05.116339200Z [2024-04-05T00:57:05.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:56:00+00:00 exited with status success for try_number 1 2024-04-05T00:57:05.140313256Z [2024-04-05T00:57:05.133+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:56:00+00:00, map_index=-1, run_start_date=2024-04-05 00:57:03.147412+00:00, run_end_date=2024-04-05 00:57:04.880439+00:00, run_duration=1.733027, state=success, executor_state=success, try_number=1, max_tries=1, job_id=659, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:57:00.890278+00:00, queued_by_job_id=1, pid=9623 2024-04-05T00:57:06.192059682Z [2024-04-05T00:57:06.191+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:57:06.192283582Z [2024-04-05T00:57:06.192+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:56:00+00:00, run_id=scheduled__2024-04-05T00:56:00+00:00, run_start_date=2024-04-05 00:57:00.808642+00:00, run_end_date=2024-04-05 00:57:06.191988+00:00, run_duration=5.383346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:56:00+00:00, data_interval_end=2024-04-05 00:57:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:57:06.203736431Z [2024-04-05T00:57:06.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:57:00+00:00, run_after=2024-04-05T00:58:00+00:00 2024-04-05T00:57:06.233069884Z [2024-04-05T00:57:06.232+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:56:00+00:00 exited with status success for try_number 1 2024-04-05T00:57:06.238316984Z [2024-04-05T00:57:06.237+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:56:00+00:00, map_index=-1, run_start_date=2024-04-05 00:57:03.539344+00:00, run_end_date=2024-04-05 00:57:05.153120+00:00, run_duration=1.613776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=660, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:57:00.890278+00:00, queued_by_job_id=1, pid=9634 2024-04-05T00:58:00.534862225Z [2024-04-05T00:58:00.534+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:58:00+00:00, run_after=2024-04-05T00:59:00+00:00 2024-04-05T00:58:00.545351941Z [2024-04-05T00:58:00.545+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:58:00.561424243Z [2024-04-05T00:58:00.561+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:58:00+00:00, run_after=2024-04-05T00:59:00+00:00 2024-04-05T00:58:00.568681300Z [2024-04-05T00:58:00.568+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:58:00.643291726Z [2024-04-05T00:58:00.642+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T00:58:00.643331220Z 2024-04-05T00:58:00.643335954Z 2024-04-05T00:58:00.643339560Z 2024-04-05T00:58:00.643342703Z 2024-04-05T00:58:00.643692502Z [2024-04-05T00:58:00.643+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T00:58:00.643878590Z [2024-04-05T00:58:00.643+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:58:00.644054241Z [2024-04-05T00:58:00.643+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:58:00.644298928Z [2024-04-05T00:58:00.644+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:58:00.645218815Z [2024-04-05T00:58:00.644+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:58:00.645231841Z 2024-04-05T00:58:00.645235729Z 2024-04-05T00:58:00.645238913Z 2024-04-05T00:58:00.645242099Z 2024-04-05T00:58:00.649815073Z [2024-04-05T00:58:00.649+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:58:00.650127795Z [2024-04-05T00:58:00.649+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T00:58:00.650579517Z [2024-04-05T00:58:00.650+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:58:00.650856133Z [2024-04-05T00:58:00.650+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:58:00.651355033Z [2024-04-05T00:58:00.651+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:58:00.651687988Z [2024-04-05T00:58:00.651+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:58:00.651959913Z [2024-04-05T00:58:00.651+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:58:00.652136337Z [2024-04-05T00:58:00.651+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:58:01.411707358Z [2024-04-05T00:58:01.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:56:00+00:00 exited with status queued for try_number 1 2024-04-05T00:58:01.411947158Z [2024-04-05T00:58:01.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:57:00+00:00 exited with status queued for try_number 1 2024-04-05T00:58:01.412122191Z [2024-04-05T00:58:01.411+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:57:00+00:00 exited with status queued for try_number 1 2024-04-05T00:58:01.412274253Z [2024-04-05T00:58:01.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:57:00+00:00 exited with status queued for try_number 1 2024-04-05T00:58:01.445539865Z [2024-04-05T00:58:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 06c39add-dddf-4744-954e-55a0216204cb 2024-04-05T00:58:01.445820228Z [2024-04-05T00:58:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 644f2cb4-214a-4779-8c68-251ef28c5dc8 2024-04-05T00:58:01.446086175Z [2024-04-05T00:58:01.445+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69811234-c6be-4faa-9430-8670d6e38578 2024-04-05T00:58:01.446303475Z [2024-04-05T00:58:01.446+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe9730a9-f899-40ea-bcee-db034a22a8e6 2024-04-05T00:58:03.754989380Z [2024-04-05T00:58:03.754+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:58:03.755358081Z [2024-04-05T00:58:03.755+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:57:00+00:00, run_id=scheduled__2024-04-05T00:57:00+00:00, run_start_date=2024-04-05 00:58:00.580552+00:00, run_end_date=2024-04-05 00:58:03.754977+00:00, run_duration=3.174425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:57:00+00:00, data_interval_end=2024-04-05 00:58:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:58:03.766009016Z [2024-04-05T00:58:03.765+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:58:00+00:00, run_after=2024-04-05T00:59:00+00:00 2024-04-05T00:58:03.774381688Z [2024-04-05T00:58:03.773+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:58:03.774750889Z [2024-04-05T00:58:03.774+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:56:00+00:00, run_id=scheduled__2024-04-05T00:56:00+00:00, run_start_date=2024-04-05 00:58:00.579292+00:00, run_end_date=2024-04-05 00:58:03.774366+00:00, run_duration=3.195074, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:56:00+00:00, data_interval_end=2024-04-05 00:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T00:58:03.784805362Z [2024-04-05T00:58:03.784+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T00:58:00+00:00, run_after=2024-04-05T01:00:00+00:00 2024-04-05T00:58:03.856872767Z [2024-04-05T00:58:03.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:56:00+00:00 exited with status success for try_number 1 2024-04-05T00:58:03.857181704Z [2024-04-05T00:58:03.856+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:57:00+00:00 exited with status success for try_number 1 2024-04-05T00:58:03.864823666Z [2024-04-05T00:58:03.864+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:57:00+00:00, map_index=-1, run_start_date=2024-04-05 00:58:02.270230+00:00, run_end_date=2024-04-05 00:58:02.751734+00:00, run_duration=0.481504, state=success, executor_state=success, try_number=1, max_tries=1, job_id=661, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:58:00.646534+00:00, queued_by_job_id=1, pid=9662 2024-04-05T00:58:03.865273859Z [2024-04-05T00:58:03.865+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:56:00+00:00, map_index=-1, run_start_date=2024-04-05 00:58:02.424588+00:00, run_end_date=2024-04-05 00:58:02.957127+00:00, run_duration=0.532539, state=success, executor_state=success, try_number=1, max_tries=1, job_id=662, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:58:00.646534+00:00, queued_by_job_id=1, pid=9663 2024-04-05T00:58:06.593226219Z [2024-04-05T00:58:06.592+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:58:06.593571652Z [2024-04-05T00:58:06.593+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:57:00+00:00, run_id=scheduled__2024-04-05T00:57:00+00:00, run_start_date=2024-04-05 00:58:00.582576+00:00, run_end_date=2024-04-05 00:58:06.593094+00:00, run_duration=6.010518, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:57:00+00:00, data_interval_end=2024-04-05 00:58:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:58:06.604125762Z [2024-04-05T00:58:06.603+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:58:00+00:00, run_after=2024-04-05T00:59:00+00:00 2024-04-05T00:58:06.610720955Z [2024-04-05T00:58:06.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:58:06.611049407Z [2024-04-05T00:58:06.610+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:57:00+00:00, run_id=scheduled__2024-04-05T00:57:00+00:00, run_start_date=2024-04-05 00:58:00.581596+00:00, run_end_date=2024-04-05 00:58:06.610585+00:00, run_duration=6.028989, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:57:00+00:00, data_interval_end=2024-04-05 00:58:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:58:06.619923969Z [2024-04-05T00:58:06.619+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:58:00+00:00, run_after=2024-04-05T00:59:00+00:00 2024-04-05T00:58:06.648311722Z [2024-04-05T00:58:06.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:57:00+00:00 exited with status success for try_number 1 2024-04-05T00:58:06.648542856Z [2024-04-05T00:58:06.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:57:00+00:00 exited with status success for try_number 1 2024-04-05T00:58:06.654360358Z [2024-04-05T00:58:06.654+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:57:00+00:00, map_index=-1, run_start_date=2024-04-05 00:58:03.786772+00:00, run_end_date=2024-04-05 00:58:06.174085+00:00, run_duration=2.387313, state=success, executor_state=success, try_number=1, max_tries=1, job_id=664, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:58:00.646534+00:00, queued_by_job_id=1, pid=9687 2024-04-05T00:58:06.654662485Z [2024-04-05T00:58:06.654+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:57:00+00:00, map_index=-1, run_start_date=2024-04-05 00:58:03.502015+00:00, run_end_date=2024-04-05 00:58:06.016868+00:00, run_duration=2.514853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=663, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:58:00.646534+00:00, queued_by_job_id=1, pid=9681 2024-04-05T00:59:00.609835873Z [2024-04-05T00:59:00.609+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T00:59:00.626887952Z [2024-04-05T00:59:00.626+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:59:00+00:00, run_after=2024-04-05T01:00:00+00:00 2024-04-05T00:59:00.640713117Z [2024-04-05T00:59:00.640+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:59:00+00:00, run_after=2024-04-05T01:00:00+00:00 2024-04-05T00:59:00.716497803Z [2024-04-05T00:59:00.716+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T00:59:00.716527832Z 2024-04-05T00:59:00.716544860Z 2024-04-05T00:59:00.716548196Z 2024-04-05T00:59:00.716764381Z [2024-04-05T00:59:00.716+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:59:00.716994509Z [2024-04-05T00:59:00.716+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T00:59:00.717214281Z [2024-04-05T00:59:00.717+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T00:59:00.717952751Z [2024-04-05T00:59:00.717+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T00:59:00.717959905Z 2024-04-05T00:59:00.717963003Z 2024-04-05T00:59:00.717966302Z 2024-04-05T00:59:00.721712065Z [2024-04-05T00:59:00.721+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:59:00.722001064Z [2024-04-05T00:59:00.721+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T00:59:00.723341905Z [2024-04-05T00:59:00.722+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:59:00.724443404Z [2024-04-05T00:59:00.723+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T00:59:00.724782068Z [2024-04-05T00:59:00.724+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T00:59:00.725119193Z [2024-04-05T00:59:00.724+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T00:59:01.132819783Z [2024-04-05T00:59:01.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:58:00+00:00 exited with status queued for try_number 1 2024-04-05T00:59:01.132896061Z [2024-04-05T00:59:01.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:58:00+00:00 exited with status queued for try_number 1 2024-04-05T00:59:01.132948829Z [2024-04-05T00:59:01.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:58:00+00:00 exited with status queued for try_number 1 2024-04-05T00:59:01.155675474Z [2024-04-05T00:59:01.152+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f47875b-eaf6-493f-ab57-a8f4daf6b85e 2024-04-05T00:59:01.155698409Z [2024-04-05T00:59:01.153+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1a60bc2-4291-45b1-8754-551589b8dcf7 2024-04-05T00:59:01.155701835Z [2024-04-05T00:59:01.153+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f060596-c830-4233-a525-f624a7d5968e 2024-04-05T00:59:02.707246127Z [2024-04-05T00:59:02.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:58:00+00:00 exited with status success for try_number 1 2024-04-05T00:59:02.715217279Z [2024-04-05T00:59:02.714+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:58:00+00:00, map_index=-1, run_start_date=2024-04-05 00:59:02.019053+00:00, run_end_date=2024-04-05 00:59:02.469451+00:00, run_duration=0.450398, state=success, executor_state=success, try_number=1, max_tries=1, job_id=665, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:59:00.718931+00:00, queued_by_job_id=1, pid=9719 2024-04-05T00:59:03.563001639Z [2024-04-05T00:59:03.562+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:59:03.563646869Z [2024-04-05T00:59:03.563+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:58:00+00:00, run_id=scheduled__2024-04-05T00:58:00+00:00, run_start_date=2024-04-05 00:59:00.660154+00:00, run_end_date=2024-04-05 00:59:03.563089+00:00, run_duration=2.902935, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:58:00+00:00, data_interval_end=2024-04-05 00:59:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T00:59:03.583102819Z [2024-04-05T00:59:03.582+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T00:59:00+00:00, run_after=2024-04-05T01:00:00+00:00 2024-04-05T00:59:05.850748315Z [2024-04-05T00:59:05.850+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:59:05.850832673Z [2024-04-05T00:59:05.850+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:58:00+00:00, run_id=scheduled__2024-04-05T00:58:00+00:00, run_start_date=2024-04-05 00:59:00.662838+00:00, run_end_date=2024-04-05 00:59:05.850589+00:00, run_duration=5.187751, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:58:00+00:00, data_interval_end=2024-04-05 00:59:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T00:59:05.859933024Z [2024-04-05T00:59:05.859+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:59:00+00:00, run_after=2024-04-05T01:00:00+00:00 2024-04-05T00:59:05.869185764Z [2024-04-05T00:59:05.868+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T00:59:05.869340129Z [2024-04-05T00:59:05.869+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:58:00+00:00, run_id=scheduled__2024-04-05T00:58:00+00:00, run_start_date=2024-04-05 00:59:00.664596+00:00, run_end_date=2024-04-05 00:59:05.869056+00:00, run_duration=5.20446, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:58:00+00:00, data_interval_end=2024-04-05 00:59:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T00:59:05.879066914Z [2024-04-05T00:59:05.878+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T00:59:00+00:00, run_after=2024-04-05T01:00:00+00:00 2024-04-05T00:59:05.922730992Z [2024-04-05T00:59:05.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:58:00+00:00 exited with status success for try_number 1 2024-04-05T00:59:05.922771042Z [2024-04-05T00:59:05.922+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:58:00+00:00 exited with status success for try_number 1 2024-04-05T00:59:05.931105685Z [2024-04-05T00:59:05.930+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:58:00+00:00, map_index=-1, run_start_date=2024-04-05 00:59:03.081462+00:00, run_end_date=2024-04-05 00:59:04.990094+00:00, run_duration=1.908632, state=success, executor_state=success, try_number=1, max_tries=1, job_id=667, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:59:00.718931+00:00, queued_by_job_id=1, pid=9738 2024-04-05T00:59:05.931309373Z [2024-04-05T00:59:05.931+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:58:00+00:00, map_index=-1, run_start_date=2024-04-05 00:59:03.046167+00:00, run_end_date=2024-04-05 00:59:05.712802+00:00, run_duration=2.666635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=666, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 00:59:00.718931+00:00, queued_by_job_id=1, pid=9737 2024-04-05T01:00:00.638407826Z [2024-04-05T01:00:00.638+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:00:00.649474612Z [2024-04-05T01:00:00.649+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:00:00.668705424Z [2024-04-05T01:00:00.668+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:00:00+00:00, run_after=2024-04-05T01:01:00+00:00 2024-04-05T01:00:00.684594671Z [2024-04-05T01:00:00.684+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:00:00+00:00, run_after=2024-04-05T01:01:00+00:00 2024-04-05T01:00:00.709997615Z [2024-04-05T01:00:00.709+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:00:00+00:00, run_after=2024-04-05T01:05:00+00:00 2024-04-05T01:00:00.822138435Z [2024-04-05T01:00:00.821+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T01:00:00.822166780Z 2024-04-05T01:00:00.822171165Z 2024-04-05T01:00:00.822177969Z 2024-04-05T01:00:00.822182336Z 2024-04-05T01:00:00.822186181Z 2024-04-05T01:00:00.822450042Z [2024-04-05T01:00:00.822+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:00:00.822691866Z [2024-04-05T01:00:00.822+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:00:00.822867808Z [2024-04-05T01:00:00.822+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:00:00.823046755Z [2024-04-05T01:00:00.822+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:00:00.823250508Z [2024-04-05T01:00:00.823+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:00:00.824382086Z [2024-04-05T01:00:00.824+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:00:00.824397788Z 2024-04-05T01:00:00.824402298Z 2024-04-05T01:00:00.824406479Z 2024-04-05T01:00:00.824410198Z 2024-04-05T01:00:00.824414063Z 2024-04-05T01:00:00.831462496Z [2024-04-05T01:00:00.831+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:00:00.831739586Z [2024-04-05T01:00:00.831+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:00:00.832045355Z [2024-04-05T01:00:00.831+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T00:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:00:00.832215073Z [2024-04-05T01:00:00.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:00:00.832497233Z [2024-04-05T01:00:00.832+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:00:00.832653819Z [2024-04-05T01:00:00.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:00:00.832965993Z [2024-04-05T01:00:00.832+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:00:00.833141571Z [2024-04-05T01:00:00.832+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:00:00.833431891Z [2024-04-05T01:00:00.833+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T00:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:00:00.835780656Z [2024-04-05T01:00:00.833+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:00:01.648741312Z [2024-04-05T01:00:01.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:55:00+00:00 exited with status queued for try_number 1 2024-04-05T01:00:01.651087746Z [2024-04-05T01:00:01.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:58:00+00:00 exited with status queued for try_number 1 2024-04-05T01:00:01.651201720Z [2024-04-05T01:00:01.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:59:00+00:00 exited with status queued for try_number 1 2024-04-05T01:00:01.651329639Z [2024-04-05T01:00:01.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:59:00+00:00 exited with status queued for try_number 1 2024-04-05T01:00:01.651436655Z [2024-04-05T01:00:01.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:59:00+00:00 exited with status queued for try_number 1 2024-04-05T01:00:01.672985879Z [2024-04-05T01:00:01.672+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75708202-6f55-48f1-b695-7e30d6fc86a1 2024-04-05T01:00:01.673207343Z [2024-04-05T01:00:01.673+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a4eb6b1-b4c6-47e4-9f92-a4560efe112a 2024-04-05T01:00:01.673377286Z [2024-04-05T01:00:01.673+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60870422-397e-4e74-9767-cd60a49d1e7e 2024-04-05T01:00:01.673530647Z [2024-04-05T01:00:01.673+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15344a2c-e5f8-435c-a916-ebbcaad4c1ae 2024-04-05T01:00:01.673680273Z [2024-04-05T01:00:01.673+0000] {scheduler_job.py:635} INFO - Setting external_id for to e6572181-6949-4522-98bd-094fa91e0f06 2024-04-05T01:00:03.070676628Z [2024-04-05T01:00:03.070+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:00:03.071395840Z [2024-04-05T01:00:03.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 00:58:00+00:00, run_id=scheduled__2024-04-05T00:58:00+00:00, run_start_date=2024-04-05 01:00:00.724604+00:00, run_end_date=2024-04-05 01:00:03.070968+00:00, run_duration=2.346364, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:58:00+00:00, data_interval_end=2024-04-05 01:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:00:03.081578865Z [2024-04-05T01:00:03.081+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:00:00+00:00, run_after=2024-04-05T01:02:00+00:00 2024-04-05T01:00:03.173776306Z [2024-04-05T01:00:03.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T00:58:00+00:00 exited with status success for try_number 1 2024-04-05T01:00:03.182629230Z [2024-04-05T01:00:03.182+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T00:58:00+00:00, map_index=-1, run_start_date=2024-04-05 01:00:02.236936+00:00, run_end_date=2024-04-05 01:00:02.707871+00:00, run_duration=0.470935, state=success, executor_state=success, try_number=1, max_tries=1, job_id=668, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:00:00.827702+00:00, queued_by_job_id=1, pid=9768 2024-04-05T01:00:04.240981371Z [2024-04-05T01:00:04.240+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:00:04.241439170Z [2024-04-05T01:00:04.241+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 00:59:00+00:00, run_id=scheduled__2024-04-05T00:59:00+00:00, run_start_date=2024-04-05 01:00:00.726131+00:00, run_end_date=2024-04-05 01:00:04.240995+00:00, run_duration=3.514864, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:59:00+00:00, data_interval_end=2024-04-05 01:00:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:00:04.251457273Z [2024-04-05T01:00:04.251+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:00:00+00:00, run_after=2024-04-05T01:01:00+00:00 2024-04-05T01:00:04.331820845Z [2024-04-05T01:00:04.331+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:00:04.331849251Z 2024-04-05T01:00:04.332983550Z [2024-04-05T01:00:04.332+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:00:04.333705723Z [2024-04-05T01:00:04.333+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:00:04.333719416Z 2024-04-05T01:00:04.337111332Z [2024-04-05T01:00:04.336+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:00:04.337421742Z [2024-04-05T01:00:04.337+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:00:04.408362831Z [2024-04-05T01:00:04.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:55:00+00:00 exited with status queued for try_number 1 2024-04-05T01:00:04.409140747Z [2024-04-05T01:00:04.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T00:55:00+00:00 exited with status success for try_number 1 2024-04-05T01:00:04.409364875Z [2024-04-05T01:00:04.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:59:00+00:00 exited with status success for try_number 1 2024-04-05T01:00:04.420368883Z [2024-04-05T01:00:04.419+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T00:55:00+00:00, map_index=-1, run_start_date=2024-04-05 01:00:03.794549+00:00, run_end_date=2024-04-05 01:00:04.187372+00:00, run_duration=0.392823, state=success, executor_state=success, try_number=1, max_tries=1, job_id=671, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:00:00.827702+00:00, queued_by_job_id=1, pid=9809 2024-04-05T01:00:04.420573928Z [2024-04-05T01:00:04.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:59:00+00:00, map_index=-1, run_start_date=2024-04-05 01:00:02.812331+00:00, run_end_date=2024-04-05 01:00:03.307159+00:00, run_duration=0.494828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=669, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:00:00.827702+00:00, queued_by_job_id=1, pid=9781 2024-04-05T01:00:04.420845628Z [2024-04-05T01:00:04.420+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ab2a54e-c95a-4795-8a12-e6ef5a16aa7e 2024-04-05T01:00:05.770669419Z [2024-04-05T01:00:05.770+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:00:05.770927495Z [2024-04-05T01:00:05.770+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:59:00+00:00, run_id=scheduled__2024-04-05T00:59:00+00:00, run_start_date=2024-04-05 01:00:00.727401+00:00, run_end_date=2024-04-05 01:00:05.770498+00:00, run_duration=5.043097, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:59:00+00:00, data_interval_end=2024-04-05 01:00:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:00:05.787135978Z [2024-04-05T01:00:05.786+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:00:00+00:00, run_after=2024-04-05T01:01:00+00:00 2024-04-05T01:00:05.860761787Z [2024-04-05T01:00:05.860+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:59:00+00:00 exited with status success for try_number 1 2024-04-05T01:00:05.867326413Z [2024-04-05T01:00:05.866+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:59:00+00:00, map_index=-1, run_start_date=2024-04-05 01:00:03.396670+00:00, run_end_date=2024-04-05 01:00:04.743311+00:00, run_duration=1.346641, state=success, executor_state=success, try_number=1, max_tries=1, job_id=670, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:00:00.827702+00:00, queued_by_job_id=1, pid=9793 2024-04-05T01:00:06.920577317Z [2024-04-05T01:00:06.920+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:00:06.920888044Z [2024-04-05T01:00:06.920+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:59:00+00:00, run_id=scheduled__2024-04-05T00:59:00+00:00, run_start_date=2024-04-05 01:00:00.728747+00:00, run_end_date=2024-04-05 01:00:06.920500+00:00, run_duration=6.191753, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:59:00+00:00, data_interval_end=2024-04-05 01:00:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:00:06.932048859Z [2024-04-05T01:00:06.931+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:00:00+00:00, run_after=2024-04-05T01:01:00+00:00 2024-04-05T01:00:06.972140361Z [2024-04-05T01:00:06.971+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:00:06.972185850Z 2024-04-05T01:00:06.972233522Z [2024-04-05T01:00:06.972+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:00:06.973052687Z [2024-04-05T01:00:06.972+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:00:06.973077502Z 2024-04-05T01:00:06.976371459Z [2024-04-05T01:00:06.975+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T00:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:00:06.976485456Z [2024-04-05T01:00:06.976+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:00:07.029850648Z [2024-04-05T01:00:07.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:55:00+00:00 exited with status queued for try_number 1 2024-04-05T01:00:07.029899613Z [2024-04-05T01:00:07.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T00:59:00+00:00 exited with status success for try_number 1 2024-04-05T01:00:07.030047779Z [2024-04-05T01:00:07.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T00:55:00+00:00 exited with status success for try_number 1 2024-04-05T01:00:07.039028497Z [2024-04-05T01:00:07.038+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T00:59:00+00:00, map_index=-1, run_start_date=2024-04-05 01:00:04.018854+00:00, run_end_date=2024-04-05 01:00:05.874300+00:00, run_duration=1.855446, state=success, executor_state=success, try_number=1, max_tries=1, job_id=672, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:00:00.827702+00:00, queued_by_job_id=1, pid=9810 2024-04-05T01:00:07.039274491Z [2024-04-05T01:00:07.039+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T00:55:00+00:00, map_index=-1, run_start_date=2024-04-05 01:00:06.220305+00:00, run_end_date=2024-04-05 01:00:06.588557+00:00, run_duration=0.368252, state=success, executor_state=success, try_number=1, max_tries=1, job_id=673, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:00:04.334700+00:00, queued_by_job_id=1, pid=9828 2024-04-05T01:00:07.039506010Z [2024-04-05T01:00:07.039+0000] {scheduler_job.py:635} INFO - Setting external_id for to b023b82e-3ee8-41ce-8fee-540d2f3e2a10 2024-04-05T01:00:08.944073572Z [2024-04-05T01:00:08.943+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:00:08.944102315Z 2024-04-05T01:00:08.944115223Z [2024-04-05T01:00:08.943+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:00:08.944606274Z [2024-04-05T01:00:08.944+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:00:08.944613899Z 2024-04-05T01:00:08.947799149Z [2024-04-05T01:00:08.947+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T00:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:00:08.947880497Z [2024-04-05T01:00:08.947+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:00:09.032792945Z [2024-04-05T01:00:09.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:55:00+00:00 exited with status queued for try_number 1 2024-04-05T01:00:09.033408872Z [2024-04-05T01:00:09.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T00:55:00+00:00 exited with status success for try_number 1 2024-04-05T01:00:09.045434864Z [2024-04-05T01:00:09.045+0000] {scheduler_job.py:635} INFO - Setting external_id for to 063a3c22-7a74-429c-a8ed-452dca1e86af 2024-04-05T01:00:09.045622824Z [2024-04-05T01:00:09.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T00:55:00+00:00, map_index=0, run_start_date=2024-04-05 01:00:08.556630+00:00, run_end_date=2024-04-05 01:00:08.878366+00:00, run_duration=0.321736, state=success, executor_state=success, try_number=1, max_tries=1, job_id=674, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:00:06.973482+00:00, queued_by_job_id=1, pid=9836 2024-04-05T01:00:11.971595433Z [2024-04-05T01:00:11.971+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:00:11.971933905Z [2024-04-05T01:00:11.971+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 00:55:00+00:00, run_id=scheduled__2024-04-05T00:55:00+00:00, run_start_date=2024-04-05 01:00:00.723084+00:00, run_end_date=2024-04-05 01:00:11.971477+00:00, run_duration=11.248393, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 00:55:00+00:00, data_interval_end=2024-04-05 01:00:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T01:00:12.008697226Z [2024-04-05T01:00:12.007+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:00:00+00:00, run_after=2024-04-05T01:05:00+00:00 2024-04-05T01:00:12.060903472Z [2024-04-05T01:00:12.060+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T00:55:00+00:00 exited with status success for try_number 1 2024-04-05T01:00:12.068518988Z [2024-04-05T01:00:12.068+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T00:55:00+00:00, map_index=-1, run_start_date=2024-04-05 01:00:10.754856+00:00, run_end_date=2024-04-05 01:00:11.191510+00:00, run_duration=0.436654, state=success, executor_state=success, try_number=1, max_tries=1, job_id=675, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:00:08.945009+00:00, queued_by_job_id=1, pid=9854 2024-04-05T01:00:40.851924722Z [2024-04-05T01:00:40.851+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T01:01:00.297179663Z [2024-04-05T01:01:00.296+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:01:00.309534494Z [2024-04-05T01:01:00.309+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:01:00+00:00, run_after=2024-04-05T01:02:00+00:00 2024-04-05T01:01:00.322762356Z [2024-04-05T01:01:00.322+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:01:00+00:00, run_after=2024-04-05T01:02:00+00:00 2024-04-05T01:01:00.424584351Z [2024-04-05T01:01:00.424+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:01:00.424639429Z 2024-04-05T01:01:00.424645223Z 2024-04-05T01:01:00.424648994Z 2024-04-05T01:01:00.424672856Z [2024-04-05T01:01:00.424+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:01:00.424787884Z [2024-04-05T01:01:00.424+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:01:00.424917187Z [2024-04-05T01:01:00.424+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:01:00.425565532Z [2024-04-05T01:01:00.425+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:01:00.425582516Z 2024-04-05T01:01:00.425586721Z 2024-04-05T01:01:00.425591545Z 2024-04-05T01:01:00.428790829Z [2024-04-05T01:01:00.428+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:01:00.428926723Z [2024-04-05T01:01:00.428+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:01:00.429178104Z [2024-04-05T01:01:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:01:00.429309383Z [2024-04-05T01:01:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:01:00.429556823Z [2024-04-05T01:01:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:01:00.429656425Z [2024-04-05T01:01:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:01:01.157979854Z [2024-04-05T01:01:01.157+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:00:00+00:00 exited with status queued for try_number 1 2024-04-05T01:01:01.158869867Z [2024-04-05T01:01:01.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:00:00+00:00 exited with status queued for try_number 1 2024-04-05T01:01:01.158886064Z [2024-04-05T01:01:01.158+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:00:00+00:00 exited with status queued for try_number 1 2024-04-05T01:01:01.196353801Z [2024-04-05T01:01:01.192+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab45861e-5d43-4400-89a3-f630e49fe9eb 2024-04-05T01:01:01.196375872Z [2024-04-05T01:01:01.193+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd29fff5-c53d-4bd3-81a3-af1e6cf3f924 2024-04-05T01:01:01.196379332Z [2024-04-05T01:01:01.193+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5a514bf8-5fda-45bc-adbe-290ca275d390 2024-04-05T01:01:03.774149828Z [2024-04-05T01:01:03.773+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:01:03.774350696Z [2024-04-05T01:01:03.774+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:00:00+00:00, run_id=scheduled__2024-04-05T01:00:00+00:00, run_start_date=2024-04-05 01:01:00.335657+00:00, run_end_date=2024-04-05 01:01:03.773997+00:00, run_duration=3.43834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:00:00+00:00, data_interval_end=2024-04-05 01:01:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:01:03.785643927Z [2024-04-05T01:01:03.785+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:01:00+00:00, run_after=2024-04-05T01:02:00+00:00 2024-04-05T01:01:03.842096959Z [2024-04-05T01:01:03.841+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:00:00+00:00 exited with status success for try_number 1 2024-04-05T01:01:03.850469277Z [2024-04-05T01:01:03.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:00:00+00:00, map_index=-1, run_start_date=2024-04-05 01:01:02.101600+00:00, run_end_date=2024-04-05 01:01:02.827807+00:00, run_duration=0.726207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=676, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:01:00.426301+00:00, queued_by_job_id=1, pid=9866 2024-04-05T01:01:06.039677014Z [2024-04-05T01:01:06.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:01:06.039968286Z [2024-04-05T01:01:06.039+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:00:00+00:00, run_id=scheduled__2024-04-05T01:00:00+00:00, run_start_date=2024-04-05 01:01:00.338136+00:00, run_end_date=2024-04-05 01:01:06.039680+00:00, run_duration=5.701544, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:00:00+00:00, data_interval_end=2024-04-05 01:01:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:01:06.059627069Z [2024-04-05T01:01:06.058+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:01:00+00:00, run_after=2024-04-05T01:02:00+00:00 2024-04-05T01:01:06.066680506Z [2024-04-05T01:01:06.065+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:01:06.066707711Z [2024-04-05T01:01:06.066+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:00:00+00:00, run_id=scheduled__2024-04-05T01:00:00+00:00, run_start_date=2024-04-05 01:01:00.337038+00:00, run_end_date=2024-04-05 01:01:06.065923+00:00, run_duration=5.728885, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:00:00+00:00, data_interval_end=2024-04-05 01:01:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:01:06.076025560Z [2024-04-05T01:01:06.075+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:01:00+00:00, run_after=2024-04-05T01:02:00+00:00 2024-04-05T01:01:06.114115297Z [2024-04-05T01:01:06.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:00:00+00:00 exited with status success for try_number 1 2024-04-05T01:01:06.114142581Z [2024-04-05T01:01:06.112+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:00:00+00:00 exited with status success for try_number 1 2024-04-05T01:01:06.120025091Z [2024-04-05T01:01:06.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:00:00+00:00, map_index=-1, run_start_date=2024-04-05 01:01:03.724068+00:00, run_end_date=2024-04-05 01:01:05.664413+00:00, run_duration=1.940345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=678, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:01:00.426301+00:00, queued_by_job_id=1, pid=9890 2024-04-05T01:01:06.120131708Z [2024-04-05T01:01:06.119+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:00:00+00:00, map_index=-1, run_start_date=2024-04-05 01:01:03.266864+00:00, run_end_date=2024-04-05 01:01:05.742240+00:00, run_duration=2.475376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=677, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:01:00.426301+00:00, queued_by_job_id=1, pid=9879 2024-04-05T01:02:00.625331064Z [2024-04-05T01:02:00.624+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:02:00.640824878Z [2024-04-05T01:02:00.640+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:02:00+00:00, run_after=2024-04-05T01:03:00+00:00 2024-04-05T01:02:00.649803796Z [2024-04-05T01:02:00.649+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:02:00.667046823Z [2024-04-05T01:02:00.666+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:02:00+00:00, run_after=2024-04-05T01:03:00+00:00 2024-04-05T01:02:00.755097936Z [2024-04-05T01:02:00.754+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:02:00.755121471Z 2024-04-05T01:02:00.755125755Z 2024-04-05T01:02:00.755129349Z 2024-04-05T01:02:00.755132604Z 2024-04-05T01:02:00.755347986Z [2024-04-05T01:02:00.755+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:02:00.755505902Z [2024-04-05T01:02:00.755+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:02:00.755671991Z [2024-04-05T01:02:00.755+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:02:00.755730512Z [2024-04-05T01:02:00.755+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:02:00.756341618Z [2024-04-05T01:02:00.756+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:02:00.756352428Z 2024-04-05T01:02:00.756356515Z 2024-04-05T01:02:00.756373831Z 2024-04-05T01:02:00.756377164Z 2024-04-05T01:02:00.763158516Z [2024-04-05T01:02:00.762+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:02:00.763289030Z [2024-04-05T01:02:00.763+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:02:00.763908770Z [2024-04-05T01:02:00.763+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:02:00.764154576Z [2024-04-05T01:02:00.763+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:02:00.764477672Z [2024-04-05T01:02:00.764+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:02:00.764643656Z [2024-04-05T01:02:00.764+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:02:00.764910258Z [2024-04-05T01:02:00.764+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:02:00.765191395Z [2024-04-05T01:02:00.764+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:02:01.191697521Z [2024-04-05T01:02:01.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:00:00+00:00 exited with status queued for try_number 1 2024-04-05T01:02:01.191721851Z [2024-04-05T01:02:01.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:01:00+00:00 exited with status queued for try_number 1 2024-04-05T01:02:01.191725605Z [2024-04-05T01:02:01.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:01:00+00:00 exited with status queued for try_number 1 2024-04-05T01:02:01.191728886Z [2024-04-05T01:02:01.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:01:00+00:00 exited with status queued for try_number 1 2024-04-05T01:02:01.195211764Z [2024-04-05T01:02:01.191+0000] {scheduler_job.py:635} INFO - Setting external_id for to 536cc9b8-6ed5-483f-b7fe-6f4ae1321d5f 2024-04-05T01:02:01.195224702Z [2024-04-05T01:02:01.192+0000] {scheduler_job.py:635} INFO - Setting external_id for to cad18f8b-5eb4-4991-9847-5ebf433e1703 2024-04-05T01:02:01.195229064Z [2024-04-05T01:02:01.192+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3f85759f-9f9d-4014-9b4e-d2d1f378ab85 2024-04-05T01:02:01.195232340Z [2024-04-05T01:02:01.193+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf609997-329f-46b9-93c0-ac63c8a7a195 2024-04-05T01:02:03.353456692Z [2024-04-05T01:02:03.352+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:02:03.353761283Z [2024-04-05T01:02:03.353+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:00:00+00:00, run_id=scheduled__2024-04-05T01:00:00+00:00, run_start_date=2024-04-05 01:02:00.680202+00:00, run_end_date=2024-04-05 01:02:03.353396+00:00, run_duration=2.673194, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:00:00+00:00, data_interval_end=2024-04-05 01:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:02:03.363623053Z [2024-04-05T01:02:03.363+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:02:00+00:00, run_after=2024-04-05T01:04:00+00:00 2024-04-05T01:02:03.371809976Z [2024-04-05T01:02:03.371+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:02:03.372030475Z [2024-04-05T01:02:03.371+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:01:00+00:00, run_id=scheduled__2024-04-05T01:01:00+00:00, run_start_date=2024-04-05 01:02:00.681645+00:00, run_end_date=2024-04-05 01:02:03.371739+00:00, run_duration=2.690094, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:01:00+00:00, data_interval_end=2024-04-05 01:02:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:02:03.386291719Z [2024-04-05T01:02:03.385+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:02:00+00:00, run_after=2024-04-05T01:03:00+00:00 2024-04-05T01:02:03.442288402Z [2024-04-05T01:02:03.441+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:00:00+00:00 exited with status success for try_number 1 2024-04-05T01:02:03.442395919Z [2024-04-05T01:02:03.442+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:01:00+00:00 exited with status success for try_number 1 2024-04-05T01:02:03.449801950Z [2024-04-05T01:02:03.449+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:00:00+00:00, map_index=-1, run_start_date=2024-04-05 01:02:02.187055+00:00, run_end_date=2024-04-05 01:02:02.783100+00:00, run_duration=0.596045, state=success, executor_state=success, try_number=1, max_tries=1, job_id=679, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:02:00.757416+00:00, queued_by_job_id=1, pid=9912 2024-04-05T01:02:03.450069329Z [2024-04-05T01:02:03.449+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:01:00+00:00, map_index=-1, run_start_date=2024-04-05 01:02:02.676910+00:00, run_end_date=2024-04-05 01:02:03.144143+00:00, run_duration=0.467233, state=success, executor_state=success, try_number=1, max_tries=1, job_id=680, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:02:00.757416+00:00, queued_by_job_id=1, pid=9923 2024-04-05T01:02:05.589973136Z [2024-04-05T01:02:05.589+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:02:05.590842648Z [2024-04-05T01:02:05.590+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:01:00+00:00, run_id=scheduled__2024-04-05T01:01:00+00:00, run_start_date=2024-04-05 01:02:00.682784+00:00, run_end_date=2024-04-05 01:02:05.589843+00:00, run_duration=4.907059, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:01:00+00:00, data_interval_end=2024-04-05 01:02:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:02:05.608312581Z [2024-04-05T01:02:05.607+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:02:00+00:00, run_after=2024-04-05T01:03:00+00:00 2024-04-05T01:02:05.655018269Z [2024-04-05T01:02:05.654+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:01:00+00:00 exited with status success for try_number 1 2024-04-05T01:02:05.662465558Z [2024-04-05T01:02:05.661+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:01:00+00:00, map_index=-1, run_start_date=2024-04-05 01:02:03.908199+00:00, run_end_date=2024-04-05 01:02:05.473729+00:00, run_duration=1.56553, state=success, executor_state=success, try_number=1, max_tries=1, job_id=681, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:02:00.757416+00:00, queued_by_job_id=1, pid=9936 2024-04-05T01:02:06.699246948Z [2024-04-05T01:02:06.698+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:02:06.699643018Z [2024-04-05T01:02:06.699+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:01:00+00:00, run_id=scheduled__2024-04-05T01:01:00+00:00, run_start_date=2024-04-05 01:02:00.684155+00:00, run_end_date=2024-04-05 01:02:06.699072+00:00, run_duration=6.014917, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:01:00+00:00, data_interval_end=2024-04-05 01:02:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:02:06.709707271Z [2024-04-05T01:02:06.709+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:02:00+00:00, run_after=2024-04-05T01:03:00+00:00 2024-04-05T01:02:06.745931955Z [2024-04-05T01:02:06.745+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:01:00+00:00 exited with status success for try_number 1 2024-04-05T01:02:06.757046552Z [2024-04-05T01:02:06.756+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:01:00+00:00, map_index=-1, run_start_date=2024-04-05 01:02:04.234591+00:00, run_end_date=2024-04-05 01:02:06.270614+00:00, run_duration=2.036023, state=success, executor_state=success, try_number=1, max_tries=1, job_id=682, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:02:00.757416+00:00, queued_by_job_id=1, pid=9947 2024-04-05T01:03:00.937687485Z [2024-04-05T01:03:00.937+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:03:00.957367840Z [2024-04-05T01:03:00.956+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:03:00+00:00, run_after=2024-04-05T01:04:00+00:00 2024-04-05T01:03:00.976348230Z [2024-04-05T01:03:00.975+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:03:00+00:00, run_after=2024-04-05T01:04:00+00:00 2024-04-05T01:03:01.083870613Z [2024-04-05T01:03:01.083+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:03:01.083912424Z 2024-04-05T01:03:01.083916750Z 2024-04-05T01:03:01.083920362Z 2024-04-05T01:03:01.084487304Z [2024-04-05T01:03:01.084+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:03:01.085002243Z [2024-04-05T01:03:01.084+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:03:01.085419296Z [2024-04-05T01:03:01.085+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:03:01.088483980Z [2024-04-05T01:03:01.088+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:03:01.088523464Z 2024-04-05T01:03:01.088529982Z 2024-04-05T01:03:01.088547236Z 2024-04-05T01:03:01.095277429Z [2024-04-05T01:03:01.094+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:03:01.095893484Z [2024-04-05T01:03:01.095+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:03:01.096500694Z [2024-04-05T01:03:01.096+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:03:01.096843342Z [2024-04-05T01:03:01.096+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:03:01.097274559Z [2024-04-05T01:03:01.097+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:03:01.097531307Z [2024-04-05T01:03:01.097+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:03:01.622017169Z [2024-04-05T01:03:01.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:02:00+00:00 exited with status queued for try_number 1 2024-04-05T01:03:01.622360190Z [2024-04-05T01:03:01.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:02:00+00:00 exited with status queued for try_number 1 2024-04-05T01:03:01.622581482Z [2024-04-05T01:03:01.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:02:00+00:00 exited with status queued for try_number 1 2024-04-05T01:03:01.638880073Z [2024-04-05T01:03:01.638+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e461e00-23bb-453f-bce9-8bc3abfa7cb8 2024-04-05T01:03:01.640012074Z [2024-04-05T01:03:01.639+0000] {scheduler_job.py:635} INFO - Setting external_id for to e86244d6-0a5b-4b0e-8175-f41f3daef7a6 2024-04-05T01:03:01.640442703Z [2024-04-05T01:03:01.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b593a21-ab84-4c65-b303-89086845d9fe 2024-04-05T01:03:02.916870371Z [2024-04-05T01:03:02.916+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:03:02.917340157Z [2024-04-05T01:03:02.917+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:02:00+00:00, run_id=scheduled__2024-04-05T01:02:00+00:00, run_start_date=2024-04-05 01:03:00.995474+00:00, run_end_date=2024-04-05 01:03:02.916680+00:00, run_duration=1.921206, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:02:00+00:00, data_interval_end=2024-04-05 01:03:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:03:02.930436681Z [2024-04-05T01:03:02.930+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:03:00+00:00, run_after=2024-04-05T01:04:00+00:00 2024-04-05T01:03:04.145550783Z [2024-04-05T01:03:04.144+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:02:00+00:00 exited with status success for try_number 1 2024-04-05T01:03:04.159093295Z [2024-04-05T01:03:04.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:02:00+00:00, map_index=-1, run_start_date=2024-04-05 01:03:02.303192+00:00, run_end_date=2024-04-05 01:03:02.831874+00:00, run_duration=0.528682, state=success, executor_state=success, try_number=1, max_tries=1, job_id=683, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:03:01.090984+00:00, queued_by_job_id=1, pid=9974 2024-04-05T01:03:06.311956524Z [2024-04-05T01:03:06.311+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:03:06.312304598Z [2024-04-05T01:03:06.312+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:02:00+00:00, run_id=scheduled__2024-04-05T01:02:00+00:00, run_start_date=2024-04-05 01:03:00.998344+00:00, run_end_date=2024-04-05 01:03:06.311876+00:00, run_duration=5.313532, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:02:00+00:00, data_interval_end=2024-04-05 01:03:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:03:06.325663174Z [2024-04-05T01:03:06.323+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:03:00+00:00, run_after=2024-04-05T01:04:00+00:00 2024-04-05T01:03:06.370101966Z [2024-04-05T01:03:06.369+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:02:00+00:00 exited with status success for try_number 1 2024-04-05T01:03:06.377357066Z [2024-04-05T01:03:06.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:02:00+00:00, map_index=-1, run_start_date=2024-04-05 01:03:03.637680+00:00, run_end_date=2024-04-05 01:03:05.789947+00:00, run_duration=2.152267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=684, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:03:01.090984+00:00, queued_by_job_id=1, pid=9992 2024-04-05T01:03:07.417812049Z [2024-04-05T01:03:07.417+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:03:07.418123345Z [2024-04-05T01:03:07.417+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:02:00+00:00, run_id=scheduled__2024-04-05T01:02:00+00:00, run_start_date=2024-04-05 01:03:01.001169+00:00, run_end_date=2024-04-05 01:03:07.417733+00:00, run_duration=6.416564, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:02:00+00:00, data_interval_end=2024-04-05 01:03:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:03:07.431910292Z [2024-04-05T01:03:07.431+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:03:00+00:00, run_after=2024-04-05T01:04:00+00:00 2024-04-05T01:03:07.468434891Z [2024-04-05T01:03:07.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:02:00+00:00 exited with status success for try_number 1 2024-04-05T01:03:07.474621111Z [2024-04-05T01:03:07.474+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:02:00+00:00, map_index=-1, run_start_date=2024-04-05 01:03:03.838658+00:00, run_end_date=2024-04-05 01:03:06.689156+00:00, run_duration=2.850498, state=success, executor_state=success, try_number=1, max_tries=1, job_id=685, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:03:01.090984+00:00, queued_by_job_id=1, pid=9993 2024-04-05T01:04:00.235483684Z [2024-04-05T01:04:00.234+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:04:00+00:00, run_after=2024-04-05T01:05:00+00:00 2024-04-05T01:04:00.251155790Z [2024-04-05T01:04:00.250+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:04:00.282430035Z [2024-04-05T01:04:00.282+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:04:00+00:00, run_after=2024-04-05T01:05:00+00:00 2024-04-05T01:04:00.291160464Z [2024-04-05T01:04:00.290+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:04:00.384618857Z [2024-04-05T01:04:00.384+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:04:00.384651753Z 2024-04-05T01:04:00.384659859Z 2024-04-05T01:04:00.384666585Z 2024-04-05T01:04:00.384673096Z 2024-04-05T01:04:00.384762362Z [2024-04-05T01:04:00.384+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:04:00.385065523Z [2024-04-05T01:04:00.384+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:04:00.385186681Z [2024-04-05T01:04:00.385+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:04:00.385375740Z [2024-04-05T01:04:00.385+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:04:00.386039798Z [2024-04-05T01:04:00.385+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:04:00.386054189Z 2024-04-05T01:04:00.386058250Z 2024-04-05T01:04:00.386061514Z 2024-04-05T01:04:00.386064664Z 2024-04-05T01:04:00.390002600Z [2024-04-05T01:04:00.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:04:00.390249085Z [2024-04-05T01:04:00.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:04:00.390658075Z [2024-04-05T01:04:00.390+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:04:00.390871873Z [2024-04-05T01:04:00.390+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:04:00.391162675Z [2024-04-05T01:04:00.391+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:04:00.391408353Z [2024-04-05T01:04:00.391+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:04:00.392292730Z [2024-04-05T01:04:00.392+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:04:00.392518179Z [2024-04-05T01:04:00.392+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:04:00.886538654Z [2024-04-05T01:04:00.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:02:00+00:00 exited with status queued for try_number 1 2024-04-05T01:04:00.891874734Z [2024-04-05T01:04:00.886+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:03:00+00:00 exited with status queued for try_number 1 2024-04-05T01:04:00.892209554Z [2024-04-05T01:04:00.891+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:03:00+00:00 exited with status queued for try_number 1 2024-04-05T01:04:00.892400103Z [2024-04-05T01:04:00.892+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:03:00+00:00 exited with status queued for try_number 1 2024-04-05T01:04:00.912964917Z [2024-04-05T01:04:00.912+0000] {scheduler_job.py:635} INFO - Setting external_id for to 35d902ac-ec70-48a8-baa3-0ec89c25197a 2024-04-05T01:04:00.915926039Z [2024-04-05T01:04:00.915+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6844311f-9762-4a54-a569-54752a2db490 2024-04-05T01:04:00.928118516Z [2024-04-05T01:04:00.927+0000] {scheduler_job.py:635} INFO - Setting external_id for to d42eaa56-a047-4804-a4e6-6b6553dbe5d0 2024-04-05T01:04:00.933715559Z [2024-04-05T01:04:00.933+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0ee9d10-9dc2-4189-a577-63b52f419bd7 2024-04-05T01:04:03.336408304Z [2024-04-05T01:04:03.335+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:04:03.336875859Z [2024-04-05T01:04:03.336+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:02:00+00:00, run_id=scheduled__2024-04-05T01:02:00+00:00, run_start_date=2024-04-05 01:04:00.303530+00:00, run_end_date=2024-04-05 01:04:03.336301+00:00, run_duration=3.032771, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:02:00+00:00, data_interval_end=2024-04-05 01:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:04:03.357381441Z [2024-04-05T01:04:03.357+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:04:00+00:00, run_after=2024-04-05T01:06:00+00:00 2024-04-05T01:04:03.370386833Z [2024-04-05T01:04:03.369+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:04:03.371427526Z [2024-04-05T01:04:03.370+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:03:00+00:00, run_id=scheduled__2024-04-05T01:03:00+00:00, run_start_date=2024-04-05 01:04:00.305040+00:00, run_end_date=2024-04-05 01:04:03.370286+00:00, run_duration=3.065246, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:03:00+00:00, data_interval_end=2024-04-05 01:04:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:04:03.389101473Z [2024-04-05T01:04:03.388+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:04:00+00:00, run_after=2024-04-05T01:05:00+00:00 2024-04-05T01:04:03.496619661Z [2024-04-05T01:04:03.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:02:00+00:00 exited with status success for try_number 1 2024-04-05T01:04:03.496989375Z [2024-04-05T01:04:03.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:03:00+00:00 exited with status success for try_number 1 2024-04-05T01:04:03.510572716Z [2024-04-05T01:04:03.510+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:02:00+00:00, map_index=-1, run_start_date=2024-04-05 01:04:02.104127+00:00, run_end_date=2024-04-05 01:04:02.623165+00:00, run_duration=0.519038, state=success, executor_state=success, try_number=1, max_tries=1, job_id=686, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:04:00.386992+00:00, queued_by_job_id=1, pid=10024 2024-04-05T01:04:03.511065783Z [2024-04-05T01:04:03.510+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:03:00+00:00, map_index=-1, run_start_date=2024-04-05 01:04:02.477710+00:00, run_end_date=2024-04-05 01:04:03.033065+00:00, run_duration=0.555355, state=success, executor_state=success, try_number=1, max_tries=1, job_id=687, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:04:00.386992+00:00, queued_by_job_id=1, pid=10031 2024-04-05T01:04:04.860987679Z [2024-04-05T01:04:04.860+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:04:04.861128893Z [2024-04-05T01:04:04.860+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:03:00+00:00, run_id=scheduled__2024-04-05T01:03:00+00:00, run_start_date=2024-04-05 01:04:00.306043+00:00, run_end_date=2024-04-05 01:04:04.860762+00:00, run_duration=4.554719, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:03:00+00:00, data_interval_end=2024-04-05 01:04:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:04:04.871668445Z [2024-04-05T01:04:04.871+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:04:00+00:00, run_after=2024-04-05T01:05:00+00:00 2024-04-05T01:04:04.914493488Z [2024-04-05T01:04:04.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:03:00+00:00 exited with status success for try_number 1 2024-04-05T01:04:04.921795433Z [2024-04-05T01:04:04.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:03:00+00:00, map_index=-1, run_start_date=2024-04-05 01:04:03.154650+00:00, run_end_date=2024-04-05 01:04:04.560455+00:00, run_duration=1.405805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=688, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:04:00.386992+00:00, queued_by_job_id=1, pid=10045 2024-04-05T01:04:05.961030478Z [2024-04-05T01:04:05.960+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:04:05.961351062Z [2024-04-05T01:04:05.961+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:03:00+00:00, run_id=scheduled__2024-04-05T01:03:00+00:00, run_start_date=2024-04-05 01:04:00.306965+00:00, run_end_date=2024-04-05 01:04:05.960943+00:00, run_duration=5.653978, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:03:00+00:00, data_interval_end=2024-04-05 01:04:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:04:05.970623373Z [2024-04-05T01:04:05.970+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:04:00+00:00, run_after=2024-04-05T01:05:00+00:00 2024-04-05T01:04:06.017579024Z [2024-04-05T01:04:06.015+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:03:00+00:00 exited with status success for try_number 1 2024-04-05T01:04:06.022671365Z [2024-04-05T01:04:06.022+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:03:00+00:00, map_index=-1, run_start_date=2024-04-05 01:04:03.579003+00:00, run_end_date=2024-04-05 01:04:05.261610+00:00, run_duration=1.682607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=689, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:04:00.386992+00:00, queued_by_job_id=1, pid=10056 2024-04-05T01:05:00.566158902Z [2024-04-05T01:05:00.565+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:05:00.578508963Z [2024-04-05T01:05:00.578+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:05:00+00:00, run_after=2024-04-05T01:10:00+00:00 2024-04-05T01:05:00.593671301Z [2024-04-05T01:05:00.593+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:05:00+00:00, run_after=2024-04-05T01:06:00+00:00 2024-04-05T01:05:00.612949967Z [2024-04-05T01:05:00.612+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:05:00+00:00, run_after=2024-04-05T01:06:00+00:00 2024-04-05T01:05:00.694621731Z [2024-04-05T01:05:00.694+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:05:00.694648783Z 2024-04-05T01:05:00.694653459Z 2024-04-05T01:05:00.694658452Z 2024-04-05T01:05:00.694663171Z 2024-04-05T01:05:00.695034499Z [2024-04-05T01:05:00.694+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:05:00.695304441Z [2024-04-05T01:05:00.695+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:05:00.695621826Z [2024-04-05T01:05:00.695+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:05:00.695876520Z [2024-04-05T01:05:00.695+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:05:00.696724219Z [2024-04-05T01:05:00.696+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:05:00.696737610Z 2024-04-05T01:05:00.696741516Z 2024-04-05T01:05:00.696744832Z 2024-04-05T01:05:00.696748182Z 2024-04-05T01:05:00.701410086Z [2024-04-05T01:05:00.701+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:05:00.701783113Z [2024-04-05T01:05:00.701+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:05:00.702219432Z [2024-04-05T01:05:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:05:00.702533056Z [2024-04-05T01:05:00.702+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:05:00.702936523Z [2024-04-05T01:05:00.702+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:05:00.703265984Z [2024-04-05T01:05:00.703+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:05:00.703658569Z [2024-04-05T01:05:00.703+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:05:00.703894905Z [2024-04-05T01:05:00.703+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:05:01.340638049Z [2024-04-05T01:05:01.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:00:00+00:00 exited with status queued for try_number 1 2024-04-05T01:05:01.340735869Z [2024-04-05T01:05:01.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:04:00+00:00 exited with status queued for try_number 1 2024-04-05T01:05:01.340777832Z [2024-04-05T01:05:01.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:04:00+00:00 exited with status queued for try_number 1 2024-04-05T01:05:01.340889018Z [2024-04-05T01:05:01.340+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:04:00+00:00 exited with status queued for try_number 1 2024-04-05T01:05:01.364965203Z [2024-04-05T01:05:01.364+0000] {scheduler_job.py:635} INFO - Setting external_id for to 46f06c85-9cf9-4be7-96c6-290927fc5e70 2024-04-05T01:05:01.365611431Z [2024-04-05T01:05:01.364+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce2e6771-7317-4e89-a2bf-9ef9f9acfd78 2024-04-05T01:05:01.365967350Z [2024-04-05T01:05:01.365+0000] {scheduler_job.py:635} INFO - Setting external_id for to 314cdcfc-862c-41e0-b888-294755777bef 2024-04-05T01:05:01.366104832Z [2024-04-05T01:05:01.365+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc3da360-d841-4b86-a051-955463138a07 2024-04-05T01:05:02.716246723Z [2024-04-05T01:05:02.709+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:05:02.716389180Z [2024-04-05T01:05:02.710+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:04:00+00:00, run_id=scheduled__2024-04-05T01:04:00+00:00, run_start_date=2024-04-05 01:05:00.627189+00:00, run_end_date=2024-04-05 01:05:02.709790+00:00, run_duration=2.082601, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:04:00+00:00, data_interval_end=2024-04-05 01:05:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:05:02.727189805Z [2024-04-05T01:05:02.726+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:05:00+00:00, run_after=2024-04-05T01:06:00+00:00 2024-04-05T01:05:02.804093767Z [2024-04-05T01:05:02.803+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:04:00+00:00 exited with status success for try_number 1 2024-04-05T01:05:02.810970138Z [2024-04-05T01:05:02.810+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:04:00+00:00, map_index=-1, run_start_date=2024-04-05 01:05:01.901679+00:00, run_end_date=2024-04-05 01:05:02.318826+00:00, run_duration=0.417147, state=success, executor_state=success, try_number=1, max_tries=1, job_id=690, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:05:00.698169+00:00, queued_by_job_id=1, pid=10084 2024-04-05T01:05:03.906243837Z [2024-04-05T01:05:03.905+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:05:03.906272429Z 2024-04-05T01:05:03.906292545Z [2024-04-05T01:05:03.906+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:05:03.907032282Z [2024-04-05T01:05:03.906+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:05:03.907047160Z 2024-04-05T01:05:03.910098878Z [2024-04-05T01:05:03.909+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:05:03.910257387Z [2024-04-05T01:05:03.910+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:05:03.979124883Z [2024-04-05T01:05:03.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:00:00+00:00 exited with status queued for try_number 1 2024-04-05T01:05:03.981738660Z [2024-04-05T01:05:03.979+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:00:00+00:00 exited with status success for try_number 1 2024-04-05T01:05:03.996797603Z [2024-04-05T01:05:03.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to de386ec2-6aac-49db-92eb-e7f88ac57138 2024-04-05T01:05:03.997072997Z [2024-04-05T01:05:03.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:00:00+00:00, map_index=-1, run_start_date=2024-04-05 01:05:03.114160+00:00, run_end_date=2024-04-05 01:05:03.614735+00:00, run_duration=0.500575, state=success, executor_state=success, try_number=1, max_tries=1, job_id=691, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:05:00.698169+00:00, queued_by_job_id=1, pid=10103 2024-04-05T01:05:05.716637948Z [2024-04-05T01:05:05.716+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:05:05.716805562Z [2024-04-05T01:05:05.716+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:04:00+00:00, run_id=scheduled__2024-04-05T01:04:00+00:00, run_start_date=2024-04-05 01:05:00.628427+00:00, run_end_date=2024-04-05 01:05:05.716523+00:00, run_duration=5.088096, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:04:00+00:00, data_interval_end=2024-04-05 01:05:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:05:05.732643512Z [2024-04-05T01:05:05.732+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:05:00+00:00, run_after=2024-04-05T01:06:00+00:00 2024-04-05T01:05:05.792574299Z [2024-04-05T01:05:05.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:04:00+00:00 exited with status success for try_number 1 2024-04-05T01:05:05.801324706Z [2024-04-05T01:05:05.800+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:04:00+00:00, map_index=-1, run_start_date=2024-04-05 01:05:03.287864+00:00, run_end_date=2024-04-05 01:05:05.499815+00:00, run_duration=2.211951, state=success, executor_state=success, try_number=1, max_tries=1, job_id=692, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:05:00.698169+00:00, queued_by_job_id=1, pid=10109 2024-04-05T01:05:06.847643016Z [2024-04-05T01:05:06.847+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:05:06.848017045Z [2024-04-05T01:05:06.847+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:04:00+00:00, run_id=scheduled__2024-04-05T01:04:00+00:00, run_start_date=2024-04-05 01:05:00.629479+00:00, run_end_date=2024-04-05 01:05:06.847487+00:00, run_duration=6.218008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:04:00+00:00, data_interval_end=2024-04-05 01:05:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:05:06.857666550Z [2024-04-05T01:05:06.857+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:05:00+00:00, run_after=2024-04-05T01:06:00+00:00 2024-04-05T01:05:06.887766586Z [2024-04-05T01:05:06.887+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:05:06.887801448Z 2024-04-05T01:05:06.887887592Z [2024-04-05T01:05:06.887+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:05:06.888714360Z [2024-04-05T01:05:06.888+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:05:06.888727018Z 2024-04-05T01:05:06.891942504Z [2024-04-05T01:05:06.891+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:05:06.892203168Z [2024-04-05T01:05:06.891+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:05:06.948161064Z [2024-04-05T01:05:06.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:00:00+00:00 exited with status queued for try_number 1 2024-04-05T01:05:06.948365426Z [2024-04-05T01:05:06.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:04:00+00:00 exited with status success for try_number 1 2024-04-05T01:05:06.948588554Z [2024-04-05T01:05:06.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:00:00+00:00 exited with status success for try_number 1 2024-04-05T01:05:06.960906068Z [2024-04-05T01:05:06.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T01:00:00+00:00, map_index=-1, run_start_date=2024-04-05 01:05:05.510817+00:00, run_end_date=2024-04-05 01:05:05.837180+00:00, run_duration=0.326363, state=success, executor_state=success, try_number=1, max_tries=1, job_id=694, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:05:03.907454+00:00, queued_by_job_id=1, pid=10133 2024-04-05T01:05:06.961431631Z [2024-04-05T01:05:06.961+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:04:00+00:00, map_index=-1, run_start_date=2024-04-05 01:05:03.530323+00:00, run_end_date=2024-04-05 01:05:05.927225+00:00, run_duration=2.396902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=693, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:05:00.698169+00:00, queued_by_job_id=1, pid=10115 2024-04-05T01:05:06.961831261Z [2024-04-05T01:05:06.961+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6d4d9cc-6272-48a6-8a38-1fcdb20043c2 2024-04-05T01:05:09.344284932Z [2024-04-05T01:05:09.343+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:05:09.344339986Z 2024-04-05T01:05:09.344415274Z [2024-04-05T01:05:09.344+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:05:09.345264466Z [2024-04-05T01:05:09.345+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:05:09.345281767Z 2024-04-05T01:05:09.348189095Z [2024-04-05T01:05:09.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:05:09.348368857Z [2024-04-05T01:05:09.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:05:09.421670520Z [2024-04-05T01:05:09.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:00:00+00:00 exited with status queued for try_number 1 2024-04-05T01:05:09.422178915Z [2024-04-05T01:05:09.421+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:00:00+00:00 exited with status success for try_number 1 2024-04-05T01:05:09.428790383Z [2024-04-05T01:05:09.428+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1697f1e4-188d-4fe2-9e41-44bf2c72b0a0 2024-04-05T01:05:09.429260105Z [2024-04-05T01:05:09.428+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:00:00+00:00, map_index=0, run_start_date=2024-04-05 01:05:08.493504+00:00, run_end_date=2024-04-05 01:05:08.835131+00:00, run_duration=0.341627, state=success, executor_state=success, try_number=1, max_tries=1, job_id=695, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:05:06.889260+00:00, queued_by_job_id=1, pid=10141 2024-04-05T01:05:11.925996450Z [2024-04-05T01:05:11.925+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:05:11.926138657Z [2024-04-05T01:05:11.925+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:00:00+00:00, run_id=scheduled__2024-04-05T01:00:00+00:00, run_start_date=2024-04-05 01:05:00.625791+00:00, run_end_date=2024-04-05 01:05:11.925887+00:00, run_duration=11.300096, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:00:00+00:00, data_interval_end=2024-04-05 01:05:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T01:05:11.933025594Z [2024-04-05T01:05:11.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:05:00+00:00, run_after=2024-04-05T01:10:00+00:00 2024-04-05T01:05:11.965013916Z [2024-04-05T01:05:11.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:00:00+00:00 exited with status success for try_number 1 2024-04-05T01:05:11.971216117Z [2024-04-05T01:05:11.970+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:00:00+00:00, map_index=-1, run_start_date=2024-04-05 01:05:11.181288+00:00, run_end_date=2024-04-05 01:05:11.561336+00:00, run_duration=0.380048, state=success, executor_state=success, try_number=1, max_tries=1, job_id=696, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:05:09.345686+00:00, queued_by_job_id=1, pid=10159 2024-04-05T01:05:40.912774538Z [2024-04-05T01:05:40.912+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T01:06:00.390328677Z [2024-04-05T01:06:00.389+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:06:00+00:00, run_after=2024-04-05T01:07:00+00:00 2024-04-05T01:06:00.400184175Z [2024-04-05T01:06:00.399+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:06:00.413591731Z [2024-04-05T01:06:00.413+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:06:00.427381513Z [2024-04-05T01:06:00.427+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:06:00+00:00, run_after=2024-04-05T01:07:00+00:00 2024-04-05T01:06:00.512440848Z [2024-04-05T01:06:00.512+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:06:00.512467215Z 2024-04-05T01:06:00.512471232Z 2024-04-05T01:06:00.512487221Z 2024-04-05T01:06:00.512490637Z 2024-04-05T01:06:00.512703960Z [2024-04-05T01:06:00.512+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:06:00.512908960Z [2024-04-05T01:06:00.512+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:06:00.513102385Z [2024-04-05T01:06:00.512+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:06:00.513270256Z [2024-04-05T01:06:00.513+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:06:00.514049929Z [2024-04-05T01:06:00.513+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:06:00.514062822Z 2024-04-05T01:06:00.514066611Z 2024-04-05T01:06:00.514069737Z 2024-04-05T01:06:00.514073069Z 2024-04-05T01:06:00.518740594Z [2024-04-05T01:06:00.518+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:06:00.518876127Z [2024-04-05T01:06:00.518+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:06:00.519130354Z [2024-04-05T01:06:00.518+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:06:00.519243579Z [2024-04-05T01:06:00.519+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:06:00.519462805Z [2024-04-05T01:06:00.519+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:06:00.519754739Z [2024-04-05T01:06:00.519+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:06:00.519873397Z [2024-04-05T01:06:00.519+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:06:00.520042707Z [2024-04-05T01:06:00.519+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:06:00.997043986Z [2024-04-05T01:06:00.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:04:00+00:00 exited with status queued for try_number 1 2024-04-05T01:06:00.997213343Z [2024-04-05T01:06:00.996+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:05:00+00:00 exited with status queued for try_number 1 2024-04-05T01:06:00.997515156Z [2024-04-05T01:06:00.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:05:00+00:00 exited with status queued for try_number 1 2024-04-05T01:06:00.997674527Z [2024-04-05T01:06:00.997+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:05:00+00:00 exited with status queued for try_number 1 2024-04-05T01:06:01.015155435Z [2024-04-05T01:06:01.014+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84871bb2-faa3-452a-ba99-66c26327f4a8 2024-04-05T01:06:01.020046427Z [2024-04-05T01:06:01.019+0000] {scheduler_job.py:635} INFO - Setting external_id for to 089b0bc4-9b50-4638-9bfd-14ebf22ee304 2024-04-05T01:06:01.020285266Z [2024-04-05T01:06:01.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to ba1ad470-2ee5-497f-bad4-3a8d303bcec7 2024-04-05T01:06:01.020490003Z [2024-04-05T01:06:01.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to 827cc678-22ea-49b6-a0e0-a4da7667a5ba 2024-04-05T01:06:02.551808252Z [2024-04-05T01:06:02.551+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:06:02.552195858Z [2024-04-05T01:06:02.551+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:04:00+00:00, run_id=scheduled__2024-04-05T01:04:00+00:00, run_start_date=2024-04-05 01:06:00.437696+00:00, run_end_date=2024-04-05 01:06:02.551715+00:00, run_duration=2.114019, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:04:00+00:00, data_interval_end=2024-04-05 01:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:06:02.561476501Z [2024-04-05T01:06:02.561+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:06:00+00:00, run_after=2024-04-05T01:08:00+00:00 2024-04-05T01:06:02.684641859Z [2024-04-05T01:06:02.684+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:04:00+00:00 exited with status success for try_number 1 2024-04-05T01:06:02.696430768Z [2024-04-05T01:06:02.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:04:00+00:00, map_index=-1, run_start_date=2024-04-05 01:06:01.960579+00:00, run_end_date=2024-04-05 01:06:02.358341+00:00, run_duration=0.397762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=697, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:06:00.515185+00:00, queued_by_job_id=1, pid=10172 2024-04-05T01:06:03.757805482Z [2024-04-05T01:06:03.757+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:06:03.758283713Z [2024-04-05T01:06:03.758+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:05:00+00:00, run_id=scheduled__2024-04-05T01:05:00+00:00, run_start_date=2024-04-05 01:06:00.439356+00:00, run_end_date=2024-04-05 01:06:03.757924+00:00, run_duration=3.318568, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:05:00+00:00, data_interval_end=2024-04-05 01:06:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:06:03.774829144Z [2024-04-05T01:06:03.774+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:06:00+00:00, run_after=2024-04-05T01:07:00+00:00 2024-04-05T01:06:03.852022228Z [2024-04-05T01:06:03.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:05:00+00:00 exited with status success for try_number 1 2024-04-05T01:06:03.860554613Z [2024-04-05T01:06:03.860+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:05:00+00:00, map_index=-1, run_start_date=2024-04-05 01:06:02.278038+00:00, run_end_date=2024-04-05 01:06:02.777076+00:00, run_duration=0.499038, state=success, executor_state=success, try_number=1, max_tries=1, job_id=698, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:06:00.515185+00:00, queued_by_job_id=1, pid=10177 2024-04-05T01:06:04.919738065Z [2024-04-05T01:06:04.919+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:06:04.920042219Z [2024-04-05T01:06:04.919+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:05:00+00:00, run_id=scheduled__2024-04-05T01:05:00+00:00, run_start_date=2024-04-05 01:06:00.441073+00:00, run_end_date=2024-04-05 01:06:04.919623+00:00, run_duration=4.47855, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:05:00+00:00, data_interval_end=2024-04-05 01:06:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:06:04.929611937Z [2024-04-05T01:06:04.929+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:06:00+00:00, run_after=2024-04-05T01:07:00+00:00 2024-04-05T01:06:06.064346800Z [2024-04-05T01:06:06.063+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:06:06.064637539Z [2024-04-05T01:06:06.064+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:05:00+00:00, run_id=scheduled__2024-04-05T01:05:00+00:00, run_start_date=2024-04-05 01:06:00.442356+00:00, run_end_date=2024-04-05 01:06:06.064131+00:00, run_duration=5.621775, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:05:00+00:00, data_interval_end=2024-04-05 01:06:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:06:06.075948098Z [2024-04-05T01:06:06.075+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:06:00+00:00, run_after=2024-04-05T01:07:00+00:00 2024-04-05T01:06:06.109331239Z [2024-04-05T01:06:06.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:05:00+00:00 exited with status success for try_number 1 2024-04-05T01:06:06.109677714Z [2024-04-05T01:06:06.109+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:05:00+00:00 exited with status success for try_number 1 2024-04-05T01:06:06.116302661Z [2024-04-05T01:06:06.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:05:00+00:00, map_index=-1, run_start_date=2024-04-05 01:06:03.573002+00:00, run_end_date=2024-04-05 01:06:04.868418+00:00, run_duration=1.295416, state=success, executor_state=success, try_number=1, max_tries=1, job_id=700, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:06:00.515185+00:00, queued_by_job_id=1, pid=10202 2024-04-05T01:06:06.116558506Z [2024-04-05T01:06:06.116+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:05:00+00:00, map_index=-1, run_start_date=2024-04-05 01:06:03.164645+00:00, run_end_date=2024-04-05 01:06:05.905341+00:00, run_duration=2.740696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=699, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:06:00.515185+00:00, queued_by_job_id=1, pid=10191 2024-04-05T01:07:00.296569384Z [2024-04-05T01:07:00.296+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:07:00+00:00, run_after=2024-04-05T01:08:00+00:00 2024-04-05T01:07:00.307386181Z [2024-04-05T01:07:00.307+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:07:00.320434586Z [2024-04-05T01:07:00.320+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:07:00+00:00, run_after=2024-04-05T01:08:00+00:00 2024-04-05T01:07:00.382272829Z [2024-04-05T01:07:00.381+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:07:00.382295786Z 2024-04-05T01:07:00.382299357Z 2024-04-05T01:07:00.382302506Z 2024-04-05T01:07:00.382388776Z [2024-04-05T01:07:00.382+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:07:00.382544425Z [2024-04-05T01:07:00.382+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:07:00.382697904Z [2024-04-05T01:07:00.382+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:07:00.383315961Z [2024-04-05T01:07:00.383+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:07:00.383326085Z 2024-04-05T01:07:00.383329453Z 2024-04-05T01:07:00.383332883Z 2024-04-05T01:07:00.386148937Z [2024-04-05T01:07:00.385+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:07:00.386295248Z [2024-04-05T01:07:00.386+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:07:00.386528430Z [2024-04-05T01:07:00.386+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:07:00.386647901Z [2024-04-05T01:07:00.386+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:07:00.386856284Z [2024-04-05T01:07:00.386+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:07:00.386973952Z [2024-04-05T01:07:00.386+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:07:00.677229884Z [2024-04-05T01:07:00.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:06:00+00:00 exited with status queued for try_number 1 2024-04-05T01:07:00.677264748Z [2024-04-05T01:07:00.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:06:00+00:00 exited with status queued for try_number 1 2024-04-05T01:07:00.677310750Z [2024-04-05T01:07:00.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:06:00+00:00 exited with status queued for try_number 1 2024-04-05T01:07:00.684930679Z [2024-04-05T01:07:00.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed5f7732-4fae-407e-a890-0f26a7a2f765 2024-04-05T01:07:00.684967279Z [2024-04-05T01:07:00.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to 021992f8-591e-4d73-91bd-9991db5ce4ed 2024-04-05T01:07:00.685087905Z [2024-04-05T01:07:00.684+0000] {scheduler_job.py:635} INFO - Setting external_id for to f082c51a-aa3f-4234-a7b2-12c7dc3f4ac9 2024-04-05T01:07:03.145735037Z [2024-04-05T01:07:03.145+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:07:03.146017118Z [2024-04-05T01:07:03.145+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:06:00+00:00, run_id=scheduled__2024-04-05T01:06:00+00:00, run_start_date=2024-04-05 01:07:00.335846+00:00, run_end_date=2024-04-05 01:07:03.145627+00:00, run_duration=2.809781, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:06:00+00:00, data_interval_end=2024-04-05 01:07:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:07:03.163770527Z [2024-04-05T01:07:03.163+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:07:00+00:00, run_after=2024-04-05T01:08:00+00:00 2024-04-05T01:07:03.251715833Z [2024-04-05T01:07:03.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:06:00+00:00 exited with status success for try_number 1 2024-04-05T01:07:03.257094765Z [2024-04-05T01:07:03.256+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:06:00+00:00, map_index=-1, run_start_date=2024-04-05 01:07:02.037678+00:00, run_end_date=2024-04-05 01:07:02.416978+00:00, run_duration=0.3793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=701, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:07:00.383982+00:00, queued_by_job_id=1, pid=10233 2024-04-05T01:07:05.447598860Z [2024-04-05T01:07:05.447+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:07:05.448125663Z [2024-04-05T01:07:05.447+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:06:00+00:00, run_id=scheduled__2024-04-05T01:06:00+00:00, run_start_date=2024-04-05 01:07:00.337014+00:00, run_end_date=2024-04-05 01:07:05.447421+00:00, run_duration=5.110407, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:06:00+00:00, data_interval_end=2024-04-05 01:07:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:07:05.457734720Z [2024-04-05T01:07:05.457+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:07:00+00:00, run_after=2024-04-05T01:08:00+00:00 2024-04-05T01:07:05.465708892Z [2024-04-05T01:07:05.465+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:07:05.466105601Z [2024-04-05T01:07:05.465+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:06:00+00:00, run_id=scheduled__2024-04-05T01:06:00+00:00, run_start_date=2024-04-05 01:07:00.338208+00:00, run_end_date=2024-04-05 01:07:05.465581+00:00, run_duration=5.127373, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:06:00+00:00, data_interval_end=2024-04-05 01:07:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:07:05.479256114Z [2024-04-05T01:07:05.478+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:07:00+00:00, run_after=2024-04-05T01:08:00+00:00 2024-04-05T01:07:05.531203383Z [2024-04-05T01:07:05.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:06:00+00:00 exited with status success for try_number 1 2024-04-05T01:07:05.531229635Z [2024-04-05T01:07:05.530+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:06:00+00:00 exited with status success for try_number 1 2024-04-05T01:07:05.539891089Z [2024-04-05T01:07:05.539+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:06:00+00:00, map_index=-1, run_start_date=2024-04-05 01:07:02.873337+00:00, run_end_date=2024-04-05 01:07:04.350534+00:00, run_duration=1.477197, state=success, executor_state=success, try_number=1, max_tries=1, job_id=702, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:07:00.383982+00:00, queued_by_job_id=1, pid=10249 2024-04-05T01:07:05.540264230Z [2024-04-05T01:07:05.540+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:06:00+00:00, map_index=-1, run_start_date=2024-04-05 01:07:02.966789+00:00, run_end_date=2024-04-05 01:07:04.679838+00:00, run_duration=1.713049, state=success, executor_state=success, try_number=1, max_tries=1, job_id=703, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:07:00.383982+00:00, queued_by_job_id=1, pid=10250 2024-04-05T01:08:00.926795377Z [2024-04-05T01:08:00.926+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:08:00.942493287Z [2024-04-05T01:08:00.942+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:08:00+00:00, run_after=2024-04-05T01:09:00+00:00 2024-04-05T01:08:00.957864645Z [2024-04-05T01:08:00.957+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:08:00+00:00, run_after=2024-04-05T01:09:00+00:00 2024-04-05T01:08:00.966327488Z [2024-04-05T01:08:00.965+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:08:01.049982979Z [2024-04-05T01:08:01.049+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:08:01.050014051Z 2024-04-05T01:08:01.050026317Z 2024-04-05T01:08:01.050031815Z 2024-04-05T01:08:01.050036795Z 2024-04-05T01:08:01.050438485Z [2024-04-05T01:08:01.050+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:08:01.050859535Z [2024-04-05T01:08:01.050+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:08:01.051282619Z [2024-04-05T01:08:01.050+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:08:01.051689870Z [2024-04-05T01:08:01.051+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:08:01.053118548Z [2024-04-05T01:08:01.052+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:08:01.053134053Z 2024-04-05T01:08:01.053139745Z 2024-04-05T01:08:01.053144605Z 2024-04-05T01:08:01.053149264Z 2024-04-05T01:08:01.059368890Z [2024-04-05T01:08:01.058+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:08:01.059777729Z [2024-04-05T01:08:01.059+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:08:01.060240240Z [2024-04-05T01:08:01.060+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:08:01.060452055Z [2024-04-05T01:08:01.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:08:01.060901023Z [2024-04-05T01:08:01.060+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:08:01.061180776Z [2024-04-05T01:08:01.060+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:08:01.061621195Z [2024-04-05T01:08:01.061+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:08:01.061886242Z [2024-04-05T01:08:01.061+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:08:01.631264334Z [2024-04-05T01:08:01.630+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:06:00+00:00 exited with status queued for try_number 1 2024-04-05T01:08:01.631487038Z [2024-04-05T01:08:01.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:07:00+00:00 exited with status queued for try_number 1 2024-04-05T01:08:01.631739127Z [2024-04-05T01:08:01.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:07:00+00:00 exited with status queued for try_number 1 2024-04-05T01:08:01.631936072Z [2024-04-05T01:08:01.631+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:07:00+00:00 exited with status queued for try_number 1 2024-04-05T01:08:01.642781839Z [2024-04-05T01:08:01.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfdee2a8-eac3-4e17-a11e-90815683bedb 2024-04-05T01:08:01.643124215Z [2024-04-05T01:08:01.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to 307d9cdc-5ea2-46df-ab68-88d2fb9c40b8 2024-04-05T01:08:01.643465909Z [2024-04-05T01:08:01.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to bf3d1288-bbb1-4e3f-b310-88bc90b14d1a 2024-04-05T01:08:01.643855757Z [2024-04-05T01:08:01.643+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20635225-ea70-4c78-997b-def8eb4a520c 2024-04-05T01:08:02.820251390Z [2024-04-05T01:08:02.816+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:08:02.821074045Z [2024-04-05T01:08:02.820+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:06:00+00:00, run_id=scheduled__2024-04-05T01:06:00+00:00, run_start_date=2024-04-05 01:08:00.976566+00:00, run_end_date=2024-04-05 01:08:02.820171+00:00, run_duration=1.843605, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:06:00+00:00, data_interval_end=2024-04-05 01:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:08:02.835509600Z [2024-04-05T01:08:02.835+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:08:00+00:00, run_after=2024-04-05T01:10:00+00:00 2024-04-05T01:08:02.956618797Z [2024-04-05T01:08:02.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:06:00+00:00 exited with status success for try_number 1 2024-04-05T01:08:02.967180680Z [2024-04-05T01:08:02.966+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:06:00+00:00, map_index=-1, run_start_date=2024-04-05 01:08:02.070512+00:00, run_end_date=2024-04-05 01:08:02.472331+00:00, run_duration=0.401819, state=success, executor_state=success, try_number=1, max_tries=1, job_id=704, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:08:01.055270+00:00, queued_by_job_id=1, pid=10279 2024-04-05T01:08:04.037692257Z [2024-04-05T01:08:04.037+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:08:04.038047601Z [2024-04-05T01:08:04.037+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:07:00+00:00, run_id=scheduled__2024-04-05T01:07:00+00:00, run_start_date=2024-04-05 01:08:00.977791+00:00, run_end_date=2024-04-05 01:08:04.037573+00:00, run_duration=3.059782, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:07:00+00:00, data_interval_end=2024-04-05 01:08:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:08:04.048052207Z [2024-04-05T01:08:04.047+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:08:00+00:00, run_after=2024-04-05T01:09:00+00:00 2024-04-05T01:08:04.101957066Z [2024-04-05T01:08:04.101+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:07:00+00:00 exited with status success for try_number 1 2024-04-05T01:08:04.109873883Z [2024-04-05T01:08:04.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:07:00+00:00, map_index=-1, run_start_date=2024-04-05 01:08:02.593031+00:00, run_end_date=2024-04-05 01:08:03.068430+00:00, run_duration=0.475399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=705, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:08:01.055270+00:00, queued_by_job_id=1, pid=10291 2024-04-05T01:08:06.327853870Z [2024-04-05T01:08:06.327+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:08:06.328491766Z [2024-04-05T01:08:06.328+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:07:00+00:00, run_id=scheduled__2024-04-05T01:07:00+00:00, run_start_date=2024-04-05 01:08:00.978850+00:00, run_end_date=2024-04-05 01:08:06.327746+00:00, run_duration=5.348896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:07:00+00:00, data_interval_end=2024-04-05 01:08:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:08:06.338224049Z [2024-04-05T01:08:06.337+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:08:00+00:00, run_after=2024-04-05T01:09:00+00:00 2024-04-05T01:08:06.345463617Z [2024-04-05T01:08:06.344+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:08:06.345793684Z [2024-04-05T01:08:06.345+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:07:00+00:00, run_id=scheduled__2024-04-05T01:07:00+00:00, run_start_date=2024-04-05 01:08:00.979837+00:00, run_end_date=2024-04-05 01:08:06.345389+00:00, run_duration=5.365552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:07:00+00:00, data_interval_end=2024-04-05 01:08:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:08:06.357344575Z [2024-04-05T01:08:06.357+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:08:00+00:00, run_after=2024-04-05T01:09:00+00:00 2024-04-05T01:08:06.391518194Z [2024-04-05T01:08:06.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:07:00+00:00 exited with status success for try_number 1 2024-04-05T01:08:06.391792617Z [2024-04-05T01:08:06.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:07:00+00:00 exited with status success for try_number 1 2024-04-05T01:08:06.408094394Z [2024-04-05T01:08:06.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:07:00+00:00, map_index=-1, run_start_date=2024-04-05 01:08:03.345894+00:00, run_end_date=2024-04-05 01:08:05.474984+00:00, run_duration=2.12909, state=success, executor_state=success, try_number=1, max_tries=1, job_id=706, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:08:01.055270+00:00, queued_by_job_id=1, pid=10307 2024-04-05T01:08:06.408552608Z [2024-04-05T01:08:06.408+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:07:00+00:00, map_index=-1, run_start_date=2024-04-05 01:08:03.553898+00:00, run_end_date=2024-04-05 01:08:05.472595+00:00, run_duration=1.918697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=707, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:08:01.055270+00:00, queued_by_job_id=1, pid=10309 2024-04-05T01:09:00.827025456Z [2024-04-05T01:09:00.826+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:09:00+00:00, run_after=2024-04-05T01:10:00+00:00 2024-04-05T01:09:00.839362041Z [2024-04-05T01:09:00.838+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:09:00.861268867Z [2024-04-05T01:09:00.860+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:09:00+00:00, run_after=2024-04-05T01:10:00+00:00 2024-04-05T01:09:00.959087083Z [2024-04-05T01:09:00.958+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:09:00.959124166Z 2024-04-05T01:09:00.959129783Z 2024-04-05T01:09:00.959150089Z 2024-04-05T01:09:00.959229255Z [2024-04-05T01:09:00.958+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:09:00.959445981Z [2024-04-05T01:09:00.959+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:09:00.959738864Z [2024-04-05T01:09:00.959+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:09:00.960791836Z [2024-04-05T01:09:00.960+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:09:00.960807369Z 2024-04-05T01:09:00.960812416Z 2024-04-05T01:09:00.960816621Z 2024-04-05T01:09:00.965221755Z [2024-04-05T01:09:00.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:09:00.965513033Z [2024-04-05T01:09:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:09:00.965905637Z [2024-04-05T01:09:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:09:00.966167866Z [2024-04-05T01:09:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:09:00.966550308Z [2024-04-05T01:09:00.966+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:09:00.966768103Z [2024-04-05T01:09:00.966+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:09:01.532145940Z [2024-04-05T01:09:01.531+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:08:00+00:00 exited with status queued for try_number 1 2024-04-05T01:09:01.532657608Z [2024-04-05T01:09:01.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:08:00+00:00 exited with status queued for try_number 1 2024-04-05T01:09:01.532844577Z [2024-04-05T01:09:01.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:08:00+00:00 exited with status queued for try_number 1 2024-04-05T01:09:01.546969095Z [2024-04-05T01:09:01.546+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee9f8f18-bb8b-4e36-bcc8-ad4a7f10effb 2024-04-05T01:09:01.547338742Z [2024-04-05T01:09:01.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60a951e4-6c8a-4ec7-9f0c-d3a0ab7129ed 2024-04-05T01:09:01.547580834Z [2024-04-05T01:09:01.547+0000] {scheduler_job.py:635} INFO - Setting external_id for to 22cabdf8-2613-48b4-91af-6d132c9d08fd 2024-04-05T01:09:03.169954915Z [2024-04-05T01:09:03.169+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:09:03.170623649Z [2024-04-05T01:09:03.170+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:08:00+00:00, run_id=scheduled__2024-04-05T01:08:00+00:00, run_start_date=2024-04-05 01:09:00.880634+00:00, run_end_date=2024-04-05 01:09:03.169872+00:00, run_duration=2.289238, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:08:00+00:00, data_interval_end=2024-04-05 01:09:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:09:03.185227829Z [2024-04-05T01:09:03.184+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:09:00+00:00, run_after=2024-04-05T01:10:00+00:00 2024-04-05T01:09:03.273480069Z [2024-04-05T01:09:03.272+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:08:00+00:00 exited with status success for try_number 1 2024-04-05T01:09:03.284550063Z [2024-04-05T01:09:03.284+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:08:00+00:00, map_index=-1, run_start_date=2024-04-05 01:09:02.115164+00:00, run_end_date=2024-04-05 01:09:02.638959+00:00, run_duration=0.523795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=708, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:09:00.961851+00:00, queued_by_job_id=1, pid=10341 2024-04-05T01:09:05.929037469Z [2024-04-05T01:09:05.928+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:09:05.929391403Z [2024-04-05T01:09:05.929+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:08:00+00:00, run_id=scheduled__2024-04-05T01:08:00+00:00, run_start_date=2024-04-05 01:09:00.882504+00:00, run_end_date=2024-04-05 01:09:05.929053+00:00, run_duration=5.046549, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:08:00+00:00, data_interval_end=2024-04-05 01:09:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:09:05.938615433Z [2024-04-05T01:09:05.938+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:09:00+00:00, run_after=2024-04-05T01:10:00+00:00 2024-04-05T01:09:05.949417837Z [2024-04-05T01:09:05.949+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:09:05.949670659Z [2024-04-05T01:09:05.949+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:08:00+00:00, run_id=scheduled__2024-04-05T01:08:00+00:00, run_start_date=2024-04-05 01:09:00.884295+00:00, run_end_date=2024-04-05 01:09:05.949377+00:00, run_duration=5.065082, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:08:00+00:00, data_interval_end=2024-04-05 01:09:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:09:05.959735650Z [2024-04-05T01:09:05.959+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:09:00+00:00, run_after=2024-04-05T01:10:00+00:00 2024-04-05T01:09:06.029049895Z [2024-04-05T01:09:06.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:08:00+00:00 exited with status success for try_number 1 2024-04-05T01:09:06.029076818Z [2024-04-05T01:09:06.028+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:08:00+00:00 exited with status success for try_number 1 2024-04-05T01:09:06.046758926Z [2024-04-05T01:09:06.046+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:08:00+00:00, map_index=-1, run_start_date=2024-04-05 01:09:03.535226+00:00, run_end_date=2024-04-05 01:09:05.547884+00:00, run_duration=2.012658, state=success, executor_state=success, try_number=1, max_tries=1, job_id=710, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:09:00.961851+00:00, queued_by_job_id=1, pid=10360 2024-04-05T01:09:06.046903049Z [2024-04-05T01:09:06.046+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:08:00+00:00, map_index=-1, run_start_date=2024-04-05 01:09:03.459464+00:00, run_end_date=2024-04-05 01:09:04.932451+00:00, run_duration=1.472987, state=success, executor_state=success, try_number=1, max_tries=1, job_id=709, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:09:00.961851+00:00, queued_by_job_id=1, pid=10359 2024-04-05T01:10:00.566365033Z [2024-04-05T01:10:00.565+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:10:00+00:00, run_after=2024-04-05T01:15:00+00:00 2024-04-05T01:10:00.579516878Z [2024-04-05T01:10:00.579+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:10:00+00:00, run_after=2024-04-05T01:11:00+00:00 2024-04-05T01:10:00.592252046Z [2024-04-05T01:10:00.591+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:10:00+00:00, run_after=2024-04-05T01:11:00+00:00 2024-04-05T01:10:00.610207694Z [2024-04-05T01:10:00.609+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:10:00.616608350Z [2024-04-05T01:10:00.616+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:10:00.734442983Z [2024-04-05T01:10:00.733+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T01:10:00.734492727Z 2024-04-05T01:10:00.734496873Z 2024-04-05T01:10:00.734501205Z 2024-04-05T01:10:00.734504468Z 2024-04-05T01:10:00.734513204Z 2024-04-05T01:10:00.734673148Z [2024-04-05T01:10:00.734+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:10:00.734883405Z [2024-04-05T01:10:00.734+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:10:00.735053924Z [2024-04-05T01:10:00.734+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:10:00.735204118Z [2024-04-05T01:10:00.735+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:10:00.735424571Z [2024-04-05T01:10:00.735+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:10:00.736295862Z [2024-04-05T01:10:00.736+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:10:00.736348264Z 2024-04-05T01:10:00.736356484Z 2024-04-05T01:10:00.736362531Z 2024-04-05T01:10:00.736366900Z 2024-04-05T01:10:00.736371600Z 2024-04-05T01:10:00.741721193Z [2024-04-05T01:10:00.741+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:10:00.741915593Z [2024-04-05T01:10:00.741+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:10:00.742289142Z [2024-04-05T01:10:00.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:10:00.742299836Z [2024-04-05T01:10:00.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:10:00.742556451Z [2024-04-05T01:10:00.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:10:00.742603462Z [2024-04-05T01:10:00.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:10:00.742804179Z [2024-04-05T01:10:00.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:10:00.742900681Z [2024-04-05T01:10:00.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:10:00.743145410Z [2024-04-05T01:10:00.742+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:10:00.743153459Z [2024-04-05T01:10:00.742+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:10:01.591938232Z [2024-04-05T01:10:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:05:00+00:00 exited with status queued for try_number 1 2024-04-05T01:10:01.591971457Z [2024-04-05T01:10:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:08:00+00:00 exited with status queued for try_number 1 2024-04-05T01:10:01.592035239Z [2024-04-05T01:10:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:09:00+00:00 exited with status queued for try_number 1 2024-04-05T01:10:01.592071780Z [2024-04-05T01:10:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:09:00+00:00 exited with status queued for try_number 1 2024-04-05T01:10:01.592148200Z [2024-04-05T01:10:01.592+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:09:00+00:00 exited with status queued for try_number 1 2024-04-05T01:10:01.603106047Z [2024-04-05T01:10:01.602+0000] {scheduler_job.py:635} INFO - Setting external_id for to ee617528-084a-4b68-a1a2-a7c111cd053a 2024-04-05T01:10:01.603155069Z [2024-04-05T01:10:01.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd512dd2-6a12-4b71-9234-4c4e6556c7ae 2024-04-05T01:10:01.603377788Z [2024-04-05T01:10:01.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to a3917650-7cd7-4b96-b4f5-f44cd633f705 2024-04-05T01:10:01.603518041Z [2024-04-05T01:10:01.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9460afce-557d-43da-93cf-8bc0e2df2b7a 2024-04-05T01:10:01.603707259Z [2024-04-05T01:10:01.603+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8b875db2-0ca4-461a-8466-bb41d5dad9e3 2024-04-05T01:10:03.933926070Z [2024-04-05T01:10:03.933+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:10:03.934438580Z [2024-04-05T01:10:03.934+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:08:00+00:00, run_id=scheduled__2024-04-05T01:08:00+00:00, run_start_date=2024-04-05 01:10:00.631741+00:00, run_end_date=2024-04-05 01:10:03.933836+00:00, run_duration=3.302095, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:08:00+00:00, data_interval_end=2024-04-05 01:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:10:03.946193374Z [2024-04-05T01:10:03.945+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:10:00+00:00, run_after=2024-04-05T01:12:00+00:00 2024-04-05T01:10:03.974408211Z [2024-04-05T01:10:03.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:10:03.974984709Z [2024-04-05T01:10:03.974+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:09:00+00:00, run_id=scheduled__2024-04-05T01:09:00+00:00, run_start_date=2024-04-05 01:10:00.633040+00:00, run_end_date=2024-04-05 01:10:03.974318+00:00, run_duration=3.341278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:09:00+00:00, data_interval_end=2024-04-05 01:10:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:10:03.997682074Z [2024-04-05T01:10:03.997+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:10:00+00:00, run_after=2024-04-05T01:11:00+00:00 2024-04-05T01:10:04.112043189Z [2024-04-05T01:10:04.111+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:08:00+00:00 exited with status success for try_number 1 2024-04-05T01:10:04.122127803Z [2024-04-05T01:10:04.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:08:00+00:00, map_index=-1, run_start_date=2024-04-05 01:10:02.768894+00:00, run_end_date=2024-04-05 01:10:03.744722+00:00, run_duration=0.975828, state=success, executor_state=success, try_number=1, max_tries=1, job_id=711, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:10:00.737427+00:00, queued_by_job_id=1, pid=10394 2024-04-05T01:10:04.716347079Z [2024-04-05T01:10:04.715+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:09:00+00:00 exited with status success for try_number 1 2024-04-05T01:10:04.735547740Z [2024-04-05T01:10:04.735+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:09:00+00:00, map_index=-1, run_start_date=2024-04-05 01:10:03.313856+00:00, run_end_date=2024-04-05 01:10:03.937388+00:00, run_duration=0.623532, state=success, executor_state=success, try_number=1, max_tries=1, job_id=712, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:10:00.737427+00:00, queued_by_job_id=1, pid=10397 2024-04-05T01:10:05.836831569Z [2024-04-05T01:10:05.836+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:10:05.836990227Z [2024-04-05T01:10:05.836+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:09:00+00:00, run_id=scheduled__2024-04-05T01:09:00+00:00, run_start_date=2024-04-05 01:10:00.634108+00:00, run_end_date=2024-04-05 01:10:05.836654+00:00, run_duration=5.202546, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:09:00+00:00, data_interval_end=2024-04-05 01:10:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:10:05.848694089Z [2024-04-05T01:10:05.848+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:10:00+00:00, run_after=2024-04-05T01:11:00+00:00 2024-04-05T01:10:05.874126583Z [2024-04-05T01:10:05.873+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:10:05.874190025Z 2024-04-05T01:10:05.874199971Z [2024-04-05T01:10:05.873+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:10:05.874745938Z [2024-04-05T01:10:05.874+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:10:05.874765801Z 2024-04-05T01:10:05.877393420Z [2024-04-05T01:10:05.877+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:10:05.877465177Z [2024-04-05T01:10:05.877+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:10:05.943677525Z [2024-04-05T01:10:05.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:05:00+00:00 exited with status queued for try_number 1 2024-04-05T01:10:05.943851511Z [2024-04-05T01:10:05.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:05:00+00:00 exited with status success for try_number 1 2024-04-05T01:10:05.943943315Z [2024-04-05T01:10:05.943+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:09:00+00:00 exited with status success for try_number 1 2024-04-05T01:10:05.951272605Z [2024-04-05T01:10:05.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:05:00+00:00, map_index=-1, run_start_date=2024-04-05 01:10:04.424330+00:00, run_end_date=2024-04-05 01:10:04.979183+00:00, run_duration=0.554853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=714, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:10:00.737427+00:00, queued_by_job_id=1, pid=10420 2024-04-05T01:10:05.951656746Z [2024-04-05T01:10:05.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1fa35c21-587f-4fb9-bf4a-85bcf60c44bd 2024-04-05T01:10:05.952029109Z [2024-04-05T01:10:05.951+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:09:00+00:00, map_index=-1, run_start_date=2024-04-05 01:10:04.329035+00:00, run_end_date=2024-04-05 01:10:05.752351+00:00, run_duration=1.423316, state=success, executor_state=success, try_number=1, max_tries=1, job_id=713, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:10:00.737427+00:00, queued_by_job_id=1, pid=10419 2024-04-05T01:10:08.215358065Z [2024-04-05T01:10:08.214+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:10:08.215787149Z [2024-04-05T01:10:08.215+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:09:00+00:00, run_id=scheduled__2024-04-05T01:09:00+00:00, run_start_date=2024-04-05 01:10:00.635120+00:00, run_end_date=2024-04-05 01:10:08.215236+00:00, run_duration=7.580116, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:09:00+00:00, data_interval_end=2024-04-05 01:10:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:10:08.225434092Z [2024-04-05T01:10:08.225+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:10:00+00:00, run_after=2024-04-05T01:11:00+00:00 2024-04-05T01:10:08.254242055Z [2024-04-05T01:10:08.253+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:10:08.254270859Z 2024-04-05T01:10:08.254513905Z [2024-04-05T01:10:08.254+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:10:08.255161830Z [2024-04-05T01:10:08.254+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:10:08.255172010Z 2024-04-05T01:10:08.257664480Z [2024-04-05T01:10:08.257+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:10:08.257877173Z [2024-04-05T01:10:08.257+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:10:08.302118060Z [2024-04-05T01:10:08.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:05:00+00:00 exited with status queued for try_number 1 2024-04-05T01:10:08.302259690Z [2024-04-05T01:10:08.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:09:00+00:00 exited with status success for try_number 1 2024-04-05T01:10:08.302385555Z [2024-04-05T01:10:08.302+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:05:00+00:00 exited with status success for try_number 1 2024-04-05T01:10:08.309007096Z [2024-04-05T01:10:08.308+0000] {scheduler_job.py:635} INFO - Setting external_id for to d20986f3-64b1-4f3e-b7b2-f1613ae17a7d 2024-04-05T01:10:08.309258628Z [2024-04-05T01:10:08.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:09:00+00:00, map_index=-1, run_start_date=2024-04-05 01:10:05.291069+00:00, run_end_date=2024-04-05 01:10:07.377366+00:00, run_duration=2.086297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=715, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:10:00.737427+00:00, queued_by_job_id=1, pid=10436 2024-04-05T01:10:08.309554821Z [2024-04-05T01:10:08.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T01:05:00+00:00, map_index=-1, run_start_date=2024-04-05 01:10:07.526652+00:00, run_end_date=2024-04-05 01:10:07.880282+00:00, run_duration=0.35363, state=success, executor_state=success, try_number=1, max_tries=1, job_id=716, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:10:05.874960+00:00, queued_by_job_id=1, pid=10449 2024-04-05T01:10:10.964736072Z [2024-04-05T01:10:10.964+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:10:10.964770709Z 2024-04-05T01:10:10.965209986Z [2024-04-05T01:10:10.964+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:10:10.966000475Z [2024-04-05T01:10:10.965+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:10:10.966015529Z 2024-04-05T01:10:10.969447471Z [2024-04-05T01:10:10.969+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:10:10.969638177Z [2024-04-05T01:10:10.969+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:10:11.052436513Z [2024-04-05T01:10:11.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:05:00+00:00 exited with status queued for try_number 1 2024-04-05T01:10:11.052565073Z [2024-04-05T01:10:11.052+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:05:00+00:00 exited with status success for try_number 1 2024-04-05T01:10:11.059547020Z [2024-04-05T01:10:11.059+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4315ee08-ade8-455a-8f65-3bac1b22b9e7 2024-04-05T01:10:11.059997005Z [2024-04-05T01:10:11.059+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:05:00+00:00, map_index=0, run_start_date=2024-04-05 01:10:09.811358+00:00, run_end_date=2024-04-05 01:10:10.117123+00:00, run_duration=0.305765, state=success, executor_state=success, try_number=1, max_tries=1, job_id=717, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:10:08.255621+00:00, queued_by_job_id=1, pid=10467 2024-04-05T01:10:14.054364885Z [2024-04-05T01:10:14.053+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:10:14.054867770Z [2024-04-05T01:10:14.054+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:05:00+00:00, run_id=scheduled__2024-04-05T01:05:00+00:00, run_start_date=2024-04-05 01:10:00.630243+00:00, run_end_date=2024-04-05 01:10:14.054240+00:00, run_duration=13.423997, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:05:00+00:00, data_interval_end=2024-04-05 01:10:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T01:10:14.061443062Z [2024-04-05T01:10:14.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:10:00+00:00, run_after=2024-04-05T01:15:00+00:00 2024-04-05T01:10:14.091027034Z [2024-04-05T01:10:14.090+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:05:00+00:00 exited with status success for try_number 1 2024-04-05T01:10:14.096274687Z [2024-04-05T01:10:14.095+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:05:00+00:00, map_index=-1, run_start_date=2024-04-05 01:10:12.796335+00:00, run_end_date=2024-04-05 01:10:13.150147+00:00, run_duration=0.353812, state=success, executor_state=success, try_number=1, max_tries=1, job_id=718, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:10:10.966525+00:00, queued_by_job_id=1, pid=10478 2024-04-05T01:10:40.980212623Z [2024-04-05T01:10:40.979+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T01:11:00.436115709Z [2024-04-05T01:11:00.435+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:11:00.457276315Z [2024-04-05T01:11:00.456+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:11:00+00:00, run_after=2024-04-05T01:12:00+00:00 2024-04-05T01:11:00.478422028Z [2024-04-05T01:11:00.478+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:11:00+00:00, run_after=2024-04-05T01:12:00+00:00 2024-04-05T01:11:00.556496007Z [2024-04-05T01:11:00.556+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:11:00.556524819Z 2024-04-05T01:11:00.556528708Z 2024-04-05T01:11:00.556532357Z 2024-04-05T01:11:00.556547475Z [2024-04-05T01:11:00.556+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:11:00.556807166Z [2024-04-05T01:11:00.556+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:11:00.556920145Z [2024-04-05T01:11:00.556+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:11:00.557570682Z [2024-04-05T01:11:00.557+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:11:00.557585930Z 2024-04-05T01:11:00.557607348Z 2024-04-05T01:11:00.557610696Z 2024-04-05T01:11:00.561238295Z [2024-04-05T01:11:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:11:00.561405107Z [2024-04-05T01:11:00.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:11:00.561720447Z [2024-04-05T01:11:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:11:00.561872892Z [2024-04-05T01:11:00.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:11:00.562163886Z [2024-04-05T01:11:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:11:00.562239054Z [2024-04-05T01:11:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:11:01.328742026Z [2024-04-05T01:11:01.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status queued for try_number 1 2024-04-05T01:11:01.332532089Z [2024-04-05T01:11:01.328+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status queued for try_number 1 2024-04-05T01:11:01.337298411Z [2024-04-05T01:11:01.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status queued for try_number 1 2024-04-05T01:11:01.381236860Z [2024-04-05T01:11:01.380+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5ead3094-fdf8-452d-a7fa-cba0b2a58841 2024-04-05T01:11:01.382740789Z [2024-04-05T01:11:01.382+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae0034ab-5393-4df4-a101-52e21f696cb2 2024-04-05T01:11:01.384620819Z [2024-04-05T01:11:01.384+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4123b54-adc5-449e-b725-6b919a9a227e 2024-04-05T01:11:02.773719446Z [2024-04-05T01:11:02.770+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:11:02.775351924Z [2024-04-05T01:11:02.774+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:10:00+00:00, run_id=scheduled__2024-04-05T01:10:00+00:00, run_start_date=2024-04-05 01:11:00.497073+00:00, run_end_date=2024-04-05 01:11:02.774560+00:00, run_duration=2.277487, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:10:00+00:00, data_interval_end=2024-04-05 01:11:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:11:02.786967627Z [2024-04-05T01:11:02.786+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:11:00+00:00, run_after=2024-04-05T01:12:00+00:00 2024-04-05T01:11:02.898989505Z [2024-04-05T01:11:02.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status success for try_number 1 2024-04-05T01:11:02.908118788Z [2024-04-05T01:11:02.906+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:10:00+00:00, map_index=-1, run_start_date=2024-04-05 01:11:02.306417+00:00, run_end_date=2024-04-05 01:11:02.734694+00:00, run_duration=0.428277, state=success, executor_state=success, try_number=1, max_tries=1, job_id=719, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:11:00.558443+00:00, queued_by_job_id=1, pid=10488 2024-04-05T01:11:05.481234690Z [2024-04-05T01:11:05.480+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:11:05.481664420Z [2024-04-05T01:11:05.481+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:10:00+00:00, run_id=scheduled__2024-04-05T01:10:00+00:00, run_start_date=2024-04-05 01:11:00.500451+00:00, run_end_date=2024-04-05 01:11:05.481132+00:00, run_duration=4.980681, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:10:00+00:00, data_interval_end=2024-04-05 01:11:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:11:05.490880069Z [2024-04-05T01:11:05.490+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:11:00+00:00, run_after=2024-04-05T01:12:00+00:00 2024-04-05T01:11:05.540372027Z [2024-04-05T01:11:05.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status success for try_number 1 2024-04-05T01:11:05.545774501Z [2024-04-05T01:11:05.545+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:10:00+00:00, map_index=-1, run_start_date=2024-04-05 01:11:02.921052+00:00, run_end_date=2024-04-05 01:11:04.860353+00:00, run_duration=1.939301, state=success, executor_state=success, try_number=1, max_tries=1, job_id=720, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:11:00.558443+00:00, queued_by_job_id=1, pid=10500 2024-04-05T01:11:07.613647766Z [2024-04-05T01:11:07.613+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:11:07.613977304Z [2024-04-05T01:11:07.613+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:10:00+00:00, run_id=scheduled__2024-04-05T01:10:00+00:00, run_start_date=2024-04-05 01:11:00.502571+00:00, run_end_date=2024-04-05 01:11:07.613546+00:00, run_duration=7.110975, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:10:00+00:00, data_interval_end=2024-04-05 01:11:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:11:07.627871710Z [2024-04-05T01:11:07.627+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:11:00+00:00, run_after=2024-04-05T01:12:00+00:00 2024-04-05T01:11:07.671400617Z [2024-04-05T01:11:07.670+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status success for try_number 1 2024-04-05T01:11:07.680055326Z [2024-04-05T01:11:07.679+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:10:00+00:00, map_index=-1, run_start_date=2024-04-05 01:11:03.274756+00:00, run_end_date=2024-04-05 01:11:06.422520+00:00, run_duration=3.147764, state=success, executor_state=success, try_number=1, max_tries=1, job_id=721, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:11:00.558443+00:00, queued_by_job_id=1, pid=10511 2024-04-05T01:12:00.477069099Z [2024-04-05T01:12:00.475+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:12:00+00:00, run_after=2024-04-05T01:13:00+00:00 2024-04-05T01:12:00.500682908Z [2024-04-05T01:12:00.500+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:12:00+00:00, run_after=2024-04-05T01:13:00+00:00 2024-04-05T01:12:00.511999616Z [2024-04-05T01:12:00.511+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:12:00.518220513Z [2024-04-05T01:12:00.517+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:12:00.602472757Z [2024-04-05T01:12:00.602+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:12:00.602497180Z 2024-04-05T01:12:00.602501566Z 2024-04-05T01:12:00.602504977Z 2024-04-05T01:12:00.602508591Z 2024-04-05T01:12:00.602614444Z [2024-04-05T01:12:00.602+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:12:00.602857188Z [2024-04-05T01:12:00.602+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:12:00.603042594Z [2024-04-05T01:12:00.602+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:12:00.603247142Z [2024-04-05T01:12:00.603+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:12:00.604746012Z [2024-04-05T01:12:00.604+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:12:00.604761803Z 2024-04-05T01:12:00.604766131Z 2024-04-05T01:12:00.604770022Z 2024-04-05T01:12:00.604773799Z 2024-04-05T01:12:00.609551926Z [2024-04-05T01:12:00.609+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:12:00.609680173Z [2024-04-05T01:12:00.609+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:12:00.609952353Z [2024-04-05T01:12:00.609+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:12:00.610385088Z [2024-04-05T01:12:00.609+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:12:00.610689047Z [2024-04-05T01:12:00.610+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:12:00.610873920Z [2024-04-05T01:12:00.610+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:12:00.611187665Z [2024-04-05T01:12:00.611+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:12:00.611357071Z [2024-04-05T01:12:00.611+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:12:01.389649467Z [2024-04-05T01:12:01.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status queued for try_number 1 2024-04-05T01:12:01.392110812Z [2024-04-05T01:12:01.391+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:11:00+00:00 exited with status queued for try_number 1 2024-04-05T01:12:01.392290451Z [2024-04-05T01:12:01.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:11:00+00:00 exited with status queued for try_number 1 2024-04-05T01:12:01.392443342Z [2024-04-05T01:12:01.392+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:11:00+00:00 exited with status queued for try_number 1 2024-04-05T01:12:01.412911013Z [2024-04-05T01:12:01.412+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd994913-a87b-4bce-9c40-1ea20fcd0fb3 2024-04-05T01:12:01.416101468Z [2024-04-05T01:12:01.415+0000] {scheduler_job.py:635} INFO - Setting external_id for to b067ac3a-4ec9-4741-9f8b-fe434899d624 2024-04-05T01:12:01.416354232Z [2024-04-05T01:12:01.416+0000] {scheduler_job.py:635} INFO - Setting external_id for to b50e96ee-ed9d-4899-ab94-8b4337c55ec7 2024-04-05T01:12:01.416550882Z [2024-04-05T01:12:01.416+0000] {scheduler_job.py:635} INFO - Setting external_id for to b176af66-eea9-4608-8403-603fbf201c1c 2024-04-05T01:12:03.585769940Z [2024-04-05T01:12:03.584+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:12:03.586527011Z [2024-04-05T01:12:03.586+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:10:00+00:00, run_id=scheduled__2024-04-05T01:10:00+00:00, run_start_date=2024-04-05 01:12:00.529502+00:00, run_end_date=2024-04-05 01:12:03.585803+00:00, run_duration=3.056301, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:10:00+00:00, data_interval_end=2024-04-05 01:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:12:03.598927160Z [2024-04-05T01:12:03.598+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:12:00+00:00, run_after=2024-04-05T01:14:00+00:00 2024-04-05T01:12:03.610697678Z [2024-04-05T01:12:03.610+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:12:03.611159454Z [2024-04-05T01:12:03.610+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:11:00+00:00, run_id=scheduled__2024-04-05T01:11:00+00:00, run_start_date=2024-04-05 01:12:00.530951+00:00, run_end_date=2024-04-05 01:12:03.610582+00:00, run_duration=3.079631, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:11:00+00:00, data_interval_end=2024-04-05 01:12:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:12:03.622847316Z [2024-04-05T01:12:03.622+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:12:00+00:00, run_after=2024-04-05T01:13:00+00:00 2024-04-05T01:12:03.698631818Z [2024-04-05T01:12:03.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status success for try_number 1 2024-04-05T01:12:03.698666563Z [2024-04-05T01:12:03.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:11:00+00:00 exited with status success for try_number 1 2024-04-05T01:12:03.710868802Z [2024-04-05T01:12:03.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:11:00+00:00, map_index=-1, run_start_date=2024-04-05 01:12:02.755810+00:00, run_end_date=2024-04-05 01:12:03.233536+00:00, run_duration=0.477726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=723, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:12:00.606447+00:00, queued_by_job_id=1, pid=10541 2024-04-05T01:12:03.710996399Z [2024-04-05T01:12:03.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:10:00+00:00, map_index=-1, run_start_date=2024-04-05 01:12:02.264487+00:00, run_end_date=2024-04-05 01:12:02.924858+00:00, run_duration=0.660371, state=success, executor_state=success, try_number=1, max_tries=1, job_id=722, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:12:00.606447+00:00, queued_by_job_id=1, pid=10534 2024-04-05T01:12:06.943081345Z [2024-04-05T01:12:06.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:12:06.943552626Z [2024-04-05T01:12:06.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:11:00+00:00, run_id=scheduled__2024-04-05T01:11:00+00:00, run_start_date=2024-04-05 01:12:00.533436+00:00, run_end_date=2024-04-05 01:12:06.943205+00:00, run_duration=6.409769, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:11:00+00:00, data_interval_end=2024-04-05 01:12:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:12:06.954726654Z [2024-04-05T01:12:06.954+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:12:00+00:00, run_after=2024-04-05T01:13:00+00:00 2024-04-05T01:12:07.019896872Z [2024-04-05T01:12:07.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:11:00+00:00 exited with status success for try_number 1 2024-04-05T01:12:07.030109960Z [2024-04-05T01:12:07.029+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:11:00+00:00, map_index=-1, run_start_date=2024-04-05 01:12:03.506510+00:00, run_end_date=2024-04-05 01:12:06.122985+00:00, run_duration=2.616475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=724, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:12:00.606447+00:00, queued_by_job_id=1, pid=10558 2024-04-05T01:12:07.542127371Z [2024-04-05T01:12:07.541+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:12:07.542393997Z [2024-04-05T01:12:07.542+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:11:00+00:00, run_id=scheduled__2024-04-05T01:11:00+00:00, run_start_date=2024-04-05 01:12:00.532233+00:00, run_end_date=2024-04-05 01:12:07.542006+00:00, run_duration=7.009773, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:11:00+00:00, data_interval_end=2024-04-05 01:12:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:12:07.550831776Z [2024-04-05T01:12:07.550+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:12:00+00:00, run_after=2024-04-05T01:13:00+00:00 2024-04-05T01:12:07.583374504Z [2024-04-05T01:12:07.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:11:00+00:00 exited with status success for try_number 1 2024-04-05T01:12:07.589643873Z [2024-04-05T01:12:07.589+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:11:00+00:00, map_index=-1, run_start_date=2024-04-05 01:12:04.194091+00:00, run_end_date=2024-04-05 01:12:07.173478+00:00, run_duration=2.979387, state=success, executor_state=success, try_number=1, max_tries=1, job_id=725, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:12:00.606447+00:00, queued_by_job_id=1, pid=10569 2024-04-05T01:13:00.398225947Z [2024-04-05T01:13:00.397+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:13:00+00:00, run_after=2024-04-05T01:14:00+00:00 2024-04-05T01:13:00.411907140Z [2024-04-05T01:13:00.411+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:13:00+00:00, run_after=2024-04-05T01:14:00+00:00 2024-04-05T01:13:00.419338898Z [2024-04-05T01:13:00.418+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:13:00.487790399Z [2024-04-05T01:13:00.487+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:13:00.487854399Z 2024-04-05T01:13:00.487858586Z 2024-04-05T01:13:00.487861753Z 2024-04-05T01:13:00.488048247Z [2024-04-05T01:13:00.487+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:13:00.488283614Z [2024-04-05T01:13:00.488+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:13:00.488447799Z [2024-04-05T01:13:00.488+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:13:00.489265251Z [2024-04-05T01:13:00.489+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:13:00.489271491Z 2024-04-05T01:13:00.489274716Z 2024-04-05T01:13:00.489277734Z 2024-04-05T01:13:00.499214816Z [2024-04-05T01:13:00.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:13:00.500014209Z [2024-04-05T01:13:00.499+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:13:00.506159336Z [2024-04-05T01:13:00.503+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:13:00.506698026Z [2024-04-05T01:13:00.506+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:13:00.507641959Z [2024-04-05T01:13:00.507+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:13:00.507803729Z [2024-04-05T01:13:00.507+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:13:01.039506507Z [2024-04-05T01:13:01.038+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:12:00+00:00 exited with status queued for try_number 1 2024-04-05T01:13:01.039683524Z [2024-04-05T01:13:01.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:12:00+00:00 exited with status queued for try_number 1 2024-04-05T01:13:01.039874743Z [2024-04-05T01:13:01.039+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:12:00+00:00 exited with status queued for try_number 1 2024-04-05T01:13:01.065974832Z [2024-04-05T01:13:01.065+0000] {scheduler_job.py:635} INFO - Setting external_id for to fc1589a3-a24e-4623-a58b-1392888044e6 2024-04-05T01:13:01.066177909Z [2024-04-05T01:13:01.065+0000] {scheduler_job.py:635} INFO - Setting external_id for to 400842bd-eaaf-4c4a-b2da-592827ad9b67 2024-04-05T01:13:01.066417087Z [2024-04-05T01:13:01.066+0000] {scheduler_job.py:635} INFO - Setting external_id for to 039bddac-896f-4197-8201-5ea348ab5873 2024-04-05T01:13:03.359836654Z [2024-04-05T01:13:03.359+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:13:03.360380889Z [2024-04-05T01:13:03.360+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:12:00+00:00, run_id=scheduled__2024-04-05T01:12:00+00:00, run_start_date=2024-04-05 01:13:00.432732+00:00, run_end_date=2024-04-05 01:13:03.359999+00:00, run_duration=2.927267, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:12:00+00:00, data_interval_end=2024-04-05 01:13:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:13:03.373283075Z [2024-04-05T01:13:03.372+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:13:00+00:00, run_after=2024-04-05T01:14:00+00:00 2024-04-05T01:13:03.430986891Z [2024-04-05T01:13:03.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:12:00+00:00 exited with status success for try_number 1 2024-04-05T01:13:03.436007415Z [2024-04-05T01:13:03.435+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:12:00+00:00, map_index=-1, run_start_date=2024-04-05 01:13:02.014468+00:00, run_end_date=2024-04-05 01:13:02.468544+00:00, run_duration=0.454076, state=success, executor_state=success, try_number=1, max_tries=1, job_id=726, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:13:00.490870+00:00, queued_by_job_id=1, pid=10598 2024-04-05T01:13:05.143476678Z [2024-04-05T01:13:05.142+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:13:05.143957491Z [2024-04-05T01:13:05.143+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:12:00+00:00, run_id=scheduled__2024-04-05T01:12:00+00:00, run_start_date=2024-04-05 01:13:00.434035+00:00, run_end_date=2024-04-05 01:13:05.143505+00:00, run_duration=4.70947, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:12:00+00:00, data_interval_end=2024-04-05 01:13:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:13:05.153606891Z [2024-04-05T01:13:05.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:13:00+00:00, run_after=2024-04-05T01:14:00+00:00 2024-04-05T01:13:05.215864166Z [2024-04-05T01:13:05.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:12:00+00:00 exited with status success for try_number 1 2024-04-05T01:13:05.224368862Z [2024-04-05T01:13:05.223+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:12:00+00:00, map_index=-1, run_start_date=2024-04-05 01:13:02.779152+00:00, run_end_date=2024-04-05 01:13:04.546728+00:00, run_duration=1.767576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=727, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:13:00.490870+00:00, queued_by_job_id=1, pid=10614 2024-04-05T01:13:06.264179397Z [2024-04-05T01:13:06.263+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:13:06.264614200Z [2024-04-05T01:13:06.264+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:12:00+00:00, run_id=scheduled__2024-04-05T01:12:00+00:00, run_start_date=2024-04-05 01:13:00.435085+00:00, run_end_date=2024-04-05 01:13:06.264275+00:00, run_duration=5.82919, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:12:00+00:00, data_interval_end=2024-04-05 01:13:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:13:06.273815028Z [2024-04-05T01:13:06.273+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:13:00+00:00, run_after=2024-04-05T01:14:00+00:00 2024-04-05T01:13:06.312356318Z [2024-04-05T01:13:06.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:12:00+00:00 exited with status success for try_number 1 2024-04-05T01:13:06.321404036Z [2024-04-05T01:13:06.320+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:12:00+00:00, map_index=-1, run_start_date=2024-04-05 01:13:02.845414+00:00, run_end_date=2024-04-05 01:13:05.574759+00:00, run_duration=2.729345, state=success, executor_state=success, try_number=1, max_tries=1, job_id=728, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:13:00.490870+00:00, queued_by_job_id=1, pid=10615 2024-04-05T01:14:00.315894171Z [2024-04-05T01:14:00.315+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:14:00.325201272Z [2024-04-05T01:14:00.324+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:14:00.345729293Z [2024-04-05T01:14:00.345+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:14:00+00:00, run_after=2024-04-05T01:15:00+00:00 2024-04-05T01:14:00.377661177Z [2024-04-05T01:14:00.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:14:00+00:00, run_after=2024-04-05T01:15:00+00:00 2024-04-05T01:14:00.482121068Z [2024-04-05T01:14:00.481+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:14:00.482161564Z 2024-04-05T01:14:00.482166041Z 2024-04-05T01:14:00.482169133Z 2024-04-05T01:14:00.482172160Z 2024-04-05T01:14:00.482543792Z [2024-04-05T01:14:00.482+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:14:00.483209995Z [2024-04-05T01:14:00.482+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:14:00.483655156Z [2024-04-05T01:14:00.483+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:14:00.484133555Z [2024-04-05T01:14:00.483+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:14:00.485332887Z [2024-04-05T01:14:00.485+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:14:00.485352953Z 2024-04-05T01:14:00.485385137Z 2024-04-05T01:14:00.485391406Z 2024-04-05T01:14:00.485397508Z 2024-04-05T01:14:00.498757867Z [2024-04-05T01:14:00.498+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:14:00.500577701Z [2024-04-05T01:14:00.500+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:14:00.501089304Z [2024-04-05T01:14:00.500+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:14:00.501303749Z [2024-04-05T01:14:00.501+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:14:00.501652946Z [2024-04-05T01:14:00.501+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:14:00.501938309Z [2024-04-05T01:14:00.501+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:14:00.502260577Z [2024-04-05T01:14:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:14:00.502485199Z [2024-04-05T01:14:00.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:14:01.151701520Z [2024-04-05T01:14:01.150+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:12:00+00:00 exited with status queued for try_number 1 2024-04-05T01:14:01.151728895Z [2024-04-05T01:14:01.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:13:00+00:00 exited with status queued for try_number 1 2024-04-05T01:14:01.156031675Z [2024-04-05T01:14:01.151+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:13:00+00:00 exited with status queued for try_number 1 2024-04-05T01:14:01.156162663Z [2024-04-05T01:14:01.155+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:13:00+00:00 exited with status queued for try_number 1 2024-04-05T01:14:01.177576196Z [2024-04-05T01:14:01.174+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d03d498-3201-4df8-86a3-db86b452edb5 2024-04-05T01:14:01.177604356Z [2024-04-05T01:14:01.174+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2fc635ac-b511-4071-972c-479300e41400 2024-04-05T01:14:01.177608186Z [2024-04-05T01:14:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3466b568-e9d6-4ffc-a87d-5629c119409b 2024-04-05T01:14:01.177612062Z [2024-04-05T01:14:01.175+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40db0006-d6f0-4aaf-bfe1-ba6985e3b20e 2024-04-05T01:14:02.526190996Z [2024-04-05T01:14:02.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:14:02.526835152Z [2024-04-05T01:14:02.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:12:00+00:00, run_id=scheduled__2024-04-05T01:12:00+00:00, run_start_date=2024-04-05 01:14:00.402300+00:00, run_end_date=2024-04-05 01:14:02.526392+00:00, run_duration=2.124092, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:12:00+00:00, data_interval_end=2024-04-05 01:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:14:02.544835164Z [2024-04-05T01:14:02.544+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:14:00+00:00, run_after=2024-04-05T01:16:00+00:00 2024-04-05T01:14:02.638928067Z [2024-04-05T01:14:02.638+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:12:00+00:00 exited with status success for try_number 1 2024-04-05T01:14:02.646191530Z [2024-04-05T01:14:02.645+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:12:00+00:00, map_index=-1, run_start_date=2024-04-05 01:14:01.774441+00:00, run_end_date=2024-04-05 01:14:02.241735+00:00, run_duration=0.467294, state=success, executor_state=success, try_number=1, max_tries=1, job_id=729, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:14:00.487652+00:00, queued_by_job_id=1, pid=10643 2024-04-05T01:14:03.702018149Z [2024-04-05T01:14:03.701+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:14:03.702471550Z [2024-04-05T01:14:03.702+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:13:00+00:00, run_id=scheduled__2024-04-05T01:13:00+00:00, run_start_date=2024-04-05 01:14:00.404580+00:00, run_end_date=2024-04-05 01:14:03.701909+00:00, run_duration=3.297329, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:13:00+00:00, data_interval_end=2024-04-05 01:14:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:14:03.715889900Z [2024-04-05T01:14:03.715+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:14:00+00:00, run_after=2024-04-05T01:15:00+00:00 2024-04-05T01:14:03.767767748Z [2024-04-05T01:14:03.767+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:13:00+00:00 exited with status success for try_number 1 2024-04-05T01:14:03.775228817Z [2024-04-05T01:14:03.774+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:13:00+00:00, map_index=-1, run_start_date=2024-04-05 01:14:02.168180+00:00, run_end_date=2024-04-05 01:14:02.719814+00:00, run_duration=0.551634, state=success, executor_state=success, try_number=1, max_tries=1, job_id=730, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:14:00.487652+00:00, queued_by_job_id=1, pid=10654 2024-04-05T01:14:05.478978721Z [2024-04-05T01:14:05.478+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:14:05.479420971Z [2024-04-05T01:14:05.479+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:13:00+00:00, run_id=scheduled__2024-04-05T01:13:00+00:00, run_start_date=2024-04-05 01:14:00.408030+00:00, run_end_date=2024-04-05 01:14:05.478922+00:00, run_duration=5.070892, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:13:00+00:00, data_interval_end=2024-04-05 01:14:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:14:05.491953819Z [2024-04-05T01:14:05.491+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:14:00+00:00, run_after=2024-04-05T01:15:00+00:00 2024-04-05T01:14:05.540874473Z [2024-04-05T01:14:05.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:13:00+00:00 exited with status success for try_number 1 2024-04-05T01:14:05.547128344Z [2024-04-05T01:14:05.546+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:13:00+00:00, map_index=-1, run_start_date=2024-04-05 01:14:03.044518+00:00, run_end_date=2024-04-05 01:14:04.988999+00:00, run_duration=1.944481, state=success, executor_state=success, try_number=1, max_tries=1, job_id=731, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:14:00.487652+00:00, queued_by_job_id=1, pid=10672 2024-04-05T01:14:06.609821571Z [2024-04-05T01:14:06.609+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:14:06.610022578Z [2024-04-05T01:14:06.609+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:13:00+00:00, run_id=scheduled__2024-04-05T01:13:00+00:00, run_start_date=2024-04-05 01:14:00.409438+00:00, run_end_date=2024-04-05 01:14:06.609581+00:00, run_duration=6.200143, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:13:00+00:00, data_interval_end=2024-04-05 01:14:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:14:06.632257272Z [2024-04-05T01:14:06.631+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:14:00+00:00, run_after=2024-04-05T01:15:00+00:00 2024-04-05T01:14:06.689367801Z [2024-04-05T01:14:06.688+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:13:00+00:00 exited with status success for try_number 1 2024-04-05T01:14:06.695251532Z [2024-04-05T01:14:06.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:13:00+00:00, map_index=-1, run_start_date=2024-04-05 01:14:03.153306+00:00, run_end_date=2024-04-05 01:14:05.975086+00:00, run_duration=2.82178, state=success, executor_state=success, try_number=1, max_tries=1, job_id=732, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:14:00.487652+00:00, queued_by_job_id=1, pid=10673 2024-04-05T01:15:00.254084185Z [2024-04-05T01:15:00.253+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:15:00+00:00, run_after=2024-04-05T01:16:00+00:00 2024-04-05T01:15:00.281654736Z [2024-04-05T01:15:00.281+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:15:00+00:00, run_after=2024-04-05T01:16:00+00:00 2024-04-05T01:15:00.290652903Z [2024-04-05T01:15:00.290+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:15:00.311021877Z [2024-04-05T01:15:00.310+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:15:00+00:00, run_after=2024-04-05T01:20:00+00:00 2024-04-05T01:15:00.445291885Z [2024-04-05T01:15:00.444+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:15:00.445324406Z 2024-04-05T01:15:00.445330060Z 2024-04-05T01:15:00.445339191Z 2024-04-05T01:15:00.445344458Z 2024-04-05T01:15:00.445399836Z [2024-04-05T01:15:00.445+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:15:00.445535276Z [2024-04-05T01:15:00.445+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:15:00.445646142Z [2024-04-05T01:15:00.445+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:15:00.445757258Z [2024-04-05T01:15:00.445+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:15:00.450397175Z [2024-04-05T01:15:00.450+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:15:00.450421690Z 2024-04-05T01:15:00.450425818Z 2024-04-05T01:15:00.450429112Z 2024-04-05T01:15:00.450432375Z 2024-04-05T01:15:00.458168167Z [2024-04-05T01:15:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:15:00.458542830Z [2024-04-05T01:15:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:15:00.458848744Z [2024-04-05T01:15:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:15:00.458973548Z [2024-04-05T01:15:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:15:00.459232339Z [2024-04-05T01:15:00.459+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:15:00.459384909Z [2024-04-05T01:15:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:15:00.459682481Z [2024-04-05T01:15:00.459+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:15:00.459826024Z [2024-04-05T01:15:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:15:00.934020916Z [2024-04-05T01:15:00.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status queued for try_number 1 2024-04-05T01:15:00.934230808Z [2024-04-05T01:15:00.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:14:00+00:00 exited with status queued for try_number 1 2024-04-05T01:15:00.934387175Z [2024-04-05T01:15:00.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:14:00+00:00 exited with status queued for try_number 1 2024-04-05T01:15:00.934532801Z [2024-04-05T01:15:00.934+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:14:00+00:00 exited with status queued for try_number 1 2024-04-05T01:15:00.950097741Z [2024-04-05T01:15:00.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ddd1fab-dd14-4c2a-85d5-05c2956ac341 2024-04-05T01:15:00.950372417Z [2024-04-05T01:15:00.950+0000] {scheduler_job.py:635} INFO - Setting external_id for to 677851c7-e649-4ee7-b41c-fc09a5bcef5a 2024-04-05T01:15:00.950786419Z [2024-04-05T01:15:00.950+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe98030c-edbf-4486-a57e-afddd934098f 2024-04-05T01:15:00.951644552Z [2024-04-05T01:15:00.951+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1aab02d7-9878-4ce1-8820-26a7711e2ebc 2024-04-05T01:15:03.489967248Z [2024-04-05T01:15:03.489+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:15:03.490901571Z [2024-04-05T01:15:03.490+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:14:00+00:00, run_id=scheduled__2024-04-05T01:14:00+00:00, run_start_date=2024-04-05 01:15:00.327519+00:00, run_end_date=2024-04-05 01:15:03.489822+00:00, run_duration=3.162303, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:14:00+00:00, data_interval_end=2024-04-05 01:15:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:15:03.502391000Z [2024-04-05T01:15:03.501+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:15:00+00:00, run_after=2024-04-05T01:16:00+00:00 2024-04-05T01:15:03.622440058Z [2024-04-05T01:15:03.621+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:14:00+00:00 exited with status success for try_number 1 2024-04-05T01:15:03.633053491Z [2024-04-05T01:15:03.632+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:14:00+00:00, map_index=-1, run_start_date=2024-04-05 01:15:01.996408+00:00, run_end_date=2024-04-05 01:15:02.558382+00:00, run_duration=0.561974, state=success, executor_state=success, try_number=1, max_tries=1, job_id=733, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:15:00.453767+00:00, queued_by_job_id=1, pid=10706 2024-04-05T01:15:04.769974035Z [2024-04-05T01:15:04.769+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:15:04.770001380Z 2024-04-05T01:15:04.770228216Z [2024-04-05T01:15:04.769+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:15:04.771046067Z [2024-04-05T01:15:04.770+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:15:04.771052544Z 2024-04-05T01:15:04.776118966Z [2024-04-05T01:15:04.775+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:15:04.776341315Z [2024-04-05T01:15:04.776+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:15:04.838796192Z [2024-04-05T01:15:04.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status queued for try_number 1 2024-04-05T01:15:04.838895219Z [2024-04-05T01:15:04.838+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status success for try_number 1 2024-04-05T01:15:04.849421064Z [2024-04-05T01:15:04.848+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71bd9d5d-4ab6-4c6b-ad0b-68f00b9f11ef 2024-04-05T01:15:04.849655997Z [2024-04-05T01:15:04.849+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:10:00+00:00, map_index=-1, run_start_date=2024-04-05 01:15:03.606352+00:00, run_end_date=2024-04-05 01:15:04.040015+00:00, run_duration=0.433663, state=success, executor_state=success, try_number=1, max_tries=1, job_id=736, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:15:00.453767+00:00, queued_by_job_id=1, pid=10736 2024-04-05T01:15:04.917941199Z [2024-04-05T01:15:04.917+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:15:04.918196630Z [2024-04-05T01:15:04.918+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:14:00+00:00, run_id=scheduled__2024-04-05T01:14:00+00:00, run_start_date=2024-04-05 01:15:00.328577+00:00, run_end_date=2024-04-05 01:15:04.917843+00:00, run_duration=4.589266, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:14:00+00:00, data_interval_end=2024-04-05 01:15:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:15:04.928058741Z [2024-04-05T01:15:04.927+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:15:00+00:00, run_after=2024-04-05T01:16:00+00:00 2024-04-05T01:15:04.994140536Z [2024-04-05T01:15:04.993+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:14:00+00:00 exited with status success for try_number 1 2024-04-05T01:15:05.014634938Z [2024-04-05T01:15:05.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:14:00+00:00, map_index=-1, run_start_date=2024-04-05 01:15:03.401252+00:00, run_end_date=2024-04-05 01:15:04.765330+00:00, run_duration=1.364078, state=success, executor_state=success, try_number=1, max_tries=1, job_id=735, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:15:00.453767+00:00, queued_by_job_id=1, pid=10730 2024-04-05T01:15:06.030114278Z [2024-04-05T01:15:06.029+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:15:06.030629550Z [2024-04-05T01:15:06.030+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:14:00+00:00, run_id=scheduled__2024-04-05T01:14:00+00:00, run_start_date=2024-04-05 01:15:00.329714+00:00, run_end_date=2024-04-05 01:15:06.030023+00:00, run_duration=5.700309, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:14:00+00:00, data_interval_end=2024-04-05 01:15:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:15:06.043410969Z [2024-04-05T01:15:06.042+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:15:00+00:00, run_after=2024-04-05T01:16:00+00:00 2024-04-05T01:15:06.109060729Z [2024-04-05T01:15:06.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:14:00+00:00 exited with status success for try_number 1 2024-04-05T01:15:06.117214888Z [2024-04-05T01:15:06.116+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:14:00+00:00, map_index=-1, run_start_date=2024-04-05 01:15:03.102752+00:00, run_end_date=2024-04-05 01:15:05.605576+00:00, run_duration=2.502824, state=success, executor_state=success, try_number=1, max_tries=1, job_id=734, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:15:00.453767+00:00, queued_by_job_id=1, pid=10719 2024-04-05T01:15:07.223344614Z [2024-04-05T01:15:07.222+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:15:07.223379657Z 2024-04-05T01:15:07.223491979Z [2024-04-05T01:15:07.223+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:15:07.224328528Z [2024-04-05T01:15:07.224+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:15:07.224349864Z 2024-04-05T01:15:07.228649160Z [2024-04-05T01:15:07.228+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:15:07.229083767Z [2024-04-05T01:15:07.228+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:15:07.282763520Z [2024-04-05T01:15:07.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status queued for try_number 1 2024-04-05T01:15:07.283034692Z [2024-04-05T01:15:07.282+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status success for try_number 1 2024-04-05T01:15:07.293195948Z [2024-04-05T01:15:07.292+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2513873f-b2ad-4f8d-b9bc-adfc0fb4bdc0 2024-04-05T01:15:07.293563783Z [2024-04-05T01:15:07.293+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T01:10:00+00:00, map_index=-1, run_start_date=2024-04-05 01:15:06.521749+00:00, run_end_date=2024-04-05 01:15:06.874613+00:00, run_duration=0.352864, state=success, executor_state=success, try_number=1, max_tries=1, job_id=737, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:15:04.771727+00:00, queued_by_job_id=1, pid=10754 2024-04-05T01:15:09.549336798Z [2024-04-05T01:15:09.548+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:15:09.549372286Z 2024-04-05T01:15:09.549397099Z [2024-04-05T01:15:09.549+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:15:09.551519342Z [2024-04-05T01:15:09.551+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:15:09.551661645Z 2024-04-05T01:15:09.559992856Z [2024-04-05T01:15:09.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:15:09.560185138Z [2024-04-05T01:15:09.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:15:09.617138385Z [2024-04-05T01:15:09.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status queued for try_number 1 2024-04-05T01:15:09.617435181Z [2024-04-05T01:15:09.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status success for try_number 1 2024-04-05T01:15:09.623811562Z [2024-04-05T01:15:09.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to d07d6fc7-79d7-41f1-9065-d668b405f9b0 2024-04-05T01:15:09.624949310Z [2024-04-05T01:15:09.624+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:10:00+00:00, map_index=0, run_start_date=2024-04-05 01:15:08.873166+00:00, run_end_date=2024-04-05 01:15:09.185088+00:00, run_duration=0.311922, state=success, executor_state=success, try_number=1, max_tries=1, job_id=738, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:15:07.224784+00:00, queued_by_job_id=1, pid=10762 2024-04-05T01:15:12.339900159Z [2024-04-05T01:15:12.339+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:15:12.340221339Z [2024-04-05T01:15:12.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:10:00+00:00, run_id=scheduled__2024-04-05T01:10:00+00:00, run_start_date=2024-04-05 01:15:00.325766+00:00, run_end_date=2024-04-05 01:15:12.339665+00:00, run_duration=12.013899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:10:00+00:00, data_interval_end=2024-04-05 01:15:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T01:15:12.346285567Z [2024-04-05T01:15:12.345+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:15:00+00:00, run_after=2024-04-05T01:20:00+00:00 2024-04-05T01:15:12.390727207Z [2024-04-05T01:15:12.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status success for try_number 1 2024-04-05T01:15:12.395451237Z [2024-04-05T01:15:12.395+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:10:00+00:00, map_index=-1, run_start_date=2024-04-05 01:15:11.172128+00:00, run_end_date=2024-04-05 01:15:11.567073+00:00, run_duration=0.394945, state=success, executor_state=success, try_number=1, max_tries=1, job_id=739, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:15:09.552381+00:00, queued_by_job_id=1, pid=10781 2024-04-05T01:15:41.040173108Z [2024-04-05T01:15:41.039+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T01:16:00.032179269Z [2024-04-05T01:16:00.031+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:16:00+00:00, run_after=2024-04-05T01:17:00+00:00 2024-04-05T01:16:00.045098174Z [2024-04-05T01:16:00.042+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:16:00.060913064Z [2024-04-05T01:16:00.060+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:16:00.083714460Z [2024-04-05T01:16:00.083+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:16:00+00:00, run_after=2024-04-05T01:17:00+00:00 2024-04-05T01:16:00.162702474Z [2024-04-05T01:16:00.162+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:16:00.162732894Z 2024-04-05T01:16:00.162736993Z 2024-04-05T01:16:00.162740334Z 2024-04-05T01:16:00.162743650Z 2024-04-05T01:16:00.162934037Z [2024-04-05T01:16:00.162+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:16:00.163195399Z [2024-04-05T01:16:00.163+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:16:00.163398821Z [2024-04-05T01:16:00.163+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:16:00.163621454Z [2024-04-05T01:16:00.163+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:16:00.164261065Z [2024-04-05T01:16:00.164+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:16:00.164272803Z 2024-04-05T01:16:00.164276531Z 2024-04-05T01:16:00.164279960Z 2024-04-05T01:16:00.164283386Z 2024-04-05T01:16:00.168040841Z [2024-04-05T01:16:00.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:16:00.168308093Z [2024-04-05T01:16:00.167+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:16:00.168628155Z [2024-04-05T01:16:00.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:16:00.168839654Z [2024-04-05T01:16:00.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:16:00.169159800Z [2024-04-05T01:16:00.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:16:00.169471920Z [2024-04-05T01:16:00.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:16:00.169801446Z [2024-04-05T01:16:00.169+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:16:00.170018033Z [2024-04-05T01:16:00.169+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:16:00.593904836Z [2024-04-05T01:16:00.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:14:00+00:00 exited with status queued for try_number 1 2024-04-05T01:16:00.594046661Z [2024-04-05T01:16:00.593+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:15:00+00:00 exited with status queued for try_number 1 2024-04-05T01:16:00.594191941Z [2024-04-05T01:16:00.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:15:00+00:00 exited with status queued for try_number 1 2024-04-05T01:16:00.594286035Z [2024-04-05T01:16:00.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:15:00+00:00 exited with status queued for try_number 1 2024-04-05T01:16:00.604949773Z [2024-04-05T01:16:00.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6cfd1ace-e1da-4076-b7be-26e86d41a806 2024-04-05T01:16:00.605202378Z [2024-04-05T01:16:00.604+0000] {scheduler_job.py:635} INFO - Setting external_id for to 91e68d20-999c-4a74-8d4b-56b21781b09e 2024-04-05T01:16:00.605382934Z [2024-04-05T01:16:00.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to 63d82653-47dc-498b-aef9-cb9d376488a8 2024-04-05T01:16:00.605539496Z [2024-04-05T01:16:00.605+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6daa904e-5f5e-4fbd-b1f9-5fcb7e05fa00 2024-04-05T01:16:03.260320861Z [2024-04-05T01:16:03.259+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:16:03.260693596Z [2024-04-05T01:16:03.260+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:14:00+00:00, run_id=scheduled__2024-04-05T01:14:00+00:00, run_start_date=2024-04-05 01:16:00.095151+00:00, run_end_date=2024-04-05 01:16:03.260168+00:00, run_duration=3.165017, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:14:00+00:00, data_interval_end=2024-04-05 01:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:16:03.270325081Z [2024-04-05T01:16:03.269+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:16:00+00:00, run_after=2024-04-05T01:18:00+00:00 2024-04-05T01:16:03.277777711Z [2024-04-05T01:16:03.277+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:16:03.278018411Z [2024-04-05T01:16:03.277+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:15:00+00:00, run_id=scheduled__2024-04-05T01:15:00+00:00, run_start_date=2024-04-05 01:16:00.096450+00:00, run_end_date=2024-04-05 01:16:03.277669+00:00, run_duration=3.181219, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:15:00+00:00, data_interval_end=2024-04-05 01:16:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:16:03.289650058Z [2024-04-05T01:16:03.289+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:16:00+00:00, run_after=2024-04-05T01:17:00+00:00 2024-04-05T01:16:03.335949006Z [2024-04-05T01:16:03.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:14:00+00:00 exited with status success for try_number 1 2024-04-05T01:16:03.336041886Z [2024-04-05T01:16:03.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:15:00+00:00 exited with status success for try_number 1 2024-04-05T01:16:03.345949755Z [2024-04-05T01:16:03.345+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:15:00+00:00, map_index=-1, run_start_date=2024-04-05 01:16:01.732016+00:00, run_end_date=2024-04-05 01:16:02.413838+00:00, run_duration=0.681822, state=success, executor_state=success, try_number=1, max_tries=1, job_id=741, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:16:00.165388+00:00, queued_by_job_id=1, pid=10797 2024-04-05T01:16:03.346052912Z [2024-04-05T01:16:03.345+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:14:00+00:00, map_index=-1, run_start_date=2024-04-05 01:16:01.374193+00:00, run_end_date=2024-04-05 01:16:01.988369+00:00, run_duration=0.614176, state=success, executor_state=success, try_number=1, max_tries=1, job_id=740, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:16:00.165388+00:00, queued_by_job_id=1, pid=10789 2024-04-05T01:16:04.395068401Z [2024-04-05T01:16:04.394+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:16:04.395343968Z [2024-04-05T01:16:04.395+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:15:00+00:00, run_id=scheduled__2024-04-05T01:15:00+00:00, run_start_date=2024-04-05 01:16:00.097510+00:00, run_end_date=2024-04-05 01:16:04.394907+00:00, run_duration=4.297397, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:15:00+00:00, data_interval_end=2024-04-05 01:16:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:16:04.408035874Z [2024-04-05T01:16:04.407+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:16:00+00:00, run_after=2024-04-05T01:17:00+00:00 2024-04-05T01:16:05.236597429Z [2024-04-05T01:16:05.236+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:15:00+00:00 exited with status success for try_number 1 2024-04-05T01:16:05.242774344Z [2024-04-05T01:16:05.242+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:15:00+00:00, map_index=-1, run_start_date=2024-04-05 01:16:02.811271+00:00, run_end_date=2024-04-05 01:16:04.336483+00:00, run_duration=1.525212, state=success, executor_state=success, try_number=1, max_tries=1, job_id=742, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:16:00.165388+00:00, queued_by_job_id=1, pid=10813 2024-04-05T01:16:06.287093302Z [2024-04-05T01:16:06.286+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:16:06.287520496Z [2024-04-05T01:16:06.287+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:15:00+00:00, run_id=scheduled__2024-04-05T01:15:00+00:00, run_start_date=2024-04-05 01:16:00.098467+00:00, run_end_date=2024-04-05 01:16:06.287171+00:00, run_duration=6.188704, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:15:00+00:00, data_interval_end=2024-04-05 01:16:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:16:06.296600885Z [2024-04-05T01:16:06.296+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:16:00+00:00, run_after=2024-04-05T01:17:00+00:00 2024-04-05T01:16:06.328029607Z [2024-04-05T01:16:06.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:15:00+00:00 exited with status success for try_number 1 2024-04-05T01:16:06.330971079Z [2024-04-05T01:16:06.330+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:15:00+00:00, map_index=-1, run_start_date=2024-04-05 01:16:03.081751+00:00, run_end_date=2024-04-05 01:16:05.142094+00:00, run_duration=2.060343, state=success, executor_state=success, try_number=1, max_tries=1, job_id=743, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:16:00.165388+00:00, queued_by_job_id=1, pid=10823 2024-04-05T01:17:00.090387236Z [2024-04-05T01:17:00.085+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:17:00+00:00, run_after=2024-04-05T01:18:00+00:00 2024-04-05T01:17:00.120038640Z [2024-04-05T01:17:00.119+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:17:00+00:00, run_after=2024-04-05T01:18:00+00:00 2024-04-05T01:17:00.131162687Z [2024-04-05T01:17:00.130+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:17:00.211240440Z [2024-04-05T01:17:00.210+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:17:00.211274694Z 2024-04-05T01:17:00.211280853Z 2024-04-05T01:17:00.211285395Z 2024-04-05T01:17:00.211588892Z [2024-04-05T01:17:00.211+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:17:00.211867764Z [2024-04-05T01:17:00.211+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:17:00.212127370Z [2024-04-05T01:17:00.211+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:17:00.212914390Z [2024-04-05T01:17:00.212+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:17:00.212974369Z 2024-04-05T01:17:00.212981252Z 2024-04-05T01:17:00.212986542Z 2024-04-05T01:17:00.216300967Z [2024-04-05T01:17:00.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:17:00.216555014Z [2024-04-05T01:17:00.216+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:17:00.216988680Z [2024-04-05T01:17:00.216+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:17:00.217373201Z [2024-04-05T01:17:00.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:17:00.217697965Z [2024-04-05T01:17:00.217+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:17:00.217928669Z [2024-04-05T01:17:00.217+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:17:00.513434358Z [2024-04-05T01:17:00.503+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:16:00+00:00 exited with status queued for try_number 1 2024-04-05T01:17:00.520957272Z [2024-04-05T01:17:00.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:16:00+00:00 exited with status queued for try_number 1 2024-04-05T01:17:00.521080588Z [2024-04-05T01:17:00.520+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:16:00+00:00 exited with status queued for try_number 1 2024-04-05T01:17:00.540715878Z [2024-04-05T01:17:00.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to 738b9e17-f273-4a57-ae13-1530342ecc16 2024-04-05T01:17:00.544012161Z [2024-04-05T01:17:00.543+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd7cdddd-d647-47b2-983b-352ee066b4aa 2024-04-05T01:17:00.544228623Z [2024-04-05T01:17:00.544+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0096370d-6427-4663-a8bc-c2cdf8973546 2024-04-05T01:17:02.879577117Z [2024-04-05T01:17:02.878+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:17:02.881562958Z [2024-04-05T01:17:02.881+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:16:00+00:00, run_id=scheduled__2024-04-05T01:16:00+00:00, run_start_date=2024-04-05 01:17:00.145494+00:00, run_end_date=2024-04-05 01:17:02.880477+00:00, run_duration=2.734983, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:16:00+00:00, data_interval_end=2024-04-05 01:17:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:17:02.899655133Z [2024-04-05T01:17:02.899+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:17:00+00:00, run_after=2024-04-05T01:18:00+00:00 2024-04-05T01:17:02.954562592Z [2024-04-05T01:17:02.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:16:00+00:00 exited with status success for try_number 1 2024-04-05T01:17:02.960890202Z [2024-04-05T01:17:02.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:16:00+00:00, map_index=-1, run_start_date=2024-04-05 01:17:01.573789+00:00, run_end_date=2024-04-05 01:17:01.974220+00:00, run_duration=0.400431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=744, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:17:00.213870+00:00, queued_by_job_id=1, pid=10853 2024-04-05T01:17:04.024833394Z [2024-04-05T01:17:04.023+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:17:04.025287417Z [2024-04-05T01:17:04.024+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:16:00+00:00, run_id=scheduled__2024-04-05T01:16:00+00:00, run_start_date=2024-04-05 01:17:00.148439+00:00, run_end_date=2024-04-05 01:17:04.024699+00:00, run_duration=3.87626, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:16:00+00:00, data_interval_end=2024-04-05 01:17:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:17:04.038051186Z [2024-04-05T01:17:04.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:17:00+00:00, run_after=2024-04-05T01:18:00+00:00 2024-04-05T01:17:04.093590829Z [2024-04-05T01:17:04.092+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:16:00+00:00 exited with status success for try_number 1 2024-04-05T01:17:04.100250602Z [2024-04-05T01:17:04.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:16:00+00:00, map_index=-1, run_start_date=2024-04-05 01:17:02.423739+00:00, run_end_date=2024-04-05 01:17:03.781328+00:00, run_duration=1.357589, state=success, executor_state=success, try_number=1, max_tries=1, job_id=746, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:17:00.213870+00:00, queued_by_job_id=1, pid=10870 2024-04-05T01:17:05.150591292Z [2024-04-05T01:17:05.150+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:17:05.150809096Z [2024-04-05T01:17:05.150+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:16:00+00:00, run_id=scheduled__2024-04-05T01:16:00+00:00, run_start_date=2024-04-05 01:17:00.150869+00:00, run_end_date=2024-04-05 01:17:05.150472+00:00, run_duration=4.999603, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:16:00+00:00, data_interval_end=2024-04-05 01:17:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:17:05.160352691Z [2024-04-05T01:17:05.159+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:17:00+00:00, run_after=2024-04-05T01:18:00+00:00 2024-04-05T01:17:05.192589677Z [2024-04-05T01:17:05.192+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:16:00+00:00 exited with status success for try_number 1 2024-04-05T01:17:05.198125655Z [2024-04-05T01:17:05.197+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:16:00+00:00, map_index=-1, run_start_date=2024-04-05 01:17:02.372453+00:00, run_end_date=2024-04-05 01:17:04.048656+00:00, run_duration=1.676203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=745, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:17:00.213870+00:00, queued_by_job_id=1, pid=10869 2024-04-05T01:17:38.430080230Z [2024-04-05T01:17:38.429+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:17:38.430108748Z 2024-04-05T01:17:38.430263097Z [2024-04-05T01:17:38.430+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-04-05T01:17:38.431375047Z [2024-04-05T01:17:38.431+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:17:38.431392218Z 2024-04-05T01:17:38.434561103Z [2024-04-05T01:17:38.434+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240405011737_357180', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:17:38.434863586Z [2024-04-05T01:17:38.434+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240405011737_357180', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-05T01:17:38.478331599Z [2024-04-05T01:17:38.477+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240405011737_357180 exited with status queued for try_number 1 2024-04-05T01:17:38.485145541Z [2024-04-05T01:17:38.484+0000] {scheduler_job.py:635} INFO - Setting external_id for to cacf971b-e2e0-484d-a3a7-f7fc99835353 2024-04-05T01:17:39.619938272Z [2024-04-05T01:17:39.619+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:17:39.620195762Z [2024-04-05T01:17:39.619+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-04-05 01:17:37.995799+00:00, run_id=vdu_down_20240405011737_357180, run_start_date=2024-04-05 01:17:38.402416+00:00, run_end_date=2024-04-05 01:17:39.619803+00:00, run_duration=1.217387, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-05 01:17:37.995799+00:00, data_interval_end=2024-04-05 01:17:37.995799+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-04-05T01:17:39.623596765Z [2024-04-05T01:17:39.623+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-04-05T01:17:39.665496614Z [2024-04-05T01:17:39.665+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240405011737_357180 exited with status success for try_number 1 2024-04-05T01:17:39.670888046Z [2024-04-05T01:17:39.670+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240405011737_357180, map_index=-1, run_start_date=2024-04-05 01:17:39.115948+00:00, run_end_date=2024-04-05 01:17:39.493968+00:00, run_duration=0.37802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=747, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:17:38.432040+00:00, queued_by_job_id=1, pid=10896 2024-04-05T01:18:00.823354850Z [2024-04-05T01:18:00.822+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:18:00+00:00, run_after=2024-04-05T01:19:00+00:00 2024-04-05T01:18:00.832997042Z [2024-04-05T01:18:00.832+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:18:00.841566822Z [2024-04-05T01:18:00.841+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:18:00.855247817Z [2024-04-05T01:18:00.854+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:18:00+00:00, run_after=2024-04-05T01:19:00+00:00 2024-04-05T01:18:00.952710587Z [2024-04-05T01:18:00.952+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:18:00.952748448Z 2024-04-05T01:18:00.952764691Z 2024-04-05T01:18:00.952772287Z 2024-04-05T01:18:00.952779540Z 2024-04-05T01:18:00.953012100Z [2024-04-05T01:18:00.952+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:18:00.953213558Z [2024-04-05T01:18:00.953+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:18:00.953386069Z [2024-04-05T01:18:00.953+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:18:00.953548335Z [2024-04-05T01:18:00.953+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:18:00.954255946Z [2024-04-05T01:18:00.954+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:18:00.954268185Z 2024-04-05T01:18:00.954278491Z 2024-04-05T01:18:00.954282785Z 2024-04-05T01:18:00.954287216Z 2024-04-05T01:18:00.959318824Z [2024-04-05T01:18:00.958+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:18:00.959734503Z [2024-04-05T01:18:00.959+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:18:00.960169167Z [2024-04-05T01:18:00.959+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:18:00.960506892Z [2024-04-05T01:18:00.960+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:18:00.960969496Z [2024-04-05T01:18:00.960+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:18:00.961420273Z [2024-04-05T01:18:00.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:18:00.961879887Z [2024-04-05T01:18:00.961+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:18:00.962133288Z [2024-04-05T01:18:00.961+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:18:01.523606059Z [2024-04-05T01:18:01.522+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:16:00+00:00 exited with status queued for try_number 1 2024-04-05T01:18:01.523870162Z [2024-04-05T01:18:01.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:17:00+00:00 exited with status queued for try_number 1 2024-04-05T01:18:01.524051430Z [2024-04-05T01:18:01.523+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:17:00+00:00 exited with status queued for try_number 1 2024-04-05T01:18:01.524217740Z [2024-04-05T01:18:01.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:17:00+00:00 exited with status queued for try_number 1 2024-04-05T01:18:01.534399438Z [2024-04-05T01:18:01.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2fe0dfce-9501-41ad-bc93-ab9082d18c5c 2024-04-05T01:18:01.534611497Z [2024-04-05T01:18:01.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8db6c380-df5e-403c-ba1e-547819845f70 2024-04-05T01:18:01.534842550Z [2024-04-05T01:18:01.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0c61597-2a71-49cd-ad39-731027aebd5c 2024-04-05T01:18:01.535043691Z [2024-04-05T01:18:01.534+0000] {scheduler_job.py:635} INFO - Setting external_id for to d836b18f-fa66-4cb9-bcf2-503da4cafa4a 2024-04-05T01:18:02.985239620Z [2024-04-05T01:18:02.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:18:02.985729270Z [2024-04-05T01:18:02.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:16:00+00:00, run_id=scheduled__2024-04-05T01:16:00+00:00, run_start_date=2024-04-05 01:18:00.867767+00:00, run_end_date=2024-04-05 01:18:02.985179+00:00, run_duration=2.117412, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:16:00+00:00, data_interval_end=2024-04-05 01:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:18:02.998432858Z [2024-04-05T01:18:02.998+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:18:00+00:00, run_after=2024-04-05T01:20:00+00:00 2024-04-05T01:18:03.026010021Z [2024-04-05T01:18:03.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:18:03.026376315Z [2024-04-05T01:18:03.026+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:17:00+00:00, run_id=scheduled__2024-04-05T01:17:00+00:00, run_start_date=2024-04-05 01:18:00.869226+00:00, run_end_date=2024-04-05 01:18:03.025929+00:00, run_duration=2.156703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:17:00+00:00, data_interval_end=2024-04-05 01:18:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:18:03.050175173Z [2024-04-05T01:18:03.049+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:18:00+00:00, run_after=2024-04-05T01:19:00+00:00 2024-04-05T01:18:03.131430375Z [2024-04-05T01:18:03.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:16:00+00:00 exited with status success for try_number 1 2024-04-05T01:18:03.139155435Z [2024-04-05T01:18:03.138+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:16:00+00:00, map_index=-1, run_start_date=2024-04-05 01:18:02.316150+00:00, run_end_date=2024-04-05 01:18:02.834905+00:00, run_duration=0.518755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=748, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:18:00.955229+00:00, queued_by_job_id=1, pid=10912 2024-04-05T01:18:03.822539730Z [2024-04-05T01:18:03.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:17:00+00:00 exited with status success for try_number 1 2024-04-05T01:18:03.832758078Z [2024-04-05T01:18:03.832+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:17:00+00:00, map_index=-1, run_start_date=2024-04-05 01:18:02.469888+00:00, run_end_date=2024-04-05 01:18:02.959111+00:00, run_duration=0.489223, state=success, executor_state=success, try_number=1, max_tries=1, job_id=749, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:18:00.955229+00:00, queued_by_job_id=1, pid=10913 2024-04-05T01:18:05.972765146Z [2024-04-05T01:18:05.972+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:18:05.973208395Z [2024-04-05T01:18:05.972+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:17:00+00:00, run_id=scheduled__2024-04-05T01:17:00+00:00, run_start_date=2024-04-05 01:18:00.870426+00:00, run_end_date=2024-04-05 01:18:05.972791+00:00, run_duration=5.102365, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:17:00+00:00, data_interval_end=2024-04-05 01:18:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:18:05.982984606Z [2024-04-05T01:18:05.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:18:00+00:00, run_after=2024-04-05T01:19:00+00:00 2024-04-05T01:18:06.036256718Z [2024-04-05T01:18:06.034+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:17:00+00:00 exited with status success for try_number 1 2024-04-05T01:18:06.045558188Z [2024-04-05T01:18:06.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:17:00+00:00, map_index=-1, run_start_date=2024-04-05 01:18:03.634222+00:00, run_end_date=2024-04-05 01:18:05.663180+00:00, run_duration=2.028958, state=success, executor_state=success, try_number=1, max_tries=1, job_id=751, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:18:00.955229+00:00, queued_by_job_id=1, pid=10937 2024-04-05T01:18:07.090666702Z [2024-04-05T01:18:07.090+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:18:07.091126809Z [2024-04-05T01:18:07.090+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:17:00+00:00, run_id=scheduled__2024-04-05T01:17:00+00:00, run_start_date=2024-04-05 01:18:00.871509+00:00, run_end_date=2024-04-05 01:18:07.090536+00:00, run_duration=6.219027, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:17:00+00:00, data_interval_end=2024-04-05 01:18:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:18:07.102409665Z [2024-04-05T01:18:07.102+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:18:00+00:00, run_after=2024-04-05T01:19:00+00:00 2024-04-05T01:18:07.162813569Z [2024-04-05T01:18:07.162+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:17:00+00:00 exited with status success for try_number 1 2024-04-05T01:18:07.170562816Z [2024-04-05T01:18:07.170+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:17:00+00:00, map_index=-1, run_start_date=2024-04-05 01:18:03.482143+00:00, run_end_date=2024-04-05 01:18:06.672751+00:00, run_duration=3.190608, state=success, executor_state=success, try_number=1, max_tries=1, job_id=750, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:18:00.955229+00:00, queued_by_job_id=1, pid=10936 2024-04-05T01:19:00.655006832Z [2024-04-05T01:19:00.654+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:19:00.723237469Z [2024-04-05T01:19:00.722+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:19:00+00:00, run_after=2024-04-05T01:20:00+00:00 2024-04-05T01:19:00.994685127Z [2024-04-05T01:19:00.994+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:19:00+00:00, run_after=2024-04-05T01:20:00+00:00 2024-04-05T01:19:01.140888404Z [2024-04-05T01:19:01.140+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:19:01.140966899Z 2024-04-05T01:19:01.140974366Z 2024-04-05T01:19:01.140977853Z 2024-04-05T01:19:01.141000255Z [2024-04-05T01:19:01.140+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:19:01.141268265Z [2024-04-05T01:19:01.141+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:19:01.141682991Z [2024-04-05T01:19:01.141+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:19:01.142325396Z [2024-04-05T01:19:01.142+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:19:01.142337203Z 2024-04-05T01:19:01.142340671Z 2024-04-05T01:19:01.142343983Z 2024-04-05T01:19:01.147316156Z [2024-04-05T01:19:01.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:19:01.147580067Z [2024-04-05T01:19:01.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:19:01.151064846Z [2024-04-05T01:19:01.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:19:01.151134470Z [2024-04-05T01:19:01.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:19:01.151309009Z [2024-04-05T01:19:01.151+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:19:01.151387179Z [2024-04-05T01:19:01.151+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:19:03.069124872Z [2024-04-05T01:19:03.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:18:00+00:00 exited with status queued for try_number 1 2024-04-05T01:19:03.076197579Z [2024-04-05T01:19:03.075+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:18:00+00:00 exited with status queued for try_number 1 2024-04-05T01:19:03.076386295Z [2024-04-05T01:19:03.076+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:18:00+00:00 exited with status queued for try_number 1 2024-04-05T01:19:03.140545160Z [2024-04-05T01:19:03.139+0000] {scheduler_job.py:635} INFO - Setting external_id for to a745452d-caf7-4643-816a-5283acf386df 2024-04-05T01:19:03.147167112Z [2024-04-05T01:19:03.146+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92d48dad-ca68-4e2c-93cb-a9a5b40f34d1 2024-04-05T01:19:03.147500923Z [2024-04-05T01:19:03.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89694fd9-8108-4645-8df8-8c9f4fc22610 2024-04-05T01:19:05.706848577Z [2024-04-05T01:19:05.706+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03 to 2024-04-05T01:15:00+00:00, run_after=2024-04-05T01:20:00+00:00 2024-04-05T01:19:05.753859373Z [2024-04-05T01:19:05.753+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:19:05.754315194Z [2024-04-05T01:19:05.753+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:18:00+00:00, run_id=scheduled__2024-04-05T01:18:00+00:00, run_start_date=2024-04-05 01:19:01.025176+00:00, run_end_date=2024-04-05 01:19:05.753719+00:00, run_duration=4.728543, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:18:00+00:00, data_interval_end=2024-04-05 01:19:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:19:05.763803604Z [2024-04-05T01:19:05.763+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:19:00+00:00, run_after=2024-04-05T01:20:00+00:00 2024-04-05T01:19:05.800546771Z [2024-04-05T01:19:05.800+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:19:05.800580128Z 2024-04-05T01:19:05.800760069Z [2024-04-05T01:19:05.800+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03 has 0/16 running and queued tasks 2024-04-05T01:19:05.801472739Z [2024-04-05T01:19:05.801+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:19:05.801485219Z 2024-04-05T01:19:05.803996696Z [2024-04-05T01:19:05.803+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:19:05.804227061Z [2024-04-05T01:19:05.803+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:19:05.930793135Z [2024-04-05T01:19:05.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status queued for try_number 1 2024-04-05T01:19:05.933936749Z [2024-04-05T01:19:05.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:18:00+00:00 exited with status success for try_number 1 2024-04-05T01:19:05.942069522Z [2024-04-05T01:19:05.941+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:18:00+00:00, map_index=-1, run_start_date=2024-04-05 01:19:04.895964+00:00, run_end_date=2024-04-05 01:19:05.372411+00:00, run_duration=0.476447, state=success, executor_state=success, try_number=1, max_tries=1, job_id=752, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:19:01.143101+00:00, queued_by_job_id=1, pid=10971 2024-04-05T01:19:05.942406639Z [2024-04-05T01:19:05.942+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e667c03-83c3-4b72-905b-b023ae81f102 2024-04-05T01:19:07.630039411Z [2024-04-05T01:19:07.628+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:19:07.630403709Z [2024-04-05T01:19:07.630+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:18:00+00:00, run_id=scheduled__2024-04-05T01:18:00+00:00, run_start_date=2024-04-05 01:19:01.028113+00:00, run_end_date=2024-04-05 01:19:07.629965+00:00, run_duration=6.601852, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:18:00+00:00, data_interval_end=2024-04-05 01:19:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:19:07.641836546Z [2024-04-05T01:19:07.641+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:19:00+00:00, run_after=2024-04-05T01:20:00+00:00 2024-04-05T01:19:07.702838374Z [2024-04-05T01:19:07.702+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:18:00+00:00 exited with status success for try_number 1 2024-04-05T01:19:07.710634383Z [2024-04-05T01:19:07.710+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:18:00+00:00, map_index=-1, run_start_date=2024-04-05 01:19:05.778478+00:00, run_end_date=2024-04-05 01:19:07.454402+00:00, run_duration=1.675924, state=success, executor_state=success, try_number=1, max_tries=1, job_id=754, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:19:01.143101+00:00, queued_by_job_id=1, pid=10989 2024-04-05T01:19:08.751305462Z [2024-04-05T01:19:08.750+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:19:08.751495158Z [2024-04-05T01:19:08.751+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:18:00+00:00, run_id=scheduled__2024-04-05T01:18:00+00:00, run_start_date=2024-04-05 01:19:01.032136+00:00, run_end_date=2024-04-05 01:19:08.751195+00:00, run_duration=7.719059, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:18:00+00:00, data_interval_end=2024-04-05 01:19:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:19:08.760534876Z [2024-04-05T01:19:08.760+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:19:00+00:00, run_after=2024-04-05T01:20:00+00:00 2024-04-05T01:19:08.785146273Z [2024-04-05T01:19:08.784+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:19:08.785172120Z 2024-04-05T01:19:08.785322649Z [2024-04-05T01:19:08.785+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03 has 0/16 running and queued tasks 2024-04-05T01:19:08.785998944Z [2024-04-05T01:19:08.785+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:19:08.786012419Z 2024-04-05T01:19:08.788216071Z [2024-04-05T01:19:08.787+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03', task_id='split_metrics', run_id='scheduled__2024-04-05T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:19:08.788381664Z [2024-04-05T01:19:08.788+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03', 'split_metrics', 'scheduled__2024-04-05T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:19:08.831022686Z [2024-04-05T01:19:08.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03.split_metrics run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status queued for try_number 1 2024-04-05T01:19:08.831064506Z [2024-04-05T01:19:08.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:18:00+00:00 exited with status success for try_number 1 2024-04-05T01:19:08.831124171Z [2024-04-05T01:19:08.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status success for try_number 1 2024-04-05T01:19:08.838017301Z [2024-04-05T01:19:08.837+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:18:00+00:00, map_index=-1, run_start_date=2024-04-05 01:19:05.635671+00:00, run_end_date=2024-04-05 01:19:07.950746+00:00, run_duration=2.315075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=753, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:19:01.143101+00:00, queued_by_job_id=1, pid=10987 2024-04-05T01:19:08.838162795Z [2024-04-05T01:19:08.838+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:10:00+00:00, map_index=-1, run_start_date=2024-04-05 01:19:07.467785+00:00, run_end_date=2024-04-05 01:19:07.874797+00:00, run_duration=0.407012, state=success, executor_state=success, try_number=1, max_tries=1, job_id=755, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:19:05.801883+00:00, queued_by_job_id=1, pid=11006 2024-04-05T01:19:08.838319547Z [2024-04-05T01:19:08.838+0000] {scheduler_job.py:635} INFO - Setting external_id for to cd317c32-9321-483b-a6a6-2855a5686d78 2024-04-05T01:19:10.833661150Z [2024-04-05T01:19:10.833+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:19:10.833687255Z 2024-04-05T01:19:10.834007426Z [2024-04-05T01:19:10.833+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03 has 0/16 running and queued tasks 2024-04-05T01:19:10.835430324Z [2024-04-05T01:19:10.835+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:19:10.835443530Z 2024-04-05T01:19:10.840296364Z [2024-04-05T01:19:10.839+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:19:10.840713774Z [2024-04-05T01:19:10.840+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03', 'collect_metrics', 'scheduled__2024-04-05T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:19:10.904251799Z [2024-04-05T01:19:10.903+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03.collect_metrics run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status queued for try_number 1 2024-04-05T01:19:10.906165649Z [2024-04-05T01:19:10.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03.split_metrics run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status success for try_number 1 2024-04-05T01:19:10.922766061Z [2024-04-05T01:19:10.922+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a427812-9b3a-45ce-8149-af370dfa6a64 2024-04-05T01:19:10.922966214Z [2024-04-05T01:19:10.922+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03, task_id=split_metrics, run_id=scheduled__2024-04-05T01:10:00+00:00, map_index=-1, run_start_date=2024-04-05 01:19:10.291465+00:00, run_end_date=2024-04-05 01:19:10.601127+00:00, run_duration=0.309662, state=success, executor_state=success, try_number=1, max_tries=1, job_id=756, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:19:08.786341+00:00, queued_by_job_id=1, pid=11029 2024-04-05T01:19:13.870829640Z [2024-04-05T01:19:13.870+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:19:13.870871443Z 2024-04-05T01:19:13.871341367Z [2024-04-05T01:19:13.870+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03 has 0/16 running and queued tasks 2024-04-05T01:19:13.873373870Z [2024-04-05T01:19:13.873+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:19:13.873395036Z 2024-04-05T01:19:13.877319613Z [2024-04-05T01:19:13.877+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:19:13.877590554Z [2024-04-05T01:19:13.877+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03', 'send_prometheus', 'scheduled__2024-04-05T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:19:13.947548120Z [2024-04-05T01:19:13.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03.send_prometheus run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status queued for try_number 1 2024-04-05T01:19:13.948017886Z [2024-04-05T01:19:13.947+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03.collect_metrics run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status success for try_number 1 2024-04-05T01:19:13.955200981Z [2024-04-05T01:19:13.954+0000] {scheduler_job.py:635} INFO - Setting external_id for to 043bca20-ccb0-4f0d-85bb-58e34385e117 2024-04-05T01:19:13.955535030Z [2024-04-05T01:19:13.955+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:10:00+00:00, map_index=0, run_start_date=2024-04-05 01:19:12.450147+00:00, run_end_date=2024-04-05 01:19:12.775706+00:00, run_duration=0.325559, state=success, executor_state=success, try_number=1, max_tries=1, job_id=757, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:19:10.836345+00:00, queued_by_job_id=1, pid=11040 2024-04-05T01:19:16.606216511Z [2024-04-05T01:19:16.605+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:19:16.606612258Z [2024-04-05T01:19:16.606+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03, execution_date=2024-04-05 01:10:00+00:00, run_id=scheduled__2024-04-05T01:10:00+00:00, run_start_date=2024-04-05 01:19:05.724828+00:00, run_end_date=2024-04-05 01:19:16.605974+00:00, run_duration=10.881146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:10:00+00:00, data_interval_end=2024-04-05 01:15:00+00:00, dag_hash=b04dc7995442c79f2831af561c5354c5 2024-04-05T01:19:16.613584079Z [2024-04-05T01:19:16.613+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03 to 2024-04-05T01:15:00+00:00, run_after=2024-04-05T01:20:00+00:00 2024-04-05T01:19:16.663817710Z [2024-04-05T01:19:16.663+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03.send_prometheus run_id=scheduled__2024-04-05T01:10:00+00:00 exited with status success for try_number 1 2024-04-05T01:19:16.676662126Z [2024-04-05T01:19:16.674+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:10:00+00:00, map_index=-1, run_start_date=2024-04-05 01:19:15.599033+00:00, run_end_date=2024-04-05 01:19:15.951308+00:00, run_duration=0.352275, state=success, executor_state=success, try_number=1, max_tries=1, job_id=758, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:19:13.874014+00:00, queued_by_job_id=1, pid=11048 2024-04-05T01:19:27.782501124Z [2024-04-05T01:19:27.782+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_efedb139-678e-4925-ae63-6f11511c8b03 to 2024-04-05T01:19:00+00:00, run_after=2024-04-05T01:20:00+00:00 2024-04-05T01:19:27.826621268Z [2024-04-05T01:19:27.826+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:19:27.826646407Z 2024-04-05T01:19:27.826963512Z [2024-04-05T01:19:27.826+0000] {scheduler_job.py:425} INFO - DAG vim_status_efedb139-678e-4925-ae63-6f11511c8b03 has 0/16 running and queued tasks 2024-04-05T01:19:27.827857042Z [2024-04-05T01:19:27.827+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:19:27.827867353Z 2024-04-05T01:19:27.830779644Z [2024-04-05T01:19:27.830+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_efedb139-678e-4925-ae63-6f11511c8b03', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:19:27.831132643Z [2024-04-05T01:19:27.830+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_efedb139-678e-4925-ae63-6f11511c8b03', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:19:27.898819894Z [2024-04-05T01:19:27.898+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_efedb139-678e-4925-ae63-6f11511c8b03.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:18:00+00:00 exited with status queued for try_number 1 2024-04-05T01:19:27.903785137Z [2024-04-05T01:19:27.903+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c554140-df6c-4205-a12a-b94e9619fbdf 2024-04-05T01:19:27.937848665Z [2024-04-05T01:19:27.937+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:19:27.994447259Z [2024-04-05T01:19:27.993+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:19:27.994469228Z 2024-04-05T01:19:27.994509072Z [2024-04-05T01:19:27.994+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03 has 0/16 running and queued tasks 2024-04-05T01:19:27.995321827Z [2024-04-05T01:19:27.995+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:19:27.995333279Z 2024-04-05T01:19:27.998437277Z [2024-04-05T01:19:27.998+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:19:27.998561160Z [2024-04-05T01:19:27.998+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:19:28.066009826Z [2024-04-05T01:19:28.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:18:00+00:00 exited with status queued for try_number 1 2024-04-05T01:19:28.071664866Z [2024-04-05T01:19:28.071+0000] {scheduler_job.py:635} INFO - Setting external_id for to ca5f4085-b4f0-4b48-ac5c-b7d1f389e8cd 2024-04-05T01:19:31.077347276Z [2024-04-05T01:19:31.076+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:19:31.077719221Z [2024-04-05T01:19:31.077+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_efedb139-678e-4925-ae63-6f11511c8b03, execution_date=2024-04-05 01:18:00+00:00, run_id=scheduled__2024-04-05T01:18:00+00:00, run_start_date=2024-04-05 01:19:27.794829+00:00, run_end_date=2024-04-05 01:19:31.077248+00:00, run_duration=3.282419, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:18:00+00:00, data_interval_end=2024-04-05 01:19:00+00:00, dag_hash=703b6c6f1cba6a93d9479e2ecee9bf1a 2024-04-05T01:19:31.093987869Z [2024-04-05T01:19:31.093+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_efedb139-678e-4925-ae63-6f11511c8b03 to 2024-04-05T01:19:00+00:00, run_after=2024-04-05T01:20:00+00:00 2024-04-05T01:19:31.130795745Z [2024-04-05T01:19:31.130+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_efedb139-678e-4925-ae63-6f11511c8b03.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:18:00+00:00 exited with status success for try_number 1 2024-04-05T01:19:31.135257928Z [2024-04-05T01:19:31.134+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_efedb139-678e-4925-ae63-6f11511c8b03, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:18:00+00:00, map_index=-1, run_start_date=2024-04-05 01:19:29.681257+00:00, run_end_date=2024-04-05 01:19:30.900065+00:00, run_duration=1.218808, state=success, executor_state=success, try_number=1, max_tries=1, job_id=760, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:19:27.828376+00:00, queued_by_job_id=1, pid=11064 2024-04-05T01:19:32.181616492Z [2024-04-05T01:19:32.181+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:19:32.181962150Z [2024-04-05T01:19:32.181+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03, execution_date=2024-04-05 01:18:00+00:00, run_id=scheduled__2024-04-05T01:18:00+00:00, run_start_date=2024-04-05 01:19:27.948176+00:00, run_end_date=2024-04-05 01:19:32.181501+00:00, run_duration=4.233325, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:18:00+00:00, data_interval_end=2024-04-05 01:19:00+00:00, dag_hash=5f3d88c265ba27928f8bef4f40581d96 2024-04-05T01:19:32.191499072Z [2024-04-05T01:19:32.191+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03 to 2024-04-05T01:19:00+00:00, run_after=2024-04-05T01:20:00+00:00 2024-04-05T01:19:32.234207865Z [2024-04-05T01:19:32.233+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:18:00+00:00 exited with status success for try_number 1 2024-04-05T01:19:32.244182414Z [2024-04-05T01:19:32.243+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:18:00+00:00, map_index=-1, run_start_date=2024-04-05 01:19:29.640556+00:00, run_end_date=2024-04-05 01:19:31.353594+00:00, run_duration=1.713038, state=success, executor_state=success, try_number=1, max_tries=1, job_id=759, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:19:27.995885+00:00, queued_by_job_id=1, pid=11063 2024-04-05T01:19:38.925799207Z [2024-04-05T01:19:38.925+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:19:38.925830585Z 2024-04-05T01:19:38.925948754Z [2024-04-05T01:19:38.925+0000] {scheduler_job.py:425} INFO - DAG vdu_down has 0/16 running and queued tasks 2024-04-05T01:19:38.926523907Z [2024-04-05T01:19:38.926+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:19:38.926531299Z 2024-04-05T01:19:38.928400153Z [2024-04-05T01:19:38.928+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_down', task_id='main_task', run_id='vdu_down_20240405011937_309897', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:19:38.928569705Z [2024-04-05T01:19:38.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240405011937_309897', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-05T01:19:38.975416160Z [2024-04-05T01:19:38.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240405011937_309897 exited with status queued for try_number 1 2024-04-05T01:19:38.980893787Z [2024-04-05T01:19:38.980+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67217ec5-8118-432e-b991-d6a84732eaff 2024-04-05T01:19:40.105165038Z [2024-04-05T01:19:40.104+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:19:40.105739997Z [2024-04-05T01:19:40.105+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_down, execution_date=2024-04-05 01:19:37.925522+00:00, run_id=vdu_down_20240405011937_309897, run_start_date=2024-04-05 01:19:38.895691+00:00, run_end_date=2024-04-05 01:19:40.105265+00:00, run_duration=1.209574, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-05 01:19:37.925522+00:00, data_interval_end=2024-04-05 01:19:37.925522+00:00, dag_hash=5d776a62c425519a22b054f47fcd284c 2024-04-05T01:19:40.110173473Z [2024-04-05T01:19:40.109+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_down to None, run_after=None 2024-04-05T01:19:40.149901400Z [2024-04-05T01:19:40.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_down.main_task run_id=vdu_down_20240405011937_309897 exited with status success for try_number 1 2024-04-05T01:19:40.159150256Z [2024-04-05T01:19:40.158+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_down, task_id=main_task, run_id=vdu_down_20240405011937_309897, map_index=-1, run_start_date=2024-04-05 01:19:39.582448+00:00, run_end_date=2024-04-05 01:19:39.891693+00:00, run_duration=0.309245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=761, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:19:38.926847+00:00, queued_by_job_id=1, pid=11076 2024-04-05T01:20:00.130180141Z [2024-04-05T01:20:00.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03 to 2024-04-05T01:20:00+00:00, run_after=2024-04-05T01:25:00+00:00 2024-04-05T01:20:00.170055238Z [2024-04-05T01:20:00.168+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:20:00.229146979Z [2024-04-05T01:20:00.228+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:20:00+00:00, run_after=2024-04-05T01:25:00+00:00 2024-04-05T01:20:00.271252484Z [2024-04-05T01:20:00.270+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:20:00.312747892Z [2024-04-05T01:20:00.312+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:20:00+00:00, run_after=2024-04-05T01:21:00+00:00 2024-04-05T01:20:00.324833482Z [2024-04-05T01:20:00.324+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:20:00+00:00, run_after=2024-04-05T01:21:00+00:00 2024-04-05T01:20:00.336937298Z [2024-04-05T01:20:00.336+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_efedb139-678e-4925-ae63-6f11511c8b03 to 2024-04-05T01:20:00+00:00, run_after=2024-04-05T01:21:00+00:00 2024-04-05T01:20:00.444530685Z [2024-04-05T01:20:00.444+0000] {scheduler_job.py:360} INFO - 7 tasks up for execution: 2024-04-05T01:20:00.444554937Z 2024-04-05T01:20:00.444558916Z 2024-04-05T01:20:00.444562975Z 2024-04-05T01:20:00.444566209Z 2024-04-05T01:20:00.444569221Z 2024-04-05T01:20:00.444572373Z 2024-04-05T01:20:00.444575436Z 2024-04-05T01:20:00.445801184Z [2024-04-05T01:20:00.444+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03 has 0/16 running and queued tasks 2024-04-05T01:20:00.446062408Z [2024-04-05T01:20:00.445+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:20:00.446282925Z [2024-04-05T01:20:00.446+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03 has 0/16 running and queued tasks 2024-04-05T01:20:00.446553678Z [2024-04-05T01:20:00.446+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:20:00.446809951Z [2024-04-05T01:20:00.446+0000] {scheduler_job.py:425} INFO - DAG vim_status_efedb139-678e-4925-ae63-6f11511c8b03 has 0/16 running and queued tasks 2024-04-05T01:20:00.447002516Z [2024-04-05T01:20:00.446+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:20:00.447206172Z [2024-04-05T01:20:00.447+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:20:00.448207053Z [2024-04-05T01:20:00.447+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:20:00.448218772Z 2024-04-05T01:20:00.448222211Z 2024-04-05T01:20:00.448226408Z 2024-04-05T01:20:00.448229718Z 2024-04-05T01:20:00.448233108Z 2024-04-05T01:20:00.448236307Z 2024-04-05T01:20:00.448259197Z 2024-04-05T01:20:00.454922740Z [2024-04-05T01:20:00.454+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:20:00.455214997Z [2024-04-05T01:20:00.454+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:20:00.455605687Z [2024-04-05T01:20:00.455+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:20:00.455854437Z [2024-04-05T01:20:00.455+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:20:00.456185334Z [2024-04-05T01:20:00.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:20:00.456356567Z [2024-04-05T01:20:00.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:20:00.456623130Z [2024-04-05T01:20:00.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:20:00.456787076Z [2024-04-05T01:20:00.456+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:20:00.457121709Z [2024-04-05T01:20:00.456+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_efedb139-678e-4925-ae63-6f11511c8b03', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:20:00.457281793Z [2024-04-05T01:20:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_efedb139-678e-4925-ae63-6f11511c8b03', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:20:00.457563840Z [2024-04-05T01:20:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:20:00.457796302Z [2024-04-05T01:20:00.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:20:00.458068298Z [2024-04-05T01:20:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:20:00.458255470Z [2024-04-05T01:20:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:20:01.401363136Z [2024-04-05T01:20:01.399+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:15:00+00:00 exited with status queued for try_number 1 2024-04-05T01:20:01.401767699Z [2024-04-05T01:20:01.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:15:00+00:00 exited with status queued for try_number 1 2024-04-05T01:20:01.402244725Z [2024-04-05T01:20:01.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:19:00+00:00 exited with status queued for try_number 1 2024-04-05T01:20:01.402413046Z [2024-04-05T01:20:01.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:19:00+00:00 exited with status queued for try_number 1 2024-04-05T01:20:01.403033032Z [2024-04-05T01:20:01.402+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_efedb139-678e-4925-ae63-6f11511c8b03.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:19:00+00:00 exited with status queued for try_number 1 2024-04-05T01:20:01.403359272Z [2024-04-05T01:20:01.403+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:19:00+00:00 exited with status queued for try_number 1 2024-04-05T01:20:01.404903701Z [2024-04-05T01:20:01.404+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:19:00+00:00 exited with status queued for try_number 1 2024-04-05T01:20:01.458868415Z [2024-04-05T01:20:01.456+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6931b472-273f-4d14-9a2c-045c91d58d21 2024-04-05T01:20:01.459119382Z [2024-04-05T01:20:01.458+0000] {scheduler_job.py:635} INFO - Setting external_id for to 661e9d48-1b48-4539-90c2-09ce279e275b 2024-04-05T01:20:01.462413965Z [2024-04-05T01:20:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 918ee6c1-16ac-490e-80c3-84d62a927c10 2024-04-05T01:20:01.462600149Z [2024-04-05T01:20:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 795f6732-d423-44eb-bebe-5d4e8ee701c9 2024-04-05T01:20:01.462803932Z [2024-04-05T01:20:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to 11c1dc33-10d1-4e1e-8850-f3b086d318a6 2024-04-05T01:20:01.463132018Z [2024-04-05T01:20:01.462+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5f22ddc-0c96-4ef0-b4e2-01153cc1509d 2024-04-05T01:20:01.463306009Z [2024-04-05T01:20:01.463+0000] {scheduler_job.py:635} INFO - Setting external_id for to 96355629-6489-48b7-92c1-b3ccf4214d2c 2024-04-05T01:20:01.560462890Z [2024-04-05T01:20:01.560+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:20:02.540260853Z [2024-04-05T01:20:02.539+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:20:02.540297473Z 2024-04-05T01:20:02.540313547Z [2024-04-05T01:20:02.540+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:20:02.540885256Z [2024-04-05T01:20:02.540+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:20:02.540904543Z 2024-04-05T01:20:02.543506058Z [2024-04-05T01:20:02.543+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:20:02.543534435Z [2024-04-05T01:20:02.543+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:20:02.746832179Z [2024-04-05T01:20:02.746+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:18:00+00:00 exited with status queued for try_number 1 2024-04-05T01:20:02.777271393Z [2024-04-05T01:20:02.776+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52ccf1c5-7cf7-4ea4-a01d-43c01642603a 2024-04-05T01:20:04.336055702Z [2024-04-05T01:20:04.335+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:20:04.336223425Z [2024-04-05T01:20:04.335+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:19:00+00:00, run_id=scheduled__2024-04-05T01:19:00+00:00, run_start_date=2024-04-05 01:20:00.350439+00:00, run_end_date=2024-04-05 01:20:04.335906+00:00, run_duration=3.985467, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:19:00+00:00, data_interval_end=2024-04-05 01:20:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:20:04.368992015Z [2024-04-05T01:20:04.368+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:20:00+00:00, run_after=2024-04-05T01:21:00+00:00 2024-04-05T01:20:04.708718527Z [2024-04-05T01:20:04.708+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:19:00+00:00 exited with status success for try_number 1 2024-04-05T01:20:04.725609666Z [2024-04-05T01:20:04.725+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:19:00+00:00, map_index=-1, run_start_date=2024-04-05 01:20:02.509891+00:00, run_end_date=2024-04-05 01:20:03.655687+00:00, run_duration=1.145796, state=success, executor_state=success, try_number=1, max_tries=1, job_id=762, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:20:00.449760+00:00, queued_by_job_id=1, pid=11094 2024-04-05T01:20:05.808691299Z [2024-04-05T01:20:05.808+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:20:05.808856778Z [2024-04-05T01:20:05.808+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:18:00+00:00, run_id=scheduled__2024-04-05T01:18:00+00:00, run_start_date=2024-04-05 01:20:01.596928+00:00, run_end_date=2024-04-05 01:20:05.808549+00:00, run_duration=4.211621, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:18:00+00:00, data_interval_end=2024-04-05 01:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:20:05.817245269Z [2024-04-05T01:20:05.816+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:20:00+00:00, run_after=2024-04-05T01:22:00+00:00 2024-04-05T01:20:05.981939464Z [2024-04-05T01:20:05.981+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:18:00+00:00 exited with status success for try_number 1 2024-04-05T01:20:06.050443802Z [2024-04-05T01:20:06.050+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:18:00+00:00, map_index=-1, run_start_date=2024-04-05 01:20:04.660215+00:00, run_end_date=2024-04-05 01:20:05.291411+00:00, run_duration=0.631196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=763, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:20:02.541336+00:00, queued_by_job_id=1, pid=11103 2024-04-05T01:20:06.757226514Z [2024-04-05T01:20:06.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:15:00+00:00 exited with status failed for try_number 1 2024-04-05T01:20:06.763869801Z [2024-04-05T01:20:06.763+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:15:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:20:00.449760+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:20:06.764484856Z [2024-04-05T01:20:06.764+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:20:06.766965586Z [2024-04-05T01:20:06.766+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:20:06.781417036Z [2024-04-05T01:20:06.781+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03, task_id=extract_metrics_from_vnfrs, execution_date=20240405T011500, start_date=, end_date=20240405T012006 2024-04-05T01:20:07.115192323Z [2024-04-05T01:20:07.114+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:20:07.115217803Z 2024-04-05T01:20:07.116311580Z [2024-04-05T01:20:07.115+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:20:07.117064109Z [2024-04-05T01:20:07.116+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:20:07.117076808Z 2024-04-05T01:20:07.120711538Z [2024-04-05T01:20:07.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:20:07.121274629Z [2024-04-05T01:20:07.120+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:20:07.201991582Z [2024-04-05T01:20:07.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:15:00+00:00 exited with status queued for try_number 1 2024-04-05T01:20:07.203405596Z [2024-04-05T01:20:07.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:15:00+00:00 exited with status success for try_number 1 2024-04-05T01:20:07.204495186Z [2024-04-05T01:20:07.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:19:00+00:00 exited with status failed for try_number 1 2024-04-05T01:20:07.204574793Z [2024-04-05T01:20:07.204+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_efedb139-678e-4925-ae63-6f11511c8b03.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:19:00+00:00 exited with status failed for try_number 1 2024-04-05T01:20:07.221737930Z [2024-04-05T01:20:07.221+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_efedb139-678e-4925-ae63-6f11511c8b03, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:19:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:20:00.449760+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:20:07.222118320Z [2024-04-05T01:20:07.221+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:20:07.224928746Z [2024-04-05T01:20:07.224+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:20:07.240851692Z [2024-04-05T01:20:07.240+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_efedb139-678e-4925-ae63-6f11511c8b03, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240405T011900, start_date=, end_date=20240405T012007 2024-04-05T01:20:07.250539608Z [2024-04-05T01:20:07.250+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:19:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:20:00.449760+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:20:07.250905856Z [2024-04-05T01:20:07.250+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:20:07.253698100Z [2024-04-05T01:20:07.253+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:20:07.270466993Z [2024-04-05T01:20:07.270+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240405T011900, start_date=, end_date=20240405T012007 2024-04-05T01:20:07.285108360Z [2024-04-05T01:20:07.284+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:15:00+00:00, map_index=-1, run_start_date=2024-04-05 01:20:05.952843+00:00, run_end_date=2024-04-05 01:20:06.842056+00:00, run_duration=0.889213, state=success, executor_state=success, try_number=1, max_tries=1, job_id=765, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:20:00.449760+00:00, queued_by_job_id=1, pid=11133 2024-04-05T01:20:07.285233650Z [2024-04-05T01:20:07.285+0000] {scheduler_job.py:635} INFO - Setting external_id for to e093c49b-7971-48e6-8a61-4873214507f6 2024-04-05T01:20:08.539877802Z [2024-04-05T01:20:08.539+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:20:08.540377934Z [2024-04-05T01:20:08.540+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:19:00+00:00, run_id=scheduled__2024-04-05T01:19:00+00:00, run_start_date=2024-04-05 01:20:00.353537+00:00, run_end_date=2024-04-05 01:20:08.539752+00:00, run_duration=8.186215, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:19:00+00:00, data_interval_end=2024-04-05 01:20:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:20:08.550885253Z [2024-04-05T01:20:08.550+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:20:00+00:00, run_after=2024-04-05T01:21:00+00:00 2024-04-05T01:20:08.677922217Z [2024-04-05T01:20:08.677+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:19:00+00:00 exited with status success for try_number 1 2024-04-05T01:20:08.689738292Z [2024-04-05T01:20:08.689+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:19:00+00:00, map_index=-1, run_start_date=2024-04-05 01:20:06.025911+00:00, run_end_date=2024-04-05 01:20:08.016161+00:00, run_duration=1.99025, state=success, executor_state=success, try_number=1, max_tries=1, job_id=764, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:20:00.449760+00:00, queued_by_job_id=1, pid=11134 2024-04-05T01:20:09.768459727Z [2024-04-05T01:20:09.767+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:20:09.769113832Z [2024-04-05T01:20:09.768+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:19:00+00:00, run_id=scheduled__2024-04-05T01:19:00+00:00, run_start_date=2024-04-05 01:20:00.352604+00:00, run_end_date=2024-04-05 01:20:09.768346+00:00, run_duration=9.415742, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:19:00+00:00, data_interval_end=2024-04-05 01:20:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:20:09.788654764Z [2024-04-05T01:20:09.788+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:20:00+00:00, run_after=2024-04-05T01:21:00+00:00 2024-04-05T01:20:09.904958528Z [2024-04-05T01:20:09.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:19:00+00:00 exited with status success for try_number 1 2024-04-05T01:20:09.922142153Z [2024-04-05T01:20:09.921+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:19:00+00:00, map_index=-1, run_start_date=2024-04-05 01:20:07.350544+00:00, run_end_date=2024-04-05 01:20:09.433894+00:00, run_duration=2.08335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=766, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:20:00.449760+00:00, queued_by_job_id=1, pid=11171 2024-04-05T01:20:11.055141400Z [2024-04-05T01:20:11.054+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:20:11.055181953Z 2024-04-05T01:20:11.055520151Z [2024-04-05T01:20:11.055+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:20:11.056267540Z [2024-04-05T01:20:11.056+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:20:11.056281457Z 2024-04-05T01:20:11.059680994Z [2024-04-05T01:20:11.059+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:20:11.060145824Z [2024-04-05T01:20:11.059+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:20:11.121072097Z [2024-04-05T01:20:11.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:15:00+00:00 exited with status queued for try_number 1 2024-04-05T01:20:11.121215330Z [2024-04-05T01:20:11.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:15:00+00:00 exited with status success for try_number 1 2024-04-05T01:20:11.133129361Z [2024-04-05T01:20:11.132+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T01:15:00+00:00, map_index=-1, run_start_date=2024-04-05 01:20:09.290304+00:00, run_end_date=2024-04-05 01:20:09.794042+00:00, run_duration=0.503738, state=success, executor_state=success, try_number=1, max_tries=1, job_id=767, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:20:07.117707+00:00, queued_by_job_id=1, pid=11193 2024-04-05T01:20:11.133463664Z [2024-04-05T01:20:11.133+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5e11030a-fd26-4da5-869e-663560a5fa16 2024-04-05T01:20:14.301179665Z [2024-04-05T01:20:14.300+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:20:14.301213317Z 2024-04-05T01:20:14.301334484Z [2024-04-05T01:20:14.301+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:20:14.302019464Z [2024-04-05T01:20:14.301+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:20:14.302041243Z 2024-04-05T01:20:14.304693837Z [2024-04-05T01:20:14.304+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:20:14.304924647Z [2024-04-05T01:20:14.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:20:14.368652466Z [2024-04-05T01:20:14.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:15:00+00:00 exited with status queued for try_number 1 2024-04-05T01:20:14.368954929Z [2024-04-05T01:20:14.368+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:15:00+00:00 exited with status success for try_number 1 2024-04-05T01:20:14.378118306Z [2024-04-05T01:20:14.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:15:00+00:00, map_index=0, run_start_date=2024-04-05 01:20:13.013470+00:00, run_end_date=2024-04-05 01:20:13.366503+00:00, run_duration=0.353033, state=success, executor_state=success, try_number=1, max_tries=1, job_id=768, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:20:11.056737+00:00, queued_by_job_id=1, pid=11204 2024-04-05T01:20:14.378617870Z [2024-04-05T01:20:14.378+0000] {scheduler_job.py:635} INFO - Setting external_id for to b55ec0e4-8e60-4b5c-bbd9-c2e328fd18d6 2024-04-05T01:20:16.738320122Z [2024-04-05T01:20:16.735+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:20:16.738974021Z [2024-04-05T01:20:16.738+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:15:00+00:00, run_id=scheduled__2024-04-05T01:15:00+00:00, run_start_date=2024-04-05 01:20:00.346827+00:00, run_end_date=2024-04-05 01:20:16.738459+00:00, run_duration=16.391632, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:15:00+00:00, data_interval_end=2024-04-05 01:20:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T01:20:16.755750664Z [2024-04-05T01:20:16.755+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:20:00+00:00, run_after=2024-04-05T01:25:00+00:00 2024-04-05T01:20:16.862312611Z [2024-04-05T01:20:16.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:15:00+00:00 exited with status success for try_number 1 2024-04-05T01:20:16.868727245Z [2024-04-05T01:20:16.868+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:15:00+00:00, map_index=-1, run_start_date=2024-04-05 01:20:16.120193+00:00, run_end_date=2024-04-05 01:20:16.489904+00:00, run_duration=0.369711, state=success, executor_state=success, try_number=1, max_tries=1, job_id=769, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:20:14.302390+00:00, queued_by_job_id=1, pid=11212 2024-04-05T01:20:17.146020287Z [2024-04-05T01:20:17.145+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:20:17.146049912Z 2024-04-05T01:20:17.146279198Z [2024-04-05T01:20:17.145+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03 has 0/16 running and queued tasks 2024-04-05T01:20:17.147234710Z [2024-04-05T01:20:17.146+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:20:17.147241583Z 2024-04-05T01:20:17.150699080Z [2024-04-05T01:20:17.150+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:15:00+00:00', try_number=2, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:20:17.150958535Z [2024-04-05T01:20:17.150+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:20:17.207167197Z [2024-04-05T01:20:17.206+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:15:00+00:00 exited with status queued for try_number 2 2024-04-05T01:20:17.215437229Z [2024-04-05T01:20:17.214+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc9508a0-8573-4f99-9d39-a9d9c0d257ca 2024-04-05T01:20:17.348995582Z [2024-04-05T01:20:17.348+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T01:20:17.349027303Z 2024-04-05T01:20:17.349033695Z 2024-04-05T01:20:17.349278393Z [2024-04-05T01:20:17.348+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03 has 0/16 running and queued tasks 2024-04-05T01:20:17.349601765Z [2024-04-05T01:20:17.349+0000] {scheduler_job.py:425} INFO - DAG vim_status_efedb139-678e-4925-ae63-6f11511c8b03 has 0/16 running and queued tasks 2024-04-05T01:20:17.350693012Z [2024-04-05T01:20:17.350+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:20:17.350711304Z 2024-04-05T01:20:17.350717042Z 2024-04-05T01:20:17.359835750Z [2024-04-05T01:20:17.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:19:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:20:17.360953367Z [2024-04-05T01:20:17.359+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:20:17.362532201Z [2024-04-05T01:20:17.362+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_efedb139-678e-4925-ae63-6f11511c8b03', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:19:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:20:17.363066234Z [2024-04-05T01:20:17.362+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_efedb139-678e-4925-ae63-6f11511c8b03', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:20:17.550280779Z [2024-04-05T01:20:17.549+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:19:00+00:00 exited with status queued for try_number 2 2024-04-05T01:20:17.550482058Z [2024-04-05T01:20:17.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_efedb139-678e-4925-ae63-6f11511c8b03.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:19:00+00:00 exited with status queued for try_number 2 2024-04-05T01:20:17.559487658Z [2024-04-05T01:20:17.558+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2fa65062-17fe-4287-abcb-89061b9d4539 2024-04-05T01:20:17.559753134Z [2024-04-05T01:20:17.559+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6f01a077-8d04-4d1c-8e05-7339be4e19cf 2024-04-05T01:20:18.871424086Z [2024-04-05T01:20:18.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:15:00+00:00 exited with status failed for try_number 2 2024-04-05T01:20:18.876291827Z [2024-04-05T01:20:18.875+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:15:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-05 01:20:06.771163+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:20:17.147869+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:20:18.876810493Z [2024-04-05T01:20:18.876+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:20:18.881344236Z [2024-04-05T01:20:18.880+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:20:18.895872197Z [2024-04-05T01:20:18.895+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03, task_id=extract_metrics_from_vnfrs, execution_date=20240405T011500, start_date=, end_date=20240405T012018 2024-04-05T01:20:20.050408222Z [2024-04-05T01:20:20.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:19:00+00:00 exited with status failed for try_number 2 2024-04-05T01:20:20.050479316Z [2024-04-05T01:20:20.050+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_efedb139-678e-4925-ae63-6f11511c8b03.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:19:00+00:00 exited with status failed for try_number 2 2024-04-05T01:20:20.064611136Z [2024-04-05T01:20:20.063+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_efedb139-678e-4925-ae63-6f11511c8b03, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:19:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-05 01:20:07.227383+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:20:17.352722+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:20:20.065352749Z [2024-04-05T01:20:20.064+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:20:20.068743504Z [2024-04-05T01:20:20.068+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:20:20.088077643Z [2024-04-05T01:20:20.087+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_efedb139-678e-4925-ae63-6f11511c8b03, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240405T011900, start_date=, end_date=20240405T012020 2024-04-05T01:20:20.098807845Z [2024-04-05T01:20:20.098+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:19:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-05 01:20:07.257903+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:20:17.352722+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:20:20.099781284Z [2024-04-05T01:20:20.099+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:20:20.103643773Z [2024-04-05T01:20:20.103+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:20:20.125273219Z [2024-04-05T01:20:20.124+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240405T011900, start_date=, end_date=20240405T012020 2024-04-05T01:20:21.215736820Z [2024-04-05T01:20:21.215+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-05T01:20:21.217511704Z [2024-04-05T01:20:21.215+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_efedb139-678e-4925-ae63-6f11511c8b03, execution_date=2024-04-05 01:19:00+00:00, run_id=scheduled__2024-04-05T01:19:00+00:00, run_start_date=2024-04-05 01:20:00.349471+00:00, run_end_date=2024-04-05 01:20:21.215332+00:00, run_duration=20.865861, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:19:00+00:00, data_interval_end=2024-04-05 01:20:00+00:00, dag_hash=703b6c6f1cba6a93d9479e2ecee9bf1a 2024-04-05T01:20:21.250547335Z [2024-04-05T01:20:21.250+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_efedb139-678e-4925-ae63-6f11511c8b03 to 2024-04-05T01:20:00+00:00, run_after=2024-04-05T01:21:00+00:00 2024-04-05T01:20:21.259517902Z [2024-04-05T01:20:21.259+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-05T01:20:21.259934457Z [2024-04-05T01:20:21.259+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03, execution_date=2024-04-05 01:19:00+00:00, run_id=scheduled__2024-04-05T01:19:00+00:00, run_start_date=2024-04-05 01:20:00.351432+00:00, run_end_date=2024-04-05 01:20:21.259491+00:00, run_duration=20.908059, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:19:00+00:00, data_interval_end=2024-04-05 01:20:00+00:00, dag_hash=5f3d88c265ba27928f8bef4f40581d96 2024-04-05T01:20:21.273400207Z [2024-04-05T01:20:21.273+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03 to 2024-04-05T01:20:00+00:00, run_after=2024-04-05T01:21:00+00:00 2024-04-05T01:20:23.371883007Z [2024-04-05T01:20:23.371+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-05T01:20:23.372412212Z [2024-04-05T01:20:23.372+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03, execution_date=2024-04-05 01:15:00+00:00, run_id=scheduled__2024-04-05T01:15:00+00:00, run_start_date=2024-04-05 01:20:00.348432+00:00, run_end_date=2024-04-05 01:20:23.371737+00:00, run_duration=23.023305, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:15:00+00:00, data_interval_end=2024-04-05 01:20:00+00:00, dag_hash=b04dc7995442c79f2831af561c5354c5 2024-04-05T01:20:23.382301710Z [2024-04-05T01:20:23.381+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_efedb139-678e-4925-ae63-6f11511c8b03 to 2024-04-05T01:20:00+00:00, run_after=2024-04-05T01:25:00+00:00 2024-04-05T01:20:41.122770334Z [2024-04-05T01:20:41.122+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T01:21:00.946393468Z [2024-04-05T01:21:00.945+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:21:00+00:00, run_after=2024-04-05T01:22:00+00:00 2024-04-05T01:21:00.967648346Z [2024-04-05T01:21:00.967+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_efedb139-678e-4925-ae63-6f11511c8b03 to 2024-04-05T01:21:00+00:00, run_after=2024-04-05T01:22:00+00:00 2024-04-05T01:21:00.982220363Z [2024-04-05T01:21:00.981+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:21:00+00:00, run_after=2024-04-05T01:22:00+00:00 2024-04-05T01:21:00.993953390Z [2024-04-05T01:21:00.993+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:21:01.010527348Z [2024-04-05T01:21:01.010+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:21:01.376123506Z [2024-04-05T01:21:01.375+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T01:21:01.376158178Z 2024-04-05T01:21:01.376171100Z 2024-04-05T01:21:01.376198136Z 2024-04-05T01:21:01.376204194Z 2024-04-05T01:21:01.376209910Z 2024-04-05T01:21:01.376791861Z [2024-04-05T01:21:01.376+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03 has 0/16 running and queued tasks 2024-04-05T01:21:01.377122932Z [2024-04-05T01:21:01.376+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:21:01.377440956Z [2024-04-05T01:21:01.377+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:21:01.377742620Z [2024-04-05T01:21:01.377+0000] {scheduler_job.py:425} INFO - DAG vim_status_efedb139-678e-4925-ae63-6f11511c8b03 has 0/16 running and queued tasks 2024-04-05T01:21:01.377979995Z [2024-04-05T01:21:01.377+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:21:01.379193679Z [2024-04-05T01:21:01.378+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:21:01.379208269Z 2024-04-05T01:21:01.379212170Z 2024-04-05T01:21:01.379215992Z 2024-04-05T01:21:01.379219858Z 2024-04-05T01:21:01.379223470Z 2024-04-05T01:21:01.387188444Z [2024-04-05T01:21:01.386+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:21:01.387496407Z [2024-04-05T01:21:01.387+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:21:01.388018197Z [2024-04-05T01:21:01.387+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:21:01.388290677Z [2024-04-05T01:21:01.388+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:21:01.388708902Z [2024-04-05T01:21:01.388+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:21:01.388971570Z [2024-04-05T01:21:01.388+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:21:01.389380254Z [2024-04-05T01:21:01.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_efedb139-678e-4925-ae63-6f11511c8b03', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:21:01.389683260Z [2024-04-05T01:21:01.389+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_efedb139-678e-4925-ae63-6f11511c8b03', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:21:01.390285289Z [2024-04-05T01:21:01.389+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:21:01.390651352Z [2024-04-05T01:21:01.390+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:21:02.011304975Z [2024-04-05T01:21:02.010+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status queued for try_number 1 2024-04-05T01:21:02.011348799Z [2024-04-05T01:21:02.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status queued for try_number 1 2024-04-05T01:21:02.011376807Z [2024-04-05T01:21:02.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status queued for try_number 1 2024-04-05T01:21:02.011449573Z [2024-04-05T01:21:02.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_efedb139-678e-4925-ae63-6f11511c8b03.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status queued for try_number 1 2024-04-05T01:21:02.011512054Z [2024-04-05T01:21:02.011+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status queued for try_number 1 2024-04-05T01:21:02.036318714Z [2024-04-05T01:21:02.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to d1e9e7a2-d3ff-4650-90c2-4d087f91ba38 2024-04-05T01:21:02.036351977Z [2024-04-05T01:21:02.036+0000] {scheduler_job.py:635} INFO - Setting external_id for to 659833c2-f072-40fc-869c-7d5f11bdcac1 2024-04-05T01:21:02.036483476Z [2024-04-05T01:21:02.036+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9afe20f4-f9d0-4671-9883-c1a6591bf5cb 2024-04-05T01:21:02.036589542Z [2024-04-05T01:21:02.036+0000] {scheduler_job.py:635} INFO - Setting external_id for to f33c4bb5-6355-430f-8717-7856a2769136 2024-04-05T01:21:02.036697224Z [2024-04-05T01:21:02.036+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3a1c445-d900-459e-8325-b104b6b55087 2024-04-05T01:21:05.569324842Z [2024-04-05T01:21:05.568+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:21:05.569567709Z [2024-04-05T01:21:05.569+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:20:00+00:00, run_id=scheduled__2024-04-05T01:20:00+00:00, run_start_date=2024-04-05 01:21:01.035954+00:00, run_end_date=2024-04-05 01:21:05.569219+00:00, run_duration=4.533265, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:20:00+00:00, data_interval_end=2024-04-05 01:21:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:21:05.579467997Z [2024-04-05T01:21:05.579+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:21:00+00:00, run_after=2024-04-05T01:22:00+00:00 2024-04-05T01:21:05.644966598Z [2024-04-05T01:21:05.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status failed for try_number 1 2024-04-05T01:21:05.645479624Z [2024-04-05T01:21:05.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status success for try_number 1 2024-04-05T01:21:05.645914522Z [2024-04-05T01:21:05.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_efedb139-678e-4925-ae63-6f11511c8b03.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status failed for try_number 1 2024-04-05T01:21:05.655879563Z [2024-04-05T01:21:05.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_efedb139-678e-4925-ae63-6f11511c8b03, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:20:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:21:01.381876+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:21:05.656614058Z [2024-04-05T01:21:05.656+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:21:05.659932179Z [2024-04-05T01:21:05.659+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:21:05.673335340Z [2024-04-05T01:21:05.672+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vim_status_efedb139-678e-4925-ae63-6f11511c8b03, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240405T012000, start_date=, end_date=20240405T012105 2024-04-05T01:21:05.680933280Z [2024-04-05T01:21:05.680+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:20:00+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:21:01.381876+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:21:05.681412983Z [2024-04-05T01:21:05.681+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:21:05.683394780Z [2024-04-05T01:21:05.683+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:21:05.695952271Z [2024-04-05T01:21:05.695+0000] {taskinstance.py:1327} INFO - Marking task as UP_FOR_RETRY. dag_id=vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240405T012000, start_date=, end_date=20240405T012105 2024-04-05T01:21:05.703815650Z [2024-04-05T01:21:05.703+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:20:00+00:00, map_index=-1, run_start_date=2024-04-05 01:21:03.685561+00:00, run_end_date=2024-04-05 01:21:04.432207+00:00, run_duration=0.746646, state=success, executor_state=success, try_number=1, max_tries=1, job_id=770, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:21:01.381876+00:00, queued_by_job_id=1, pid=11261 2024-04-05T01:21:07.846363460Z [2024-04-05T01:21:07.845+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:21:07.847314218Z [2024-04-05T01:21:07.846+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:20:00+00:00, run_id=scheduled__2024-04-05T01:20:00+00:00, run_start_date=2024-04-05 01:21:01.043990+00:00, run_end_date=2024-04-05 01:21:07.846268+00:00, run_duration=6.802278, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:20:00+00:00, data_interval_end=2024-04-05 01:21:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:21:07.860885171Z [2024-04-05T01:21:07.860+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:21:00+00:00, run_after=2024-04-05T01:22:00+00:00 2024-04-05T01:21:07.868489916Z [2024-04-05T01:21:07.867+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:21:07.868826497Z [2024-04-05T01:21:07.868+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:20:00+00:00, run_id=scheduled__2024-04-05T01:20:00+00:00, run_start_date=2024-04-05 01:21:01.060184+00:00, run_end_date=2024-04-05 01:21:07.868315+00:00, run_duration=6.808131, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:20:00+00:00, data_interval_end=2024-04-05 01:21:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:21:07.881202238Z [2024-04-05T01:21:07.880+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:21:00+00:00, run_after=2024-04-05T01:22:00+00:00 2024-04-05T01:21:07.930539700Z [2024-04-05T01:21:07.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status success for try_number 1 2024-04-05T01:21:07.930635909Z [2024-04-05T01:21:07.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status success for try_number 1 2024-04-05T01:21:07.937326218Z [2024-04-05T01:21:07.936+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:20:00+00:00, map_index=-1, run_start_date=2024-04-05 01:21:05.779535+00:00, run_end_date=2024-04-05 01:21:07.678082+00:00, run_duration=1.898547, state=success, executor_state=success, try_number=1, max_tries=1, job_id=772, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:21:01.381876+00:00, queued_by_job_id=1, pid=11305 2024-04-05T01:21:07.937682363Z [2024-04-05T01:21:07.937+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:20:00+00:00, map_index=-1, run_start_date=2024-04-05 01:21:04.658270+00:00, run_end_date=2024-04-05 01:21:06.779426+00:00, run_duration=2.121156, state=success, executor_state=success, try_number=1, max_tries=1, job_id=771, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:21:01.381876+00:00, queued_by_job_id=1, pid=11272 2024-04-05T01:21:16.496595528Z [2024-04-05T01:21:16.495+0000] {scheduler_job.py:360} INFO - 2 tasks up for execution: 2024-04-05T01:21:16.496636044Z 2024-04-05T01:21:16.496642618Z 2024-04-05T01:21:16.496649146Z [2024-04-05T01:21:16.495+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03 has 0/16 running and queued tasks 2024-04-05T01:21:16.496674823Z [2024-04-05T01:21:16.495+0000] {scheduler_job.py:425} INFO - DAG vim_status_efedb139-678e-4925-ae63-6f11511c8b03 has 0/16 running and queued tasks 2024-04-05T01:21:16.496681228Z [2024-04-05T01:21:16.496+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:21:16.496687019Z 2024-04-05T01:21:16.496692646Z 2024-04-05T01:21:16.500428615Z [2024-04-05T01:21:16.499+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:20:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:21:16.500451429Z [2024-04-05T01:21:16.499+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:21:16.500455636Z [2024-04-05T01:21:16.500+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_efedb139-678e-4925-ae63-6f11511c8b03', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:20:00+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:21:16.500577835Z [2024-04-05T01:21:16.500+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_efedb139-678e-4925-ae63-6f11511c8b03', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:21:16.646197946Z [2024-04-05T01:21:16.645+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status queued for try_number 2 2024-04-05T01:21:16.646301316Z [2024-04-05T01:21:16.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_efedb139-678e-4925-ae63-6f11511c8b03.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status queued for try_number 2 2024-04-05T01:21:16.656187431Z [2024-04-05T01:21:16.655+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6f595cc-f7c3-4921-88f0-cfb0653c0592 2024-04-05T01:21:16.656563530Z [2024-04-05T01:21:16.656+0000] {scheduler_job.py:635} INFO - Setting external_id for to 471c6c12-3a45-40a3-961e-2f742e1d0798 2024-04-05T01:21:18.057120106Z [2024-04-05T01:21:18.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status failed for try_number 2 2024-04-05T01:21:18.057151477Z [2024-04-05T01:21:18.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_efedb139-678e-4925-ae63-6f11511c8b03.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status failed for try_number 2 2024-04-05T01:21:18.063986803Z [2024-04-05T01:21:18.063+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_efedb139-678e-4925-ae63-6f11511c8b03, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:20:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-05 01:21:05.662632+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:21:16.497319+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:21:18.064696627Z [2024-04-05T01:21:18.064+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:21:18.066813007Z [2024-04-05T01:21:18.066+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:21:18.080704107Z [2024-04-05T01:21:18.080+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vim_status_efedb139-678e-4925-ae63-6f11511c8b03, task_id=get_vim_status_and_send_to_prometheus, execution_date=20240405T012000, start_date=, end_date=20240405T012118 2024-04-05T01:21:18.087856903Z [2024-04-05T01:21:18.087+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:20:00+00:00, map_index=-1, run_start_date=None, run_end_date=2024-04-05 01:21:05.686357+00:00, run_duration=None, state=queued, executor_state=failed, try_number=2, max_tries=1, job_id=None, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:21:16.497319+00:00, queued_by_job_id=1, pid=None 2024-04-05T01:21:18.088270795Z [2024-04-05T01:21:18.088+0000] {scheduler_job.py:687} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:21:18.090237736Z [2024-04-05T01:21:18.090+0000] {taskinstance.py:1778} ERROR - Executor reports task instance finished (failed) although the task says its queued. (Info: None) Was the task killed externally? 2024-04-05T01:21:18.100968712Z [2024-04-05T01:21:18.100+0000] {taskinstance.py:1327} INFO - Marking task as FAILED. dag_id=vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03, task_id=get_all_vm_status_and_send_to_prometheus, execution_date=20240405T012000, start_date=, end_date=20240405T012118 2024-04-05T01:21:18.320473938Z [2024-04-05T01:21:18.320+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-05T01:21:18.320919711Z [2024-04-05T01:21:18.320+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_efedb139-678e-4925-ae63-6f11511c8b03, execution_date=2024-04-05 01:20:00+00:00, run_id=scheduled__2024-04-05T01:20:00+00:00, run_start_date=2024-04-05 01:21:01.052345+00:00, run_end_date=2024-04-05 01:21:18.320335+00:00, run_duration=17.26799, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:20:00+00:00, data_interval_end=2024-04-05 01:21:00+00:00, dag_hash=703b6c6f1cba6a93d9479e2ecee9bf1a 2024-04-05T01:21:18.329261060Z [2024-04-05T01:21:18.328+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_efedb139-678e-4925-ae63-6f11511c8b03 to 2024-04-05T01:21:00+00:00, run_after=2024-04-05T01:22:00+00:00 2024-04-05T01:21:18.335967855Z [2024-04-05T01:21:18.335+0000] {dagrun.py:586} ERROR - Marking run failed 2024-04-05T01:21:18.336263266Z [2024-04-05T01:21:18.336+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03, execution_date=2024-04-05 01:20:00+00:00, run_id=scheduled__2024-04-05T01:20:00+00:00, run_start_date=2024-04-05 01:21:01.068186+00:00, run_end_date=2024-04-05 01:21:18.335892+00:00, run_duration=17.267706, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:20:00+00:00, data_interval_end=2024-04-05 01:21:00+00:00, dag_hash=5f3d88c265ba27928f8bef4f40581d96 2024-04-05T01:21:18.344738312Z [2024-04-05T01:21:18.344+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_efedb139-678e-4925-ae63-6f11511c8b03 to 2024-04-05T01:21:00+00:00, run_after=2024-04-05T01:22:00+00:00 2024-04-05T01:22:00.997940182Z [2024-04-05T01:22:00.997+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:22:00+00:00, run_after=2024-04-05T01:23:00+00:00 2024-04-05T01:22:01.020232197Z [2024-04-05T01:22:01.019+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:22:00+00:00, run_after=2024-04-05T01:23:00+00:00 2024-04-05T01:22:01.030231611Z [2024-04-05T01:22:01.029+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:22:01.038563764Z [2024-04-05T01:22:01.038+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:22:01.153771683Z [2024-04-05T01:22:01.153+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:22:01.153816223Z 2024-04-05T01:22:01.153830411Z 2024-04-05T01:22:01.153838666Z 2024-04-05T01:22:01.153855358Z 2024-04-05T01:22:01.153942786Z [2024-04-05T01:22:01.153+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:22:01.153967244Z [2024-04-05T01:22:01.153+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:22:01.154140990Z [2024-04-05T01:22:01.153+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:22:01.154147979Z [2024-04-05T01:22:01.153+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:22:01.155102176Z [2024-04-05T01:22:01.154+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:22:01.155146743Z 2024-04-05T01:22:01.155156056Z 2024-04-05T01:22:01.155163973Z 2024-04-05T01:22:01.155178446Z 2024-04-05T01:22:01.160987061Z [2024-04-05T01:22:01.160+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:22:01.164050842Z [2024-04-05T01:22:01.160+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:22:01.164072319Z [2024-04-05T01:22:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:22:01.164076405Z [2024-04-05T01:22:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:22:01.164079671Z [2024-04-05T01:22:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:22:01.164083094Z [2024-04-05T01:22:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:22:01.164086373Z [2024-04-05T01:22:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:22:01.164089584Z [2024-04-05T01:22:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:22:01.728631309Z [2024-04-05T01:22:01.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status queued for try_number 1 2024-04-05T01:22:01.728664311Z [2024-04-05T01:22:01.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:21:00+00:00 exited with status queued for try_number 1 2024-04-05T01:22:01.728811403Z [2024-04-05T01:22:01.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:21:00+00:00 exited with status queued for try_number 1 2024-04-05T01:22:01.728933629Z [2024-04-05T01:22:01.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:21:00+00:00 exited with status queued for try_number 1 2024-04-05T01:22:01.776503225Z [2024-04-05T01:22:01.767+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0825724-dea6-422c-8011-c131e3c559e9 2024-04-05T01:22:01.776530049Z [2024-04-05T01:22:01.769+0000] {scheduler_job.py:635} INFO - Setting external_id for to be4d6d99-0b1c-4c10-8789-91dc660dd1f7 2024-04-05T01:22:01.776535087Z [2024-04-05T01:22:01.769+0000] {scheduler_job.py:635} INFO - Setting external_id for to d95d5855-61e0-40aa-a763-351b276dfa2b 2024-04-05T01:22:01.776539230Z [2024-04-05T01:22:01.769+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6949dac0-4deb-4d64-a435-f0bf10da9271 2024-04-05T01:22:03.144363525Z [2024-04-05T01:22:03.143+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:22:03.146132779Z [2024-04-05T01:22:03.145+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:20:00+00:00, run_id=scheduled__2024-04-05T01:20:00+00:00, run_start_date=2024-04-05 01:22:01.051579+00:00, run_end_date=2024-04-05 01:22:03.144260+00:00, run_duration=2.092681, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:20:00+00:00, data_interval_end=2024-04-05 01:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:22:03.161003976Z [2024-04-05T01:22:03.159+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:22:00+00:00, run_after=2024-04-05T01:24:00+00:00 2024-04-05T01:22:03.940062880Z [2024-04-05T01:22:03.937+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:22:03.940402039Z [2024-04-05T01:22:03.940+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:21:00+00:00, run_id=scheduled__2024-04-05T01:21:00+00:00, run_start_date=2024-04-05 01:22:01.052903+00:00, run_end_date=2024-04-05 01:22:03.939962+00:00, run_duration=2.887059, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:21:00+00:00, data_interval_end=2024-04-05 01:22:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:22:03.954542509Z [2024-04-05T01:22:03.954+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:22:00+00:00, run_after=2024-04-05T01:23:00+00:00 2024-04-05T01:22:04.025995971Z [2024-04-05T01:22:04.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status success for try_number 1 2024-04-05T01:22:04.026200045Z [2024-04-05T01:22:04.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:21:00+00:00 exited with status success for try_number 1 2024-04-05T01:22:04.034674388Z [2024-04-05T01:22:04.034+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:21:00+00:00, map_index=-1, run_start_date=2024-04-05 01:22:02.626494+00:00, run_end_date=2024-04-05 01:22:03.215253+00:00, run_duration=0.588759, state=success, executor_state=success, try_number=1, max_tries=1, job_id=774, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:22:01.156330+00:00, queued_by_job_id=1, pid=11358 2024-04-05T01:22:04.035014862Z [2024-04-05T01:22:04.034+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:20:00+00:00, map_index=-1, run_start_date=2024-04-05 01:22:02.438523+00:00, run_end_date=2024-04-05 01:22:03.070511+00:00, run_duration=0.631988, state=success, executor_state=success, try_number=1, max_tries=1, job_id=773, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:22:01.156330+00:00, queued_by_job_id=1, pid=11357 2024-04-05T01:22:06.221873761Z [2024-04-05T01:22:06.221+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:22:06.222217950Z [2024-04-05T01:22:06.222+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:21:00+00:00, run_id=scheduled__2024-04-05T01:21:00+00:00, run_start_date=2024-04-05 01:22:01.053964+00:00, run_end_date=2024-04-05 01:22:06.221796+00:00, run_duration=5.167832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:21:00+00:00, data_interval_end=2024-04-05 01:22:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:22:06.231306460Z [2024-04-05T01:22:06.231+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:22:00+00:00, run_after=2024-04-05T01:23:00+00:00 2024-04-05T01:22:07.376543108Z [2024-04-05T01:22:07.375+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:22:07.377039441Z [2024-04-05T01:22:07.376+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:21:00+00:00, run_id=scheduled__2024-04-05T01:21:00+00:00, run_start_date=2024-04-05 01:22:01.054927+00:00, run_end_date=2024-04-05 01:22:07.376528+00:00, run_duration=6.321601, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:21:00+00:00, data_interval_end=2024-04-05 01:22:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:22:07.387098873Z [2024-04-05T01:22:07.386+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:22:00+00:00, run_after=2024-04-05T01:23:00+00:00 2024-04-05T01:22:07.422886556Z [2024-04-05T01:22:07.422+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:21:00+00:00 exited with status success for try_number 1 2024-04-05T01:22:07.425297887Z [2024-04-05T01:22:07.424+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:21:00+00:00 exited with status success for try_number 1 2024-04-05T01:22:07.432505881Z [2024-04-05T01:22:07.432+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:21:00+00:00, map_index=-1, run_start_date=2024-04-05 01:22:04.084582+00:00, run_end_date=2024-04-05 01:22:06.177037+00:00, run_duration=2.092455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=776, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:22:01.156330+00:00, queued_by_job_id=1, pid=11382 2024-04-05T01:22:07.432751869Z [2024-04-05T01:22:07.432+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:21:00+00:00, map_index=-1, run_start_date=2024-04-05 01:22:03.937240+00:00, run_end_date=2024-04-05 01:22:06.654480+00:00, run_duration=2.71724, state=success, executor_state=success, try_number=1, max_tries=1, job_id=775, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:22:01.156330+00:00, queued_by_job_id=1, pid=11381 2024-04-05T01:23:00.792288791Z [2024-04-05T01:23:00.791+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:23:00+00:00, run_after=2024-04-05T01:24:00+00:00 2024-04-05T01:23:00.813684861Z [2024-04-05T01:23:00.813+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:23:00+00:00, run_after=2024-04-05T01:24:00+00:00 2024-04-05T01:23:00.829219171Z [2024-04-05T01:23:00.828+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:23:00.924773642Z [2024-04-05T01:23:00.923+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:23:00.924803526Z 2024-04-05T01:23:00.924809085Z 2024-04-05T01:23:00.924813709Z 2024-04-05T01:23:00.925411789Z [2024-04-05T01:23:00.924+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:23:00.925745919Z [2024-04-05T01:23:00.925+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:23:00.926100358Z [2024-04-05T01:23:00.925+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:23:00.927261185Z [2024-04-05T01:23:00.926+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:23:00.927273791Z 2024-04-05T01:23:00.927278509Z 2024-04-05T01:23:00.927301422Z 2024-04-05T01:23:00.935544014Z [2024-04-05T01:23:00.935+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:23:00.935976802Z [2024-04-05T01:23:00.935+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:23:00.936513150Z [2024-04-05T01:23:00.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:23:00.936752019Z [2024-04-05T01:23:00.936+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:23:00.937195942Z [2024-04-05T01:23:00.936+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:23:00.937445293Z [2024-04-05T01:23:00.937+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:23:01.356548779Z [2024-04-05T01:23:01.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:22:00+00:00 exited with status queued for try_number 1 2024-04-05T01:23:01.356575685Z [2024-04-05T01:23:01.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:22:00+00:00 exited with status queued for try_number 1 2024-04-05T01:23:01.356580075Z [2024-04-05T01:23:01.355+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:22:00+00:00 exited with status queued for try_number 1 2024-04-05T01:23:01.370969362Z [2024-04-05T01:23:01.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1c3701fb-4551-41fc-9bc7-21c72ca502fa 2024-04-05T01:23:01.371275657Z [2024-04-05T01:23:01.370+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ae36b23-a65d-4351-9af2-69fae57acc4b 2024-04-05T01:23:01.371681493Z [2024-04-05T01:23:01.371+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa4aaabb-bbb2-4d5a-a89d-7ad906ec0232 2024-04-05T01:23:02.576387508Z [2024-04-05T01:23:02.575+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:23:02.579195668Z [2024-04-05T01:23:02.576+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:22:00+00:00, run_id=scheduled__2024-04-05T01:22:00+00:00, run_start_date=2024-04-05 01:23:00.844991+00:00, run_end_date=2024-04-05 01:23:02.576477+00:00, run_duration=1.731486, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:22:00+00:00, data_interval_end=2024-04-05 01:23:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:23:02.596788680Z [2024-04-05T01:23:02.595+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:23:00+00:00, run_after=2024-04-05T01:24:00+00:00 2024-04-05T01:23:03.854892914Z [2024-04-05T01:23:03.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:22:00+00:00 exited with status success for try_number 1 2024-04-05T01:23:03.862637497Z [2024-04-05T01:23:03.862+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:22:00+00:00, map_index=-1, run_start_date=2024-04-05 01:23:02.043792+00:00, run_end_date=2024-04-05 01:23:02.533705+00:00, run_duration=0.489913, state=success, executor_state=success, try_number=1, max_tries=1, job_id=777, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:23:00.928680+00:00, queued_by_job_id=1, pid=11414 2024-04-05T01:23:04.795255750Z [2024-04-05T01:23:04.794+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:23:04.795820057Z [2024-04-05T01:23:04.795+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:22:00+00:00, run_id=scheduled__2024-04-05T01:22:00+00:00, run_start_date=2024-04-05 01:23:00.846555+00:00, run_end_date=2024-04-05 01:23:04.795125+00:00, run_duration=3.94857, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:22:00+00:00, data_interval_end=2024-04-05 01:23:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:23:04.808163393Z [2024-04-05T01:23:04.807+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:23:00+00:00, run_after=2024-04-05T01:24:00+00:00 2024-04-05T01:23:04.857800241Z [2024-04-05T01:23:04.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:22:00+00:00 exited with status success for try_number 1 2024-04-05T01:23:04.863391648Z [2024-04-05T01:23:04.862+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:22:00+00:00, map_index=-1, run_start_date=2024-04-05 01:23:03.190133+00:00, run_end_date=2024-04-05 01:23:04.509996+00:00, run_duration=1.319863, state=success, executor_state=success, try_number=1, max_tries=1, job_id=778, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:23:00.928680+00:00, queued_by_job_id=1, pid=11427 2024-04-05T01:23:05.915382523Z [2024-04-05T01:23:05.914+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:23:05.915811805Z [2024-04-05T01:23:05.915+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:22:00+00:00, run_id=scheduled__2024-04-05T01:22:00+00:00, run_start_date=2024-04-05 01:23:00.847959+00:00, run_end_date=2024-04-05 01:23:05.915382+00:00, run_duration=5.067423, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:22:00+00:00, data_interval_end=2024-04-05 01:23:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:23:05.925178673Z [2024-04-05T01:23:05.924+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:23:00+00:00, run_after=2024-04-05T01:24:00+00:00 2024-04-05T01:23:05.960332982Z [2024-04-05T01:23:05.959+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:22:00+00:00 exited with status success for try_number 1 2024-04-05T01:23:05.967914083Z [2024-04-05T01:23:05.967+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:22:00+00:00, map_index=-1, run_start_date=2024-04-05 01:23:03.461124+00:00, run_end_date=2024-04-05 01:23:05.379863+00:00, run_duration=1.918739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=779, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:23:00.928680+00:00, queued_by_job_id=1, pid=11435 2024-04-05T01:24:00.095192597Z [2024-04-05T01:24:00.094+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:24:00.102021901Z [2024-04-05T01:24:00.101+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:24:00.114680593Z [2024-04-05T01:24:00.114+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:24:00+00:00, run_after=2024-04-05T01:25:00+00:00 2024-04-05T01:24:00.126586415Z [2024-04-05T01:24:00.126+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:24:00+00:00, run_after=2024-04-05T01:25:00+00:00 2024-04-05T01:24:00.267692285Z [2024-04-05T01:24:00.262+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:24:00.267712153Z 2024-04-05T01:24:00.267716976Z 2024-04-05T01:24:00.267720627Z 2024-04-05T01:24:00.267724058Z 2024-04-05T01:24:00.267727893Z [2024-04-05T01:24:00.262+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:24:00.267748378Z [2024-04-05T01:24:00.262+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:24:00.267753378Z [2024-04-05T01:24:00.262+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:24:00.267758210Z [2024-04-05T01:24:00.262+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:24:00.267763159Z [2024-04-05T01:24:00.263+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:24:00.267768101Z 2024-04-05T01:24:00.267773987Z 2024-04-05T01:24:00.267778995Z 2024-04-05T01:24:00.267783821Z 2024-04-05T01:24:00.273216760Z [2024-04-05T01:24:00.267+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:24:00.273239714Z [2024-04-05T01:24:00.271+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:24:00.273248804Z [2024-04-05T01:24:00.272+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:24:00.273254113Z [2024-04-05T01:24:00.272+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:24:00.273258412Z [2024-04-05T01:24:00.272+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:24:00.273261682Z [2024-04-05T01:24:00.272+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:24:00.273265238Z [2024-04-05T01:24:00.272+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:24:00.273268435Z [2024-04-05T01:24:00.272+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:24:00.902512257Z [2024-04-05T01:24:00.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:22:00+00:00 exited with status queued for try_number 1 2024-04-05T01:24:00.902771212Z [2024-04-05T01:24:00.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:23:00+00:00 exited with status queued for try_number 1 2024-04-05T01:24:00.902930470Z [2024-04-05T01:24:00.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:23:00+00:00 exited with status queued for try_number 1 2024-04-05T01:24:00.903164637Z [2024-04-05T01:24:00.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:23:00+00:00 exited with status queued for try_number 1 2024-04-05T01:24:00.921279178Z [2024-04-05T01:24:00.920+0000] {scheduler_job.py:635} INFO - Setting external_id for to cfe1c1a2-c37f-4059-b792-9462f4e567d4 2024-04-05T01:24:00.922303982Z [2024-04-05T01:24:00.921+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e75776d-dcb7-45ab-b263-dd0e605b4562 2024-04-05T01:24:00.923322256Z [2024-04-05T01:24:00.922+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed1ad15b-b9c6-4fcc-bc04-47ee9c13eaf5 2024-04-05T01:24:00.924519251Z [2024-04-05T01:24:00.924+0000] {scheduler_job.py:635} INFO - Setting external_id for to bdd281ad-508e-47ad-be7f-67014e5c3698 2024-04-05T01:24:03.455863849Z [2024-04-05T01:24:03.455+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:24:03.456626027Z [2024-04-05T01:24:03.456+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:22:00+00:00, run_id=scheduled__2024-04-05T01:22:00+00:00, run_start_date=2024-04-05 01:24:00.137428+00:00, run_end_date=2024-04-05 01:24:03.456178+00:00, run_duration=3.31875, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:22:00+00:00, data_interval_end=2024-04-05 01:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:24:03.465920630Z [2024-04-05T01:24:03.465+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:24:00+00:00, run_after=2024-04-05T01:26:00+00:00 2024-04-05T01:24:03.475187315Z [2024-04-05T01:24:03.474+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:24:03.475720512Z [2024-04-05T01:24:03.475+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:23:00+00:00, run_id=scheduled__2024-04-05T01:23:00+00:00, run_start_date=2024-04-05 01:24:00.138684+00:00, run_end_date=2024-04-05 01:24:03.475338+00:00, run_duration=3.336654, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:23:00+00:00, data_interval_end=2024-04-05 01:24:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:24:03.488412807Z [2024-04-05T01:24:03.488+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:24:00+00:00, run_after=2024-04-05T01:25:00+00:00 2024-04-05T01:24:03.554375489Z [2024-04-05T01:24:03.553+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:22:00+00:00 exited with status success for try_number 1 2024-04-05T01:24:03.554401143Z [2024-04-05T01:24:03.554+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:23:00+00:00 exited with status success for try_number 1 2024-04-05T01:24:03.564036895Z [2024-04-05T01:24:03.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:22:00+00:00, map_index=-1, run_start_date=2024-04-05 01:24:01.759106+00:00, run_end_date=2024-04-05 01:24:02.401506+00:00, run_duration=0.6424, state=success, executor_state=success, try_number=1, max_tries=1, job_id=781, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:24:00.264673+00:00, queued_by_job_id=1, pid=11466 2024-04-05T01:24:03.564211325Z [2024-04-05T01:24:03.563+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:23:00+00:00, map_index=-1, run_start_date=2024-04-05 01:24:01.729066+00:00, run_end_date=2024-04-05 01:24:02.332011+00:00, run_duration=0.602945, state=success, executor_state=success, try_number=1, max_tries=1, job_id=780, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:24:00.264673+00:00, queued_by_job_id=1, pid=11465 2024-04-05T01:24:06.022407125Z [2024-04-05T01:24:06.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:24:06.022965179Z [2024-04-05T01:24:06.022+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:23:00+00:00, run_id=scheduled__2024-04-05T01:23:00+00:00, run_start_date=2024-04-05 01:24:00.139679+00:00, run_end_date=2024-04-05 01:24:06.022359+00:00, run_duration=5.88268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:23:00+00:00, data_interval_end=2024-04-05 01:24:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:24:06.037489114Z [2024-04-05T01:24:06.037+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:24:00+00:00, run_after=2024-04-05T01:25:00+00:00 2024-04-05T01:24:06.084579827Z [2024-04-05T01:24:06.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:23:00+00:00 exited with status success for try_number 1 2024-04-05T01:24:06.092060177Z [2024-04-05T01:24:06.091+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:23:00+00:00, map_index=-1, run_start_date=2024-04-05 01:24:03.603175+00:00, run_end_date=2024-04-05 01:24:05.723583+00:00, run_duration=2.120408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=782, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:24:00.264673+00:00, queued_by_job_id=1, pid=11489 2024-04-05T01:24:07.161403186Z [2024-04-05T01:24:07.160+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:24:07.161832027Z [2024-04-05T01:24:07.161+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:23:00+00:00, run_id=scheduled__2024-04-05T01:23:00+00:00, run_start_date=2024-04-05 01:24:00.140607+00:00, run_end_date=2024-04-05 01:24:07.161328+00:00, run_duration=7.020721, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:23:00+00:00, data_interval_end=2024-04-05 01:24:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:24:07.174508058Z [2024-04-05T01:24:07.174+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:24:00+00:00, run_after=2024-04-05T01:25:00+00:00 2024-04-05T01:24:07.212857624Z [2024-04-05T01:24:07.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:23:00+00:00 exited with status success for try_number 1 2024-04-05T01:24:07.219289005Z [2024-04-05T01:24:07.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:23:00+00:00, map_index=-1, run_start_date=2024-04-05 01:24:03.732432+00:00, run_end_date=2024-04-05 01:24:06.318180+00:00, run_duration=2.585748, state=success, executor_state=success, try_number=1, max_tries=1, job_id=783, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:24:00.264673+00:00, queued_by_job_id=1, pid=11490 2024-04-05T01:25:00.442695217Z [2024-04-05T01:25:00.442+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:25:00+00:00, run_after=2024-04-05T01:26:00+00:00 2024-04-05T01:25:00.456868983Z [2024-04-05T01:25:00.456+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:25:00+00:00, run_after=2024-04-05T01:30:00+00:00 2024-04-05T01:25:00.467434298Z [2024-04-05T01:25:00.466+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:25:00.489700152Z [2024-04-05T01:25:00.489+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:25:00+00:00, run_after=2024-04-05T01:26:00+00:00 2024-04-05T01:25:00.591316102Z [2024-04-05T01:25:00.590+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:25:00.591348349Z 2024-04-05T01:25:00.591352877Z 2024-04-05T01:25:00.591356413Z 2024-04-05T01:25:00.591360018Z 2024-04-05T01:25:00.591488880Z [2024-04-05T01:25:00.591+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:25:00.591636896Z [2024-04-05T01:25:00.591+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:25:00.591748273Z [2024-04-05T01:25:00.591+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:25:00.591892511Z [2024-04-05T01:25:00.591+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:25:00.592508254Z [2024-04-05T01:25:00.592+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:25:00.592518937Z 2024-04-05T01:25:00.592523154Z 2024-04-05T01:25:00.592526636Z 2024-04-05T01:25:00.592529748Z 2024-04-05T01:25:00.596199334Z [2024-04-05T01:25:00.595+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:25:00.596291672Z [2024-04-05T01:25:00.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:25:00.596560664Z [2024-04-05T01:25:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:25:00.596665511Z [2024-04-05T01:25:00.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:25:00.596944698Z [2024-04-05T01:25:00.596+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:25:00.597080154Z [2024-04-05T01:25:00.596+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:25:00.597315511Z [2024-04-05T01:25:00.597+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:25:00.597408177Z [2024-04-05T01:25:00.597+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:25:00.971892721Z [2024-04-05T01:25:00.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status queued for try_number 1 2024-04-05T01:25:00.971991198Z [2024-04-05T01:25:00.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:24:00+00:00 exited with status queued for try_number 1 2024-04-05T01:25:00.971997159Z [2024-04-05T01:25:00.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:24:00+00:00 exited with status queued for try_number 1 2024-04-05T01:25:00.972035671Z [2024-04-05T01:25:00.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:24:00+00:00 exited with status queued for try_number 1 2024-04-05T01:25:00.987692545Z [2024-04-05T01:25:00.987+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ee0bb96-23a8-408d-b3a3-85143f8ea3c7 2024-04-05T01:25:00.987775886Z [2024-04-05T01:25:00.987+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71f7a80d-8d91-4f84-a12b-a26ef3dc153c 2024-04-05T01:25:00.987876163Z [2024-04-05T01:25:00.987+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31a52137-df89-4b29-a2ee-548208b1ec94 2024-04-05T01:25:00.987967356Z [2024-04-05T01:25:00.987+0000] {scheduler_job.py:635} INFO - Setting external_id for to ccbaeb39-d528-4a1f-9844-5c9d6534edc3 2024-04-05T01:25:03.197572934Z [2024-04-05T01:25:03.196+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:25:03.198457712Z [2024-04-05T01:25:03.197+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:24:00+00:00, run_id=scheduled__2024-04-05T01:24:00+00:00, run_start_date=2024-04-05 01:25:00.510988+00:00, run_end_date=2024-04-05 01:25:03.197686+00:00, run_duration=2.686698, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:24:00+00:00, data_interval_end=2024-04-05 01:25:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:25:03.219699312Z [2024-04-05T01:25:03.219+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:25:00+00:00, run_after=2024-04-05T01:26:00+00:00 2024-04-05T01:25:03.350738599Z [2024-04-05T01:25:03.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:24:00+00:00 exited with status success for try_number 1 2024-04-05T01:25:03.390255683Z [2024-04-05T01:25:03.389+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:24:00+00:00, map_index=-1, run_start_date=2024-04-05 01:25:02.218354+00:00, run_end_date=2024-04-05 01:25:02.787240+00:00, run_duration=0.568886, state=success, executor_state=success, try_number=1, max_tries=1, job_id=784, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:25:00.593462+00:00, queued_by_job_id=1, pid=11524 2024-04-05T01:25:04.490155192Z [2024-04-05T01:25:04.489+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:25:04.490733130Z [2024-04-05T01:25:04.490+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:24:00+00:00, run_id=scheduled__2024-04-05T01:24:00+00:00, run_start_date=2024-04-05 01:25:00.513460+00:00, run_end_date=2024-04-05 01:25:04.489893+00:00, run_duration=3.976433, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:24:00+00:00, data_interval_end=2024-04-05 01:25:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:25:04.517731807Z [2024-04-05T01:25:04.516+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:25:00+00:00, run_after=2024-04-05T01:26:00+00:00 2024-04-05T01:25:04.589035519Z [2024-04-05T01:25:04.588+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:25:04.589066574Z 2024-04-05T01:25:04.589277130Z [2024-04-05T01:25:04.589+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:25:04.589989915Z [2024-04-05T01:25:04.589+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:25:04.590006727Z 2024-04-05T01:25:04.593519606Z [2024-04-05T01:25:04.593+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:25:04.593730834Z [2024-04-05T01:25:04.593+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:25:04.673204540Z [2024-04-05T01:25:04.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status queued for try_number 1 2024-04-05T01:25:04.673274336Z [2024-04-05T01:25:04.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:24:00+00:00 exited with status success for try_number 1 2024-04-05T01:25:04.687218514Z [2024-04-05T01:25:04.686+0000] {scheduler_job.py:635} INFO - Setting external_id for to eebcd700-7c49-4190-bcf4-eb8697c6fcc7 2024-04-05T01:25:04.687294608Z [2024-04-05T01:25:04.686+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:24:00+00:00, map_index=-1, run_start_date=2024-04-05 01:25:03.019126+00:00, run_end_date=2024-04-05 01:25:04.405867+00:00, run_duration=1.386741, state=success, executor_state=success, try_number=1, max_tries=1, job_id=785, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:25:00.593462+00:00, queued_by_job_id=1, pid=11536 2024-04-05T01:25:04.823180353Z [2024-04-05T01:25:04.822+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status success for try_number 1 2024-04-05T01:25:04.832366459Z [2024-04-05T01:25:04.831+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:20:00+00:00, map_index=-1, run_start_date=2024-04-05 01:25:04.088084+00:00, run_end_date=2024-04-05 01:25:04.499758+00:00, run_duration=0.411674, state=success, executor_state=success, try_number=1, max_tries=1, job_id=787, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:25:00.593462+00:00, queued_by_job_id=1, pid=11559 2024-04-05T01:25:05.907917787Z [2024-04-05T01:25:05.903+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:25:05.908759523Z [2024-04-05T01:25:05.908+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:24:00+00:00, run_id=scheduled__2024-04-05T01:24:00+00:00, run_start_date=2024-04-05 01:25:00.514690+00:00, run_end_date=2024-04-05 01:25:05.907887+00:00, run_duration=5.393197, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:24:00+00:00, data_interval_end=2024-04-05 01:25:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:25:05.931922293Z [2024-04-05T01:25:05.931+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:25:00+00:00, run_after=2024-04-05T01:26:00+00:00 2024-04-05T01:25:05.995385671Z [2024-04-05T01:25:05.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:24:00+00:00 exited with status success for try_number 1 2024-04-05T01:25:06.005846620Z [2024-04-05T01:25:06.005+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:24:00+00:00, map_index=-1, run_start_date=2024-04-05 01:25:03.588667+00:00, run_end_date=2024-04-05 01:25:05.235506+00:00, run_duration=1.646839, state=success, executor_state=success, try_number=1, max_tries=1, job_id=786, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:25:00.593462+00:00, queued_by_job_id=1, pid=11548 2024-04-05T01:25:07.110177200Z [2024-04-05T01:25:07.109+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:25:07.110230649Z 2024-04-05T01:25:07.110371512Z [2024-04-05T01:25:07.110+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:25:07.113105345Z [2024-04-05T01:25:07.112+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:25:07.113165774Z 2024-04-05T01:25:07.120004901Z [2024-04-05T01:25:07.119+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:25:07.120203788Z [2024-04-05T01:25:07.119+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:25:07.191934900Z [2024-04-05T01:25:07.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status queued for try_number 1 2024-04-05T01:25:07.192127192Z [2024-04-05T01:25:07.191+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status success for try_number 1 2024-04-05T01:25:07.201136187Z [2024-04-05T01:25:07.200+0000] {scheduler_job.py:635} INFO - Setting external_id for to be0d50e3-64b4-4453-8ac8-fcc74c2b1132 2024-04-05T01:25:07.201353489Z [2024-04-05T01:25:07.201+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T01:20:00+00:00, map_index=-1, run_start_date=2024-04-05 01:25:06.449034+00:00, run_end_date=2024-04-05 01:25:06.864470+00:00, run_duration=0.415436, state=success, executor_state=success, try_number=1, max_tries=1, job_id=788, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:25:04.590491+00:00, queued_by_job_id=1, pid=11572 2024-04-05T01:25:09.523722608Z [2024-04-05T01:25:09.523+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:25:09.523765621Z 2024-04-05T01:25:09.524129897Z [2024-04-05T01:25:09.523+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:25:09.525208373Z [2024-04-05T01:25:09.524+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:25:09.525232534Z 2024-04-05T01:25:09.529177169Z [2024-04-05T01:25:09.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:25:09.529536317Z [2024-04-05T01:25:09.529+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:25:09.620840984Z [2024-04-05T01:25:09.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status queued for try_number 1 2024-04-05T01:25:09.620890266Z [2024-04-05T01:25:09.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status success for try_number 1 2024-04-05T01:25:09.631652657Z [2024-04-05T01:25:09.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 15d67498-615c-421d-974b-fb3dd798976d 2024-04-05T01:25:09.631782173Z [2024-04-05T01:25:09.631+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:20:00+00:00, map_index=0, run_start_date=2024-04-05 01:25:09.010278+00:00, run_end_date=2024-04-05 01:25:09.410294+00:00, run_duration=0.400016, state=success, executor_state=success, try_number=1, max_tries=1, job_id=789, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:25:07.114205+00:00, queued_by_job_id=1, pid=11580 2024-04-05T01:25:12.272363473Z [2024-04-05T01:25:12.271+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:25:12.272741759Z [2024-04-05T01:25:12.272+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:20:00+00:00, run_id=scheduled__2024-04-05T01:20:00+00:00, run_start_date=2024-04-05 01:25:00.509296+00:00, run_end_date=2024-04-05 01:25:12.272263+00:00, run_duration=11.762967, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:20:00+00:00, data_interval_end=2024-04-05 01:25:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T01:25:12.279840928Z [2024-04-05T01:25:12.279+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:25:00+00:00, run_after=2024-04-05T01:30:00+00:00 2024-04-05T01:25:12.311469393Z [2024-04-05T01:25:12.311+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:20:00+00:00 exited with status success for try_number 1 2024-04-05T01:25:12.316883708Z [2024-04-05T01:25:12.316+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:20:00+00:00, map_index=-1, run_start_date=2024-04-05 01:25:11.523182+00:00, run_end_date=2024-04-05 01:25:12.028562+00:00, run_duration=0.50538, state=success, executor_state=success, try_number=1, max_tries=1, job_id=790, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:25:09.525995+00:00, queued_by_job_id=1, pid=11598 2024-04-05T01:25:41.206325894Z [2024-04-05T01:25:41.203+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T01:26:00.998528905Z [2024-04-05T01:26:00.997+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:26:01.020729289Z [2024-04-05T01:26:01.020+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:26:00+00:00, run_after=2024-04-05T01:27:00+00:00 2024-04-05T01:26:01.032945222Z [2024-04-05T01:26:01.032+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:26:01.049786113Z [2024-04-05T01:26:01.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:26:00+00:00, run_after=2024-04-05T01:27:00+00:00 2024-04-05T01:26:01.252382616Z [2024-04-05T01:26:01.232+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:26:01.252412729Z 2024-04-05T01:26:01.252417606Z 2024-04-05T01:26:01.252421294Z 2024-04-05T01:26:01.252425260Z 2024-04-05T01:26:01.252430108Z [2024-04-05T01:26:01.233+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:26:01.252433727Z [2024-04-05T01:26:01.233+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:26:01.252436983Z [2024-04-05T01:26:01.233+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:26:01.252440170Z [2024-04-05T01:26:01.233+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:26:01.252443483Z [2024-04-05T01:26:01.234+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:26:01.252446754Z 2024-04-05T01:26:01.252450032Z 2024-04-05T01:26:01.252453474Z 2024-04-05T01:26:01.252456846Z 2024-04-05T01:26:01.260353698Z [2024-04-05T01:26:01.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:26:01.263553963Z [2024-04-05T01:26:01.261+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:26:01.263596207Z [2024-04-05T01:26:01.262+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:26:01.267705328Z [2024-04-05T01:26:01.263+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:26:01.267749816Z [2024-04-05T01:26:01.263+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:26:01.267753483Z [2024-04-05T01:26:01.264+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:26:01.267756689Z [2024-04-05T01:26:01.264+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:26:01.267759980Z [2024-04-05T01:26:01.264+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:26:01.964160544Z [2024-04-05T01:26:01.963+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:24:00+00:00 exited with status queued for try_number 1 2024-04-05T01:26:01.965537053Z [2024-04-05T01:26:01.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status queued for try_number 1 2024-04-05T01:26:01.965606367Z [2024-04-05T01:26:01.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status queued for try_number 1 2024-04-05T01:26:01.965922212Z [2024-04-05T01:26:01.965+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status queued for try_number 1 2024-04-05T01:26:01.985454373Z [2024-04-05T01:26:01.984+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0acd62bf-9c23-4dea-9fa5-2f088ea387b3 2024-04-05T01:26:01.985670119Z [2024-04-05T01:26:01.985+0000] {scheduler_job.py:635} INFO - Setting external_id for to 08a4fcd2-546b-4ca7-9dca-a073ba3d4b33 2024-04-05T01:26:01.985909996Z [2024-04-05T01:26:01.985+0000] {scheduler_job.py:635} INFO - Setting external_id for to 312defb2-6f55-46e6-b270-bd343c2f31ab 2024-04-05T01:26:01.986026199Z [2024-04-05T01:26:01.985+0000] {scheduler_job.py:635} INFO - Setting external_id for to aac31d37-ea9f-4d9b-81a5-b55193c614fc 2024-04-05T01:26:04.331020498Z [2024-04-05T01:26:04.330+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:26:04.331267240Z [2024-04-05T01:26:04.331+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:25:00+00:00, run_id=scheduled__2024-04-05T01:25:00+00:00, run_start_date=2024-04-05 01:26:01.070328+00:00, run_end_date=2024-04-05 01:26:04.330846+00:00, run_duration=3.260518, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:25:00+00:00, data_interval_end=2024-04-05 01:26:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:26:04.342002689Z [2024-04-05T01:26:04.341+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:26:00+00:00, run_after=2024-04-05T01:27:00+00:00 2024-04-05T01:26:04.350077894Z [2024-04-05T01:26:04.349+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:26:04.350243757Z [2024-04-05T01:26:04.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:24:00+00:00, run_id=scheduled__2024-04-05T01:24:00+00:00, run_start_date=2024-04-05 01:26:01.068766+00:00, run_end_date=2024-04-05 01:26:04.349930+00:00, run_duration=3.281164, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:24:00+00:00, data_interval_end=2024-04-05 01:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:26:04.358762704Z [2024-04-05T01:26:04.358+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:26:00+00:00, run_after=2024-04-05T01:28:00+00:00 2024-04-05T01:26:04.413610233Z [2024-04-05T01:26:04.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:24:00+00:00 exited with status success for try_number 1 2024-04-05T01:26:04.413638119Z [2024-04-05T01:26:04.412+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status success for try_number 1 2024-04-05T01:26:04.420669211Z [2024-04-05T01:26:04.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:25:00+00:00, map_index=-1, run_start_date=2024-04-05 01:26:02.719290+00:00, run_end_date=2024-04-05 01:26:03.514775+00:00, run_duration=0.795485, state=success, executor_state=success, try_number=1, max_tries=1, job_id=791, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:26:01.240365+00:00, queued_by_job_id=1, pid=11611 2024-04-05T01:26:04.420731357Z [2024-04-05T01:26:04.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:24:00+00:00, map_index=-1, run_start_date=2024-04-05 01:26:03.014257+00:00, run_end_date=2024-04-05 01:26:03.748334+00:00, run_duration=0.734077, state=success, executor_state=success, try_number=1, max_tries=1, job_id=792, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:26:01.240365+00:00, queued_by_job_id=1, pid=11612 2024-04-05T01:26:06.596488480Z [2024-04-05T01:26:06.596+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:26:06.596743661Z [2024-04-05T01:26:06.596+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:25:00+00:00, run_id=scheduled__2024-04-05T01:25:00+00:00, run_start_date=2024-04-05 01:26:01.071698+00:00, run_end_date=2024-04-05 01:26:06.596376+00:00, run_duration=5.524678, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:25:00+00:00, data_interval_end=2024-04-05 01:26:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:26:06.606332034Z [2024-04-05T01:26:06.605+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:26:00+00:00, run_after=2024-04-05T01:27:00+00:00 2024-04-05T01:26:06.614806853Z [2024-04-05T01:26:06.614+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:26:06.614991277Z [2024-04-05T01:26:06.614+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:25:00+00:00, run_id=scheduled__2024-04-05T01:25:00+00:00, run_start_date=2024-04-05 01:26:01.073128+00:00, run_end_date=2024-04-05 01:26:06.614613+00:00, run_duration=5.541485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:25:00+00:00, data_interval_end=2024-04-05 01:26:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:26:06.625051288Z [2024-04-05T01:26:06.624+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:26:00+00:00, run_after=2024-04-05T01:27:00+00:00 2024-04-05T01:26:06.658956797Z [2024-04-05T01:26:06.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status success for try_number 1 2024-04-05T01:26:06.659048419Z [2024-04-05T01:26:06.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status success for try_number 1 2024-04-05T01:26:06.667512761Z [2024-04-05T01:26:06.667+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:25:00+00:00, map_index=-1, run_start_date=2024-04-05 01:26:04.241724+00:00, run_end_date=2024-04-05 01:26:06.032821+00:00, run_duration=1.791097, state=success, executor_state=success, try_number=1, max_tries=1, job_id=793, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:26:01.240365+00:00, queued_by_job_id=1, pid=11635 2024-04-05T01:26:06.668194376Z [2024-04-05T01:26:06.667+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:25:00+00:00, map_index=-1, run_start_date=2024-04-05 01:26:04.324051+00:00, run_end_date=2024-04-05 01:26:06.384552+00:00, run_duration=2.060501, state=success, executor_state=success, try_number=1, max_tries=1, job_id=794, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:26:01.240365+00:00, queued_by_job_id=1, pid=11636 2024-04-05T01:27:00.056936779Z [2024-04-05T01:27:00.056+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:27:00.094985067Z [2024-04-05T01:27:00.094+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:27:00+00:00, run_after=2024-04-05T01:28:00+00:00 2024-04-05T01:27:00.130758647Z [2024-04-05T01:27:00.130+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:27:00+00:00, run_after=2024-04-05T01:28:00+00:00 2024-04-05T01:27:00.221676369Z [2024-04-05T01:27:00.221+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:27:00.221701823Z 2024-04-05T01:27:00.221705584Z 2024-04-05T01:27:00.221708852Z 2024-04-05T01:27:00.221796352Z [2024-04-05T01:27:00.221+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:27:00.221984015Z [2024-04-05T01:27:00.221+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:27:00.222131796Z [2024-04-05T01:27:00.222+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:27:00.222780643Z [2024-04-05T01:27:00.222+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:27:00.222792117Z 2024-04-05T01:27:00.222795507Z 2024-04-05T01:27:00.222804465Z 2024-04-05T01:27:00.226204082Z [2024-04-05T01:27:00.225+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:27:00.226362740Z [2024-04-05T01:27:00.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:27:00.226644984Z [2024-04-05T01:27:00.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:27:00.226797185Z [2024-04-05T01:27:00.226+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:27:00.227033417Z [2024-04-05T01:27:00.226+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:27:00.227205953Z [2024-04-05T01:27:00.227+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:27:00.944800815Z [2024-04-05T01:27:00.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:26:00+00:00 exited with status queued for try_number 1 2024-04-05T01:27:00.944876205Z [2024-04-05T01:27:00.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:26:00+00:00 exited with status queued for try_number 1 2024-04-05T01:27:00.944888537Z [2024-04-05T01:27:00.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:26:00+00:00 exited with status queued for try_number 1 2024-04-05T01:27:01.016335673Z [2024-04-05T01:27:01.015+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9bb7edab-cacc-4970-8199-4123d2182992 2024-04-05T01:27:01.016404178Z [2024-04-05T01:27:01.016+0000] {scheduler_job.py:635} INFO - Setting external_id for to e4c45b6d-b617-4dbc-bcb3-a1b4056b9528 2024-04-05T01:27:01.016528638Z [2024-04-05T01:27:01.016+0000] {scheduler_job.py:635} INFO - Setting external_id for to b0d4861c-7a06-4784-a2b9-289e31a0282c 2024-04-05T01:27:04.150557049Z [2024-04-05T01:27:04.150+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:27:04.150991650Z [2024-04-05T01:27:04.150+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:26:00+00:00, run_id=scheduled__2024-04-05T01:26:00+00:00, run_start_date=2024-04-05 01:27:00.164315+00:00, run_end_date=2024-04-05 01:27:04.150430+00:00, run_duration=3.986115, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:26:00+00:00, data_interval_end=2024-04-05 01:27:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:27:04.172187758Z [2024-04-05T01:27:04.171+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:27:00+00:00, run_after=2024-04-05T01:28:00+00:00 2024-04-05T01:27:05.665220237Z [2024-04-05T01:27:05.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:26:00+00:00 exited with status success for try_number 1 2024-04-05T01:27:05.671918716Z [2024-04-05T01:27:05.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:26:00+00:00, map_index=-1, run_start_date=2024-04-05 01:27:02.791301+00:00, run_end_date=2024-04-05 01:27:03.997559+00:00, run_duration=1.206258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=795, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:27:00.223512+00:00, queued_by_job_id=1, pid=11668 2024-04-05T01:27:07.924845678Z [2024-04-05T01:27:07.924+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:27:07.924929423Z [2024-04-05T01:27:07.924+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:26:00+00:00, run_id=scheduled__2024-04-05T01:26:00+00:00, run_start_date=2024-04-05 01:27:00.167926+00:00, run_end_date=2024-04-05 01:27:07.924660+00:00, run_duration=7.756734, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:26:00+00:00, data_interval_end=2024-04-05 01:27:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:27:07.934477171Z [2024-04-05T01:27:07.934+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:27:00+00:00, run_after=2024-04-05T01:28:00+00:00 2024-04-05T01:27:07.999811724Z [2024-04-05T01:27:07.999+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:26:00+00:00 exited with status success for try_number 1 2024-04-05T01:27:08.015292081Z [2024-04-05T01:27:08.014+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:26:00+00:00, map_index=-1, run_start_date=2024-04-05 01:27:05.366331+00:00, run_end_date=2024-04-05 01:27:07.202450+00:00, run_duration=1.836119, state=success, executor_state=success, try_number=1, max_tries=1, job_id=796, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:27:00.223512+00:00, queued_by_job_id=1, pid=11681 2024-04-05T01:27:09.075846177Z [2024-04-05T01:27:09.075+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:27:09.076444015Z [2024-04-05T01:27:09.076+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:26:00+00:00, run_id=scheduled__2024-04-05T01:26:00+00:00, run_start_date=2024-04-05 01:27:00.169150+00:00, run_end_date=2024-04-05 01:27:09.075901+00:00, run_duration=8.906751, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:26:00+00:00, data_interval_end=2024-04-05 01:27:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:27:09.086469998Z [2024-04-05T01:27:09.086+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:27:00+00:00, run_after=2024-04-05T01:28:00+00:00 2024-04-05T01:27:09.115577204Z [2024-04-05T01:27:09.115+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:26:00+00:00 exited with status success for try_number 1 2024-04-05T01:27:09.121816516Z [2024-04-05T01:27:09.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:26:00+00:00, map_index=-1, run_start_date=2024-04-05 01:27:06.643139+00:00, run_end_date=2024-04-05 01:27:08.455544+00:00, run_duration=1.812405, state=success, executor_state=success, try_number=1, max_tries=1, job_id=797, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:27:00.223512+00:00, queued_by_job_id=1, pid=11692 2024-04-05T01:28:00.110583348Z [2024-04-05T01:28:00.110+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:28:00+00:00, run_after=2024-04-05T01:29:00+00:00 2024-04-05T01:28:00.126595000Z [2024-04-05T01:28:00.126+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:28:00.152824787Z [2024-04-05T01:28:00.152+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:28:00+00:00, run_after=2024-04-05T01:29:00+00:00 2024-04-05T01:28:00.166101009Z [2024-04-05T01:28:00.165+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:28:00.277590640Z [2024-04-05T01:28:00.277+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:28:00.277614129Z 2024-04-05T01:28:00.277618104Z 2024-04-05T01:28:00.277621364Z 2024-04-05T01:28:00.277624653Z 2024-04-05T01:28:00.277635126Z [2024-04-05T01:28:00.277+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:28:00.277697725Z [2024-04-05T01:28:00.277+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:28:00.277853741Z [2024-04-05T01:28:00.277+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:28:00.277968311Z [2024-04-05T01:28:00.277+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:28:00.278532814Z [2024-04-05T01:28:00.278+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:28:00.278542867Z 2024-04-05T01:28:00.278546430Z 2024-04-05T01:28:00.278549974Z 2024-04-05T01:28:00.278553208Z 2024-04-05T01:28:00.282021987Z [2024-04-05T01:28:00.281+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:28:00.282106010Z [2024-04-05T01:28:00.281+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:28:00.282295372Z [2024-04-05T01:28:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:28:00.282374516Z [2024-04-05T01:28:00.282+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:28:00.282542091Z [2024-04-05T01:28:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:28:00.282615908Z [2024-04-05T01:28:00.282+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:28:00.282773594Z [2024-04-05T01:28:00.282+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:28:00.282846762Z [2024-04-05T01:28:00.282+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:28:00.689889976Z [2024-04-05T01:28:00.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:26:00+00:00 exited with status queued for try_number 1 2024-04-05T01:28:00.689921203Z [2024-04-05T01:28:00.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:27:00+00:00 exited with status queued for try_number 1 2024-04-05T01:28:00.689936744Z [2024-04-05T01:28:00.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:27:00+00:00 exited with status queued for try_number 1 2024-04-05T01:28:00.690014292Z [2024-04-05T01:28:00.689+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:27:00+00:00 exited with status queued for try_number 1 2024-04-05T01:28:00.704808950Z [2024-04-05T01:28:00.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5c5aa1e-3a6e-4fe6-86e1-3ede15fe59a5 2024-04-05T01:28:00.705046537Z [2024-04-05T01:28:00.704+0000] {scheduler_job.py:635} INFO - Setting external_id for to 768df3e2-c5ab-4d5f-a101-b48edce39b16 2024-04-05T01:28:00.705179826Z [2024-04-05T01:28:00.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to dad2c56d-7a78-4055-b8f0-00df7a56643e 2024-04-05T01:28:00.705330815Z [2024-04-05T01:28:00.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d6888bb-acba-4c33-94b0-abe0f6c8d6e5 2024-04-05T01:28:02.792669658Z [2024-04-05T01:28:02.792+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:28:02.794093579Z [2024-04-05T01:28:02.792+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:27:00+00:00, run_id=scheduled__2024-04-05T01:27:00+00:00, run_start_date=2024-04-05 01:28:00.180670+00:00, run_end_date=2024-04-05 01:28:02.792569+00:00, run_duration=2.611899, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:27:00+00:00, data_interval_end=2024-04-05 01:28:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:28:02.813688636Z [2024-04-05T01:28:02.813+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:28:00+00:00, run_after=2024-04-05T01:29:00+00:00 2024-04-05T01:28:02.884699230Z [2024-04-05T01:28:02.884+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:27:00+00:00 exited with status success for try_number 1 2024-04-05T01:28:02.892529387Z [2024-04-05T01:28:02.892+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:27:00+00:00, map_index=-1, run_start_date=2024-04-05 01:28:01.760807+00:00, run_end_date=2024-04-05 01:28:02.548008+00:00, run_duration=0.787201, state=success, executor_state=success, try_number=1, max_tries=1, job_id=798, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:28:00.279481+00:00, queued_by_job_id=1, pid=11720 2024-04-05T01:28:03.965424183Z [2024-04-05T01:28:03.964+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:28:03.965801957Z [2024-04-05T01:28:03.965+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:26:00+00:00, run_id=scheduled__2024-04-05T01:26:00+00:00, run_start_date=2024-04-05 01:28:00.178811+00:00, run_end_date=2024-04-05 01:28:03.965404+00:00, run_duration=3.786593, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:26:00+00:00, data_interval_end=2024-04-05 01:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:28:03.977033315Z [2024-04-05T01:28:03.976+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:28:00+00:00, run_after=2024-04-05T01:30:00+00:00 2024-04-05T01:28:04.105522073Z [2024-04-05T01:28:04.105+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:26:00+00:00 exited with status success for try_number 1 2024-04-05T01:28:04.118726755Z [2024-04-05T01:28:04.118+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:26:00+00:00, map_index=-1, run_start_date=2024-04-05 01:28:02.325253+00:00, run_end_date=2024-04-05 01:28:02.957099+00:00, run_duration=0.631846, state=success, executor_state=success, try_number=1, max_tries=1, job_id=799, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:28:00.279481+00:00, queued_by_job_id=1, pid=11721 2024-04-05T01:28:06.907478608Z [2024-04-05T01:28:06.907+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:28:06.907772051Z [2024-04-05T01:28:06.907+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:27:00+00:00, run_id=scheduled__2024-04-05T01:27:00+00:00, run_start_date=2024-04-05 01:28:00.182369+00:00, run_end_date=2024-04-05 01:28:06.907380+00:00, run_duration=6.725011, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:27:00+00:00, data_interval_end=2024-04-05 01:28:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:28:06.916345551Z [2024-04-05T01:28:06.916+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:28:00+00:00, run_after=2024-04-05T01:29:00+00:00 2024-04-05T01:28:06.924664441Z [2024-04-05T01:28:06.924+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:28:06.925125472Z [2024-04-05T01:28:06.924+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:27:00+00:00, run_id=scheduled__2024-04-05T01:27:00+00:00, run_start_date=2024-04-05 01:28:00.183871+00:00, run_end_date=2024-04-05 01:28:06.924570+00:00, run_duration=6.740699, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:27:00+00:00, data_interval_end=2024-04-05 01:28:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:28:06.941134674Z [2024-04-05T01:28:06.940+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:28:00+00:00, run_after=2024-04-05T01:29:00+00:00 2024-04-05T01:28:06.977441762Z [2024-04-05T01:28:06.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:27:00+00:00 exited with status success for try_number 1 2024-04-05T01:28:06.977724384Z [2024-04-05T01:28:06.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:27:00+00:00 exited with status success for try_number 1 2024-04-05T01:28:06.984744544Z [2024-04-05T01:28:06.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:27:00+00:00, map_index=-1, run_start_date=2024-04-05 01:28:04.063994+00:00, run_end_date=2024-04-05 01:28:05.777792+00:00, run_duration=1.713798, state=success, executor_state=success, try_number=1, max_tries=1, job_id=800, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:28:00.279481+00:00, queued_by_job_id=1, pid=11745 2024-04-05T01:28:06.984998330Z [2024-04-05T01:28:06.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:27:00+00:00, map_index=-1, run_start_date=2024-04-05 01:28:04.037050+00:00, run_end_date=2024-04-05 01:28:06.153045+00:00, run_duration=2.115995, state=success, executor_state=success, try_number=1, max_tries=1, job_id=801, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:28:00.279481+00:00, queued_by_job_id=1, pid=11744 2024-04-05T01:29:00.143833106Z [2024-04-05T01:29:00.143+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:29:00.168732998Z [2024-04-05T01:29:00.168+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:29:00+00:00, run_after=2024-04-05T01:30:00+00:00 2024-04-05T01:29:00.185689883Z [2024-04-05T01:29:00.185+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:29:00+00:00, run_after=2024-04-05T01:30:00+00:00 2024-04-05T01:29:00.292195373Z [2024-04-05T01:29:00.291+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:29:00.292224665Z 2024-04-05T01:29:00.292229604Z 2024-04-05T01:29:00.292233955Z 2024-04-05T01:29:00.292570515Z [2024-04-05T01:29:00.292+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:29:00.292839402Z [2024-04-05T01:29:00.292+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:29:00.293055258Z [2024-04-05T01:29:00.292+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:29:00.293809821Z [2024-04-05T01:29:00.293+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:29:00.293823592Z 2024-04-05T01:29:00.293828101Z 2024-04-05T01:29:00.293832672Z 2024-04-05T01:29:00.298485450Z [2024-04-05T01:29:00.298+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:29:00.298777499Z [2024-04-05T01:29:00.298+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:29:00.299306861Z [2024-04-05T01:29:00.299+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:29:00.299610340Z [2024-04-05T01:29:00.299+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:29:00.300014235Z [2024-04-05T01:29:00.299+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:29:00.300560701Z [2024-04-05T01:29:00.300+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:29:00.699632578Z [2024-04-05T01:29:00.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:28:00+00:00 exited with status queued for try_number 1 2024-04-05T01:29:00.700021322Z [2024-04-05T01:29:00.699+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:28:00+00:00 exited with status queued for try_number 1 2024-04-05T01:29:00.700391234Z [2024-04-05T01:29:00.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:28:00+00:00 exited with status queued for try_number 1 2024-04-05T01:29:00.719376672Z [2024-04-05T01:29:00.718+0000] {scheduler_job.py:635} INFO - Setting external_id for to ace5faa7-e3d7-4771-a33e-dfb5ec96dbd3 2024-04-05T01:29:00.719859657Z [2024-04-05T01:29:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to 41516847-c008-4c38-9064-bfbad53d0b3e 2024-04-05T01:29:00.720142292Z [2024-04-05T01:29:00.719+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7987a49-d094-4c29-bdc9-7c369be9ea30 2024-04-05T01:29:03.373720968Z [2024-04-05T01:29:03.373+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:29:03.374287224Z [2024-04-05T01:29:03.374+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:28:00+00:00, run_id=scheduled__2024-04-05T01:28:00+00:00, run_start_date=2024-04-05 01:29:00.203069+00:00, run_end_date=2024-04-05 01:29:03.373894+00:00, run_duration=3.170825, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:28:00+00:00, data_interval_end=2024-04-05 01:29:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:29:03.387408915Z [2024-04-05T01:29:03.387+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:29:00+00:00, run_after=2024-04-05T01:30:00+00:00 2024-04-05T01:29:03.464531588Z [2024-04-05T01:29:03.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:28:00+00:00 exited with status success for try_number 1 2024-04-05T01:29:03.470874135Z [2024-04-05T01:29:03.470+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:28:00+00:00, map_index=-1, run_start_date=2024-04-05 01:29:02.412924+00:00, run_end_date=2024-04-05 01:29:02.995717+00:00, run_duration=0.582793, state=success, executor_state=success, try_number=1, max_tries=1, job_id=802, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:29:00.294929+00:00, queued_by_job_id=1, pid=11777 2024-04-05T01:29:06.708035808Z [2024-04-05T01:29:06.707+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:29:06.708125441Z [2024-04-05T01:29:06.707+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:28:00+00:00, run_id=scheduled__2024-04-05T01:28:00+00:00, run_start_date=2024-04-05 01:29:00.205046+00:00, run_end_date=2024-04-05 01:29:06.707591+00:00, run_duration=6.502545, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:28:00+00:00, data_interval_end=2024-04-05 01:29:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:29:06.719389459Z [2024-04-05T01:29:06.718+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:29:00+00:00, run_after=2024-04-05T01:30:00+00:00 2024-04-05T01:29:06.730475590Z [2024-04-05T01:29:06.729+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:29:06.731039901Z [2024-04-05T01:29:06.730+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:28:00+00:00, run_id=scheduled__2024-04-05T01:28:00+00:00, run_start_date=2024-04-05 01:29:00.207873+00:00, run_end_date=2024-04-05 01:29:06.730373+00:00, run_duration=6.5225, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:28:00+00:00, data_interval_end=2024-04-05 01:29:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:29:06.741239651Z [2024-04-05T01:29:06.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:29:00+00:00, run_after=2024-04-05T01:30:00+00:00 2024-04-05T01:29:06.790913502Z [2024-04-05T01:29:06.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:28:00+00:00 exited with status success for try_number 1 2024-04-05T01:29:06.791244895Z [2024-04-05T01:29:06.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:28:00+00:00 exited with status success for try_number 1 2024-04-05T01:29:06.803355719Z [2024-04-05T01:29:06.802+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:28:00+00:00, map_index=-1, run_start_date=2024-04-05 01:29:04.169481+00:00, run_end_date=2024-04-05 01:29:05.774031+00:00, run_duration=1.60455, state=success, executor_state=success, try_number=1, max_tries=1, job_id=804, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:29:00.294929+00:00, queued_by_job_id=1, pid=11796 2024-04-05T01:29:06.803957689Z [2024-04-05T01:29:06.803+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:28:00+00:00, map_index=-1, run_start_date=2024-04-05 01:29:04.165165+00:00, run_end_date=2024-04-05 01:29:06.057808+00:00, run_duration=1.892643, state=success, executor_state=success, try_number=1, max_tries=1, job_id=803, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:29:00.294929+00:00, queued_by_job_id=1, pid=11795 2024-04-05T01:30:00.421896042Z [2024-04-05T01:30:00.421+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:30:00.438266495Z [2024-04-05T01:30:00.437+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:30:00+00:00, run_after=2024-04-05T01:35:00+00:00 2024-04-05T01:30:00.453143012Z [2024-04-05T01:30:00.452+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:30:00+00:00, run_after=2024-04-05T01:31:00+00:00 2024-04-05T01:30:00.469633440Z [2024-04-05T01:30:00.469+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:30:00+00:00, run_after=2024-04-05T01:31:00+00:00 2024-04-05T01:30:00.480264260Z [2024-04-05T01:30:00.479+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:30:00.622356007Z [2024-04-05T01:30:00.621+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T01:30:00.622379918Z 2024-04-05T01:30:00.622399750Z 2024-04-05T01:30:00.622404099Z 2024-04-05T01:30:00.622407490Z 2024-04-05T01:30:00.622410853Z 2024-04-05T01:30:00.622685845Z [2024-04-05T01:30:00.622+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:30:00.623025225Z [2024-04-05T01:30:00.622+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:30:00.623392964Z [2024-04-05T01:30:00.623+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:30:00.623666098Z [2024-04-05T01:30:00.623+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:30:00.623976568Z [2024-04-05T01:30:00.623+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:30:00.625050424Z [2024-04-05T01:30:00.624+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:30:00.625069536Z 2024-04-05T01:30:00.625074075Z 2024-04-05T01:30:00.625078113Z 2024-04-05T01:30:00.625081433Z 2024-04-05T01:30:00.625084846Z 2024-04-05T01:30:00.634042355Z [2024-04-05T01:30:00.633+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:30:00.635345861Z [2024-04-05T01:30:00.635+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:30:00.635713049Z [2024-04-05T01:30:00.635+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:30:00.635883879Z [2024-04-05T01:30:00.635+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:30:00.636295960Z [2024-04-05T01:30:00.636+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:30:00.636782156Z [2024-04-05T01:30:00.636+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:30:00.637822270Z [2024-04-05T01:30:00.637+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:30:00.637949705Z [2024-04-05T01:30:00.637+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:30:00.638218521Z [2024-04-05T01:30:00.638+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:30:00.638423439Z [2024-04-05T01:30:00.638+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:30:01.538033558Z [2024-04-05T01:30:01.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status queued for try_number 1 2024-04-05T01:30:01.538329394Z [2024-04-05T01:30:01.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:28:00+00:00 exited with status queued for try_number 1 2024-04-05T01:30:01.538538124Z [2024-04-05T01:30:01.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:29:00+00:00 exited with status queued for try_number 1 2024-04-05T01:30:01.538759267Z [2024-04-05T01:30:01.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:29:00+00:00 exited with status queued for try_number 1 2024-04-05T01:30:01.543974690Z [2024-04-05T01:30:01.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:29:00+00:00 exited with status queued for try_number 1 2024-04-05T01:30:01.602540464Z [2024-04-05T01:30:01.601+0000] {scheduler_job.py:635} INFO - Setting external_id for to ccfa2b79-d575-4b44-82a0-6dfaed2d9570 2024-04-05T01:30:01.607470935Z [2024-04-05T01:30:01.606+0000] {scheduler_job.py:635} INFO - Setting external_id for to a34c08c9-1043-45e1-a8db-3dfe686490ae 2024-04-05T01:30:01.607865901Z [2024-04-05T01:30:01.607+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4ee80c2b-12ef-41ca-9c8c-e3b43a077ba0 2024-04-05T01:30:01.611248543Z [2024-04-05T01:30:01.610+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09e6e79e-9fd5-4c66-ab78-b2c91e80e972 2024-04-05T01:30:01.611477346Z [2024-04-05T01:30:01.611+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33bb1f98-e5fc-4b53-a6fa-fb5e7e78f11a 2024-04-05T01:30:04.452424988Z [2024-04-05T01:30:04.451+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:30:04.453189134Z [2024-04-05T01:30:04.452+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:28:00+00:00, run_id=scheduled__2024-04-05T01:28:00+00:00, run_start_date=2024-04-05 01:30:00.506905+00:00, run_end_date=2024-04-05 01:30:04.452538+00:00, run_duration=3.945633, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:28:00+00:00, data_interval_end=2024-04-05 01:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:30:04.466349772Z [2024-04-05T01:30:04.465+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:30:00+00:00, run_after=2024-04-05T01:32:00+00:00 2024-04-05T01:30:04.483145908Z [2024-04-05T01:30:04.482+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:30:04.483662779Z [2024-04-05T01:30:04.483+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:29:00+00:00, run_id=scheduled__2024-04-05T01:29:00+00:00, run_start_date=2024-04-05 01:30:00.509942+00:00, run_end_date=2024-04-05 01:30:04.483034+00:00, run_duration=3.973092, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:29:00+00:00, data_interval_end=2024-04-05 01:30:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:30:04.520982521Z [2024-04-05T01:30:04.520+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:30:00+00:00, run_after=2024-04-05T01:31:00+00:00 2024-04-05T01:30:04.628911680Z [2024-04-05T01:30:04.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:28:00+00:00 exited with status success for try_number 1 2024-04-05T01:30:04.631996688Z [2024-04-05T01:30:04.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:29:00+00:00 exited with status success for try_number 1 2024-04-05T01:30:04.643960583Z [2024-04-05T01:30:04.643+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:28:00+00:00, map_index=-1, run_start_date=2024-04-05 01:30:02.958859+00:00, run_end_date=2024-04-05 01:30:03.696547+00:00, run_duration=0.737688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=805, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:30:00.626978+00:00, queued_by_job_id=1, pid=11831 2024-04-05T01:30:04.644367444Z [2024-04-05T01:30:04.644+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:29:00+00:00, map_index=-1, run_start_date=2024-04-05 01:30:03.228883+00:00, run_end_date=2024-04-05 01:30:03.902984+00:00, run_duration=0.674101, state=success, executor_state=success, try_number=1, max_tries=1, job_id=806, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:30:00.626978+00:00, queued_by_job_id=1, pid=11833 2024-04-05T01:30:05.749524171Z [2024-04-05T01:30:05.749+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:30:05.749557375Z 2024-04-05T01:30:05.749769667Z [2024-04-05T01:30:05.749+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:30:05.750550748Z [2024-04-05T01:30:05.750+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:30:05.750571148Z 2024-04-05T01:30:05.757470348Z [2024-04-05T01:30:05.757+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:30:05.757617482Z [2024-04-05T01:30:05.757+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:30:05.854610578Z [2024-04-05T01:30:05.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status queued for try_number 1 2024-04-05T01:30:05.855012903Z [2024-04-05T01:30:05.854+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status success for try_number 1 2024-04-05T01:30:05.863598603Z [2024-04-05T01:30:05.863+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9144dcab-2880-474a-b3bb-5dafefd85f3d 2024-04-05T01:30:05.864224220Z [2024-04-05T01:30:05.863+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:25:00+00:00, map_index=-1, run_start_date=2024-04-05 01:30:05.213357+00:00, run_end_date=2024-04-05 01:30:05.628978+00:00, run_duration=0.415621, state=success, executor_state=success, try_number=1, max_tries=1, job_id=809, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:30:00.626978+00:00, queued_by_job_id=1, pid=11872 2024-04-05T01:30:07.105176031Z [2024-04-05T01:30:07.103+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:30:07.105944516Z [2024-04-05T01:30:07.105+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:29:00+00:00, run_id=scheduled__2024-04-05T01:29:00+00:00, run_start_date=2024-04-05 01:30:00.512192+00:00, run_end_date=2024-04-05 01:30:07.105105+00:00, run_duration=6.592913, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:29:00+00:00, data_interval_end=2024-04-05 01:30:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:30:07.132731354Z [2024-04-05T01:30:07.132+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:30:00+00:00, run_after=2024-04-05T01:31:00+00:00 2024-04-05T01:30:07.148587933Z [2024-04-05T01:30:07.147+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:30:07.149104708Z [2024-04-05T01:30:07.148+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:29:00+00:00, run_id=scheduled__2024-04-05T01:29:00+00:00, run_start_date=2024-04-05 01:30:00.513803+00:00, run_end_date=2024-04-05 01:30:07.148483+00:00, run_duration=6.63468, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:29:00+00:00, data_interval_end=2024-04-05 01:30:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:30:07.180632061Z [2024-04-05T01:30:07.180+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:30:00+00:00, run_after=2024-04-05T01:31:00+00:00 2024-04-05T01:30:07.304493754Z [2024-04-05T01:30:07.303+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:29:00+00:00 exited with status success for try_number 1 2024-04-05T01:30:07.304697782Z [2024-04-05T01:30:07.304+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:29:00+00:00 exited with status success for try_number 1 2024-04-05T01:30:07.315431927Z [2024-04-05T01:30:07.314+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:29:00+00:00, map_index=-1, run_start_date=2024-04-05 01:30:04.270755+00:00, run_end_date=2024-04-05 01:30:05.938898+00:00, run_duration=1.668143, state=success, executor_state=success, try_number=1, max_tries=1, job_id=807, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:30:00.626978+00:00, queued_by_job_id=1, pid=11855 2024-04-05T01:30:07.315977175Z [2024-04-05T01:30:07.315+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:29:00+00:00, map_index=-1, run_start_date=2024-04-05 01:30:04.416747+00:00, run_end_date=2024-04-05 01:30:06.458598+00:00, run_duration=2.041851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=808, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:30:00.626978+00:00, queued_by_job_id=1, pid=11856 2024-04-05T01:30:08.447055000Z [2024-04-05T01:30:08.446+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:30:08.447083196Z 2024-04-05T01:30:08.447266559Z [2024-04-05T01:30:08.447+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:30:08.448193817Z [2024-04-05T01:30:08.447+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:30:08.448209612Z 2024-04-05T01:30:08.452355429Z [2024-04-05T01:30:08.451+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:30:08.452511596Z [2024-04-05T01:30:08.452+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:30:08.533462014Z [2024-04-05T01:30:08.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status queued for try_number 1 2024-04-05T01:30:08.533600480Z [2024-04-05T01:30:08.533+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status success for try_number 1 2024-04-05T01:30:08.540514000Z [2024-04-05T01:30:08.540+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea3e2453-9447-483b-9608-88ca0f8bb830 2024-04-05T01:30:08.540751344Z [2024-04-05T01:30:08.540+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T01:25:00+00:00, map_index=-1, run_start_date=2024-04-05 01:30:07.926654+00:00, run_end_date=2024-04-05 01:30:08.334309+00:00, run_duration=0.407655, state=success, executor_state=success, try_number=1, max_tries=1, job_id=810, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:30:05.751262+00:00, queued_by_job_id=1, pid=11885 2024-04-05T01:30:10.824685831Z [2024-04-05T01:30:10.824+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:30:10.824724212Z 2024-04-05T01:30:10.825113875Z [2024-04-05T01:30:10.824+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:30:10.826267636Z [2024-04-05T01:30:10.825+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:30:10.826288231Z 2024-04-05T01:30:10.830740408Z [2024-04-05T01:30:10.830+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:30:10.831014577Z [2024-04-05T01:30:10.830+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:30:10.920789868Z [2024-04-05T01:30:10.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status queued for try_number 1 2024-04-05T01:30:10.921075990Z [2024-04-05T01:30:10.920+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status success for try_number 1 2024-04-05T01:30:10.929397658Z [2024-04-05T01:30:10.929+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6625158b-27e3-465e-876e-8239786fcdff 2024-04-05T01:30:10.929685521Z [2024-04-05T01:30:10.929+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:25:00+00:00, map_index=0, run_start_date=2024-04-05 01:30:10.338312+00:00, run_end_date=2024-04-05 01:30:10.644622+00:00, run_duration=0.30631, state=success, executor_state=success, try_number=1, max_tries=1, job_id=811, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:30:08.449364+00:00, queued_by_job_id=1, pid=11903 2024-04-05T01:30:13.621959943Z [2024-04-05T01:30:13.621+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:30:13.622185739Z [2024-04-05T01:30:13.621+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:25:00+00:00, run_id=scheduled__2024-04-05T01:25:00+00:00, run_start_date=2024-04-05 01:30:00.493912+00:00, run_end_date=2024-04-05 01:30:13.621773+00:00, run_duration=13.127861, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:25:00+00:00, data_interval_end=2024-04-05 01:30:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T01:30:13.630358518Z [2024-04-05T01:30:13.629+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:30:00+00:00, run_after=2024-04-05T01:35:00+00:00 2024-04-05T01:30:13.664869287Z [2024-04-05T01:30:13.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:25:00+00:00 exited with status success for try_number 1 2024-04-05T01:30:13.672395000Z [2024-04-05T01:30:13.671+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:25:00+00:00, map_index=-1, run_start_date=2024-04-05 01:30:12.783627+00:00, run_end_date=2024-04-05 01:30:13.182602+00:00, run_duration=0.398975, state=success, executor_state=success, try_number=1, max_tries=1, job_id=812, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:30:10.827014+00:00, queued_by_job_id=1, pid=11914 2024-04-05T01:30:41.300068361Z [2024-04-05T01:30:41.299+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T01:31:00.652595402Z [2024-04-05T01:31:00.652+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:31:00.673316628Z [2024-04-05T01:31:00.672+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:31:00+00:00, run_after=2024-04-05T01:32:00+00:00 2024-04-05T01:31:00.688291162Z [2024-04-05T01:31:00.687+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:31:00+00:00, run_after=2024-04-05T01:32:00+00:00 2024-04-05T01:31:00.786964327Z [2024-04-05T01:31:00.786+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:31:00.786991877Z 2024-04-05T01:31:00.786995825Z 2024-04-05T01:31:00.786999212Z 2024-04-05T01:31:00.787289608Z [2024-04-05T01:31:00.787+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:31:00.787516784Z [2024-04-05T01:31:00.787+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:31:00.787746774Z [2024-04-05T01:31:00.787+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:31:00.788502597Z [2024-04-05T01:31:00.788+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:31:00.788519010Z 2024-04-05T01:31:00.788522833Z 2024-04-05T01:31:00.788526110Z 2024-04-05T01:31:00.792177710Z [2024-04-05T01:31:00.791+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:31:00.792504368Z [2024-04-05T01:31:00.792+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:31:00.792904540Z [2024-04-05T01:31:00.792+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:31:00.793137656Z [2024-04-05T01:31:00.792+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:31:00.793450199Z [2024-04-05T01:31:00.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:31:00.793793060Z [2024-04-05T01:31:00.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:31:01.456203517Z [2024-04-05T01:31:01.455+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status queued for try_number 1 2024-04-05T01:31:01.456374547Z [2024-04-05T01:31:01.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status queued for try_number 1 2024-04-05T01:31:01.456591422Z [2024-04-05T01:31:01.456+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status queued for try_number 1 2024-04-05T01:31:01.484041343Z [2024-04-05T01:31:01.483+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae625c76-c4bc-4996-8060-8deaf67ce570 2024-04-05T01:31:01.484277890Z [2024-04-05T01:31:01.484+0000] {scheduler_job.py:635} INFO - Setting external_id for to 884f5484-1fdf-47cb-9107-caadf6dae456 2024-04-05T01:31:01.484695112Z [2024-04-05T01:31:01.484+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d794dca-e9ad-419e-bb84-316d62204267 2024-04-05T01:31:02.767690566Z [2024-04-05T01:31:02.767+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:31:02.768370344Z [2024-04-05T01:31:02.767+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:30:00+00:00, run_id=scheduled__2024-04-05T01:30:00+00:00, run_start_date=2024-04-05 01:31:00.701243+00:00, run_end_date=2024-04-05 01:31:02.767688+00:00, run_duration=2.066445, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:30:00+00:00, data_interval_end=2024-04-05 01:31:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:31:02.789841298Z [2024-04-05T01:31:02.789+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:31:00+00:00, run_after=2024-04-05T01:32:00+00:00 2024-04-05T01:31:02.863706142Z [2024-04-05T01:31:02.863+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status success for try_number 1 2024-04-05T01:31:02.872701009Z [2024-04-05T01:31:02.872+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:30:00+00:00, map_index=-1, run_start_date=2024-04-05 01:31:02.096081+00:00, run_end_date=2024-04-05 01:31:02.559427+00:00, run_duration=0.463346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=813, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:31:00.789395+00:00, queued_by_job_id=1, pid=11923 2024-04-05T01:31:06.566676581Z [2024-04-05T01:31:06.566+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:31:06.567102630Z [2024-04-05T01:31:06.566+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:30:00+00:00, run_id=scheduled__2024-04-05T01:30:00+00:00, run_start_date=2024-04-05 01:31:00.703169+00:00, run_end_date=2024-04-05 01:31:06.566553+00:00, run_duration=5.863384, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:30:00+00:00, data_interval_end=2024-04-05 01:31:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:31:06.576998663Z [2024-04-05T01:31:06.576+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:31:00+00:00, run_after=2024-04-05T01:32:00+00:00 2024-04-05T01:31:06.584498937Z [2024-04-05T01:31:06.584+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:31:06.585009422Z [2024-04-05T01:31:06.584+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:30:00+00:00, run_id=scheduled__2024-04-05T01:30:00+00:00, run_start_date=2024-04-05 01:31:00.705424+00:00, run_end_date=2024-04-05 01:31:06.584372+00:00, run_duration=5.878948, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:30:00+00:00, data_interval_end=2024-04-05 01:31:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:31:06.595166239Z [2024-04-05T01:31:06.594+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:31:00+00:00, run_after=2024-04-05T01:32:00+00:00 2024-04-05T01:31:06.641949960Z [2024-04-05T01:31:06.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status success for try_number 1 2024-04-05T01:31:06.644022335Z [2024-04-05T01:31:06.641+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status success for try_number 1 2024-04-05T01:31:06.656375769Z [2024-04-05T01:31:06.655+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:30:00+00:00, map_index=-1, run_start_date=2024-04-05 01:31:03.420865+00:00, run_end_date=2024-04-05 01:31:05.944323+00:00, run_duration=2.523458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=814, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:31:00.789395+00:00, queued_by_job_id=1, pid=11942 2024-04-05T01:31:06.656915257Z [2024-04-05T01:31:06.656+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:30:00+00:00, map_index=-1, run_start_date=2024-04-05 01:31:03.432023+00:00, run_end_date=2024-04-05 01:31:05.522579+00:00, run_duration=2.090556, state=success, executor_state=success, try_number=1, max_tries=1, job_id=815, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:31:00.789395+00:00, queued_by_job_id=1, pid=11941 2024-04-05T01:32:00.152548705Z [2024-04-05T01:32:00.152+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:32:00.178508304Z [2024-04-05T01:32:00.178+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:32:00+00:00, run_after=2024-04-05T01:33:00+00:00 2024-04-05T01:32:00.188409494Z [2024-04-05T01:32:00.188+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:32:00.222856534Z [2024-04-05T01:32:00.222+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:32:00+00:00, run_after=2024-04-05T01:33:00+00:00 2024-04-05T01:32:00.302218201Z [2024-04-05T01:32:00.301+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:32:00.302245040Z 2024-04-05T01:32:00.302249555Z 2024-04-05T01:32:00.302266583Z 2024-04-05T01:32:00.302270272Z 2024-04-05T01:32:00.302285549Z [2024-04-05T01:32:00.302+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:32:00.302383123Z [2024-04-05T01:32:00.302+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:32:00.302449561Z [2024-04-05T01:32:00.302+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:32:00.302543234Z [2024-04-05T01:32:00.302+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:32:00.303120011Z [2024-04-05T01:32:00.302+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:32:00.303130613Z 2024-04-05T01:32:00.303134092Z 2024-04-05T01:32:00.303137568Z 2024-04-05T01:32:00.303140837Z 2024-04-05T01:32:00.312104628Z [2024-04-05T01:32:00.311+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:32:00.312205352Z [2024-04-05T01:32:00.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:32:00.312709875Z [2024-04-05T01:32:00.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:32:00.312966017Z [2024-04-05T01:32:00.312+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:32:00.313096457Z [2024-04-05T01:32:00.312+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:32:00.313177607Z [2024-04-05T01:32:00.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:32:00.313347415Z [2024-04-05T01:32:00.313+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:32:00.313410954Z [2024-04-05T01:32:00.313+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:32:00.975584974Z [2024-04-05T01:32:00.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status queued for try_number 1 2024-04-05T01:32:00.975769367Z [2024-04-05T01:32:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:31:00+00:00 exited with status queued for try_number 1 2024-04-05T01:32:00.975961100Z [2024-04-05T01:32:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:31:00+00:00 exited with status queued for try_number 1 2024-04-05T01:32:00.975994763Z [2024-04-05T01:32:00.975+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:31:00+00:00 exited with status queued for try_number 1 2024-04-05T01:32:01.010507121Z [2024-04-05T01:32:01.010+0000] {scheduler_job.py:635} INFO - Setting external_id for to f47eaa44-a214-45c4-9421-14485e78a7bf 2024-04-05T01:32:01.010540844Z [2024-04-05T01:32:01.010+0000] {scheduler_job.py:635} INFO - Setting external_id for to e2d5ed02-bac7-484a-a56f-f18edcad03fd 2024-04-05T01:32:01.018713245Z [2024-04-05T01:32:01.018+0000] {scheduler_job.py:635} INFO - Setting external_id for to 77127165-4114-4a41-a2c6-d6500d6550b8 2024-04-05T01:32:01.018803235Z [2024-04-05T01:32:01.018+0000] {scheduler_job.py:635} INFO - Setting external_id for to 17e35fa7-db3b-47cd-99e0-b7df1328de6b 2024-04-05T01:32:03.857812471Z [2024-04-05T01:32:03.857+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:32:03.858070952Z [2024-04-05T01:32:03.857+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:30:00+00:00, run_id=scheduled__2024-04-05T01:30:00+00:00, run_start_date=2024-04-05 01:32:00.234904+00:00, run_end_date=2024-04-05 01:32:03.857695+00:00, run_duration=3.622791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:30:00+00:00, data_interval_end=2024-04-05 01:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:32:03.872270826Z [2024-04-05T01:32:03.871+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:32:00+00:00, run_after=2024-04-05T01:34:00+00:00 2024-04-05T01:32:03.882012744Z [2024-04-05T01:32:03.881+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:32:03.882179525Z [2024-04-05T01:32:03.881+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:31:00+00:00, run_id=scheduled__2024-04-05T01:31:00+00:00, run_start_date=2024-04-05 01:32:00.236336+00:00, run_end_date=2024-04-05 01:32:03.881886+00:00, run_duration=3.64555, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:31:00+00:00, data_interval_end=2024-04-05 01:32:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:32:03.899702712Z [2024-04-05T01:32:03.899+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:32:00+00:00, run_after=2024-04-05T01:33:00+00:00 2024-04-05T01:32:04.025848422Z [2024-04-05T01:32:04.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status success for try_number 1 2024-04-05T01:32:04.026951526Z [2024-04-05T01:32:04.026+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:31:00+00:00 exited with status success for try_number 1 2024-04-05T01:32:04.044800931Z [2024-04-05T01:32:04.043+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:30:00+00:00, map_index=-1, run_start_date=2024-04-05 01:32:01.988820+00:00, run_end_date=2024-04-05 01:32:02.793037+00:00, run_duration=0.804217, state=success, executor_state=success, try_number=1, max_tries=1, job_id=816, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:32:00.304619+00:00, queued_by_job_id=1, pid=11970 2024-04-05T01:32:04.045450924Z [2024-04-05T01:32:04.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:31:00+00:00, map_index=-1, run_start_date=2024-04-05 01:32:03.187726+00:00, run_end_date=2024-04-05 01:32:03.693272+00:00, run_duration=0.505546, state=success, executor_state=success, try_number=1, max_tries=1, job_id=817, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:32:00.304619+00:00, queued_by_job_id=1, pid=11981 2024-04-05T01:32:08.378916765Z [2024-04-05T01:32:08.378+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:32:08.379174953Z [2024-04-05T01:32:08.378+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:31:00+00:00, run_id=scheduled__2024-04-05T01:31:00+00:00, run_start_date=2024-04-05 01:32:00.237441+00:00, run_end_date=2024-04-05 01:32:08.378745+00:00, run_duration=8.141304, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:31:00+00:00, data_interval_end=2024-04-05 01:32:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:32:08.391648881Z [2024-04-05T01:32:08.391+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:32:00+00:00, run_after=2024-04-05T01:33:00+00:00 2024-04-05T01:32:08.398280911Z [2024-04-05T01:32:08.397+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:32:08.398572874Z [2024-04-05T01:32:08.398+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:31:00+00:00, run_id=scheduled__2024-04-05T01:31:00+00:00, run_start_date=2024-04-05 01:32:00.238423+00:00, run_end_date=2024-04-05 01:32:08.398090+00:00, run_duration=8.159667, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:31:00+00:00, data_interval_end=2024-04-05 01:32:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:32:08.408552028Z [2024-04-05T01:32:08.408+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:32:00+00:00, run_after=2024-04-05T01:33:00+00:00 2024-04-05T01:32:08.451357656Z [2024-04-05T01:32:08.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:31:00+00:00 exited with status success for try_number 1 2024-04-05T01:32:08.451414658Z [2024-04-05T01:32:08.451+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:31:00+00:00 exited with status success for try_number 1 2024-04-05T01:32:08.457635016Z [2024-04-05T01:32:08.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:31:00+00:00, map_index=-1, run_start_date=2024-04-05 01:32:04.576539+00:00, run_end_date=2024-04-05 01:32:08.220341+00:00, run_duration=3.643802, state=success, executor_state=success, try_number=1, max_tries=1, job_id=818, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:32:00.304619+00:00, queued_by_job_id=1, pid=11999 2024-04-05T01:32:08.457773204Z [2024-04-05T01:32:08.457+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:31:00+00:00, map_index=-1, run_start_date=2024-04-05 01:32:04.794127+00:00, run_end_date=2024-04-05 01:32:07.761074+00:00, run_duration=2.966947, state=success, executor_state=success, try_number=1, max_tries=1, job_id=819, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:32:00.304619+00:00, queued_by_job_id=1, pid=12000 2024-04-05T01:33:00.092351546Z [2024-04-05T01:33:00.092+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:33:00.110862552Z [2024-04-05T01:33:00.110+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:33:00+00:00, run_after=2024-04-05T01:34:00+00:00 2024-04-05T01:33:00.128682902Z [2024-04-05T01:33:00.128+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:33:00+00:00, run_after=2024-04-05T01:34:00+00:00 2024-04-05T01:33:00.208445310Z [2024-04-05T01:33:00.208+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:33:00.208497646Z 2024-04-05T01:33:00.208503718Z 2024-04-05T01:33:00.208507990Z 2024-04-05T01:33:00.208537757Z [2024-04-05T01:33:00.208+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:33:00.208809161Z [2024-04-05T01:33:00.208+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:33:00.208962408Z [2024-04-05T01:33:00.208+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:33:00.209875668Z [2024-04-05T01:33:00.209+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:33:00.209890986Z 2024-04-05T01:33:00.209895815Z 2024-04-05T01:33:00.209900289Z 2024-04-05T01:33:00.213670886Z [2024-04-05T01:33:00.213+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:33:00.214032154Z [2024-04-05T01:33:00.213+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:33:00.214383986Z [2024-04-05T01:33:00.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:33:00.214522359Z [2024-04-05T01:33:00.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:33:00.214780188Z [2024-04-05T01:33:00.214+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:33:00.214950708Z [2024-04-05T01:33:00.214+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:33:00.760772131Z [2024-04-05T01:33:00.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:32:00+00:00 exited with status queued for try_number 1 2024-04-05T01:33:00.760987449Z [2024-04-05T01:33:00.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:32:00+00:00 exited with status queued for try_number 1 2024-04-05T01:33:00.761110294Z [2024-04-05T01:33:00.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:32:00+00:00 exited with status queued for try_number 1 2024-04-05T01:33:00.776787661Z [2024-04-05T01:33:00.776+0000] {scheduler_job.py:635} INFO - Setting external_id for to f03a58df-a29c-4866-9f94-4114193f9143 2024-04-05T01:33:00.780063570Z [2024-04-05T01:33:00.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to f7fc5f9f-4848-434f-8f12-292448825555 2024-04-05T01:33:00.780289709Z [2024-04-05T01:33:00.780+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9d87cb8-a36d-4815-a16a-9d428188e03a 2024-04-05T01:33:03.179277239Z [2024-04-05T01:33:03.178+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:33:03.179689719Z [2024-04-05T01:33:03.179+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:32:00+00:00, run_id=scheduled__2024-04-05T01:32:00+00:00, run_start_date=2024-04-05 01:33:00.144699+00:00, run_end_date=2024-04-05 01:33:03.179164+00:00, run_duration=3.034465, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:32:00+00:00, data_interval_end=2024-04-05 01:33:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:33:03.196898787Z [2024-04-05T01:33:03.196+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:33:00+00:00, run_after=2024-04-05T01:34:00+00:00 2024-04-05T01:33:03.271874411Z [2024-04-05T01:33:03.271+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:32:00+00:00 exited with status success for try_number 1 2024-04-05T01:33:03.277952205Z [2024-04-05T01:33:03.277+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:32:00+00:00, map_index=-1, run_start_date=2024-04-05 01:33:01.557997+00:00, run_end_date=2024-04-05 01:33:02.184395+00:00, run_duration=0.626398, state=success, executor_state=success, try_number=1, max_tries=1, job_id=820, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:33:00.210606+00:00, queued_by_job_id=1, pid=12032 2024-04-05T01:33:04.324016464Z [2024-04-05T01:33:04.323+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:33:04.324167940Z [2024-04-05T01:33:04.323+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:32:00+00:00, run_id=scheduled__2024-04-05T01:32:00+00:00, run_start_date=2024-04-05 01:33:00.145984+00:00, run_end_date=2024-04-05 01:33:04.323894+00:00, run_duration=4.17791, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:32:00+00:00, data_interval_end=2024-04-05 01:33:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:33:04.336533680Z [2024-04-05T01:33:04.336+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:33:00+00:00, run_after=2024-04-05T01:34:00+00:00 2024-04-05T01:33:05.436607180Z [2024-04-05T01:33:05.436+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:33:05.437068445Z [2024-04-05T01:33:05.436+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:32:00+00:00, run_id=scheduled__2024-04-05T01:32:00+00:00, run_start_date=2024-04-05 01:33:00.147169+00:00, run_end_date=2024-04-05 01:33:05.436488+00:00, run_duration=5.289319, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:32:00+00:00, data_interval_end=2024-04-05 01:33:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:33:05.447077355Z [2024-04-05T01:33:05.446+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:33:00+00:00, run_after=2024-04-05T01:34:00+00:00 2024-04-05T01:33:05.494425627Z [2024-04-05T01:33:05.493+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:32:00+00:00 exited with status success for try_number 1 2024-04-05T01:33:05.494594530Z [2024-04-05T01:33:05.494+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:32:00+00:00 exited with status success for try_number 1 2024-04-05T01:33:05.504655005Z [2024-04-05T01:33:05.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:32:00+00:00, map_index=-1, run_start_date=2024-04-05 01:33:02.781823+00:00, run_end_date=2024-04-05 01:33:04.291245+00:00, run_duration=1.509422, state=success, executor_state=success, try_number=1, max_tries=1, job_id=821, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:33:00.210606+00:00, queued_by_job_id=1, pid=12045 2024-04-05T01:33:05.505091986Z [2024-04-05T01:33:05.504+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:32:00+00:00, map_index=-1, run_start_date=2024-04-05 01:33:03.321116+00:00, run_end_date=2024-04-05 01:33:05.208094+00:00, run_duration=1.886978, state=success, executor_state=success, try_number=1, max_tries=1, job_id=822, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:33:00.210606+00:00, queued_by_job_id=1, pid=12056 2024-04-05T01:34:01.026171139Z [2024-04-05T01:34:01.025+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:34:00+00:00, run_after=2024-04-05T01:35:00+00:00 2024-04-05T01:34:01.034306421Z [2024-04-05T01:34:01.033+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:34:01.049305192Z [2024-04-05T01:34:01.048+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:34:00+00:00, run_after=2024-04-05T01:35:00+00:00 2024-04-05T01:34:01.068376040Z [2024-04-05T01:34:01.068+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:34:01.190527319Z [2024-04-05T01:34:01.187+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:34:01.190618257Z 2024-04-05T01:34:01.190628658Z 2024-04-05T01:34:01.190633859Z 2024-04-05T01:34:01.190638684Z 2024-04-05T01:34:01.190644296Z [2024-04-05T01:34:01.188+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:34:01.190649274Z [2024-04-05T01:34:01.189+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:34:01.190654179Z [2024-04-05T01:34:01.189+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:34:01.190659071Z [2024-04-05T01:34:01.189+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:34:01.191067293Z [2024-04-05T01:34:01.190+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:34:01.191082034Z 2024-04-05T01:34:01.191099659Z 2024-04-05T01:34:01.191105911Z 2024-04-05T01:34:01.191111367Z 2024-04-05T01:34:01.201242650Z [2024-04-05T01:34:01.199+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:34:01.201274576Z [2024-04-05T01:34:01.200+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:34:01.201617434Z [2024-04-05T01:34:01.201+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:34:01.201921180Z [2024-04-05T01:34:01.201+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:34:01.202452789Z [2024-04-05T01:34:01.202+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:34:01.202891193Z [2024-04-05T01:34:01.202+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:34:01.203445627Z [2024-04-05T01:34:01.203+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:34:01.204023311Z [2024-04-05T01:34:01.203+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:34:01.929174471Z [2024-04-05T01:34:01.928+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:32:00+00:00 exited with status queued for try_number 1 2024-04-05T01:34:01.929341525Z [2024-04-05T01:34:01.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:33:00+00:00 exited with status queued for try_number 1 2024-04-05T01:34:01.929495169Z [2024-04-05T01:34:01.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:33:00+00:00 exited with status queued for try_number 1 2024-04-05T01:34:01.929637679Z [2024-04-05T01:34:01.929+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:33:00+00:00 exited with status queued for try_number 1 2024-04-05T01:34:01.949411343Z [2024-04-05T01:34:01.948+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8fd75675-5b7e-412d-86e2-9ede8b2e815d 2024-04-05T01:34:01.949673853Z [2024-04-05T01:34:01.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4788bfea-6990-4d01-8fa6-768c59aefd12 2024-04-05T01:34:01.949980932Z [2024-04-05T01:34:01.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52a78e6b-9d8b-42ae-bf72-9eec12c30876 2024-04-05T01:34:01.950264432Z [2024-04-05T01:34:01.950+0000] {scheduler_job.py:635} INFO - Setting external_id for to 33c3bda6-f7e6-4723-826e-9d633f422ae8 2024-04-05T01:34:02.991742550Z [2024-04-05T01:34:02.991+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:34:02.991977495Z [2024-04-05T01:34:02.991+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:33:00+00:00, run_id=scheduled__2024-04-05T01:33:00+00:00, run_start_date=2024-04-05 01:34:01.087808+00:00, run_end_date=2024-04-05 01:34:02.991662+00:00, run_duration=1.903854, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:33:00+00:00, data_interval_end=2024-04-05 01:34:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:34:03.008213999Z [2024-04-05T01:34:03.007+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:34:00+00:00, run_after=2024-04-05T01:35:00+00:00 2024-04-05T01:34:03.058997979Z [2024-04-05T01:34:03.058+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:33:00+00:00 exited with status success for try_number 1 2024-04-05T01:34:03.064501680Z [2024-04-05T01:34:03.064+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:33:00+00:00, map_index=-1, run_start_date=2024-04-05 01:34:02.325392+00:00, run_end_date=2024-04-05 01:34:02.829690+00:00, run_duration=0.504298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=823, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:34:01.193974+00:00, queued_by_job_id=1, pid=12083 2024-04-05T01:34:04.155097511Z [2024-04-05T01:34:04.154+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:34:04.155261075Z [2024-04-05T01:34:04.155+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:32:00+00:00, run_id=scheduled__2024-04-05T01:32:00+00:00, run_start_date=2024-04-05 01:34:01.085970+00:00, run_end_date=2024-04-05 01:34:04.154979+00:00, run_duration=3.069009, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:32:00+00:00, data_interval_end=2024-04-05 01:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:34:04.163708641Z [2024-04-05T01:34:04.163+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:34:00+00:00, run_after=2024-04-05T01:36:00+00:00 2024-04-05T01:34:04.211433443Z [2024-04-05T01:34:04.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:32:00+00:00 exited with status success for try_number 1 2024-04-05T01:34:04.216926200Z [2024-04-05T01:34:04.216+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:32:00+00:00, map_index=-1, run_start_date=2024-04-05 01:34:02.581712+00:00, run_end_date=2024-04-05 01:34:03.012118+00:00, run_duration=0.430406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=824, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:34:01.193974+00:00, queued_by_job_id=1, pid=12084 2024-04-05T01:34:05.889799526Z [2024-04-05T01:34:05.889+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:34:05.890220839Z [2024-04-05T01:34:05.889+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:33:00+00:00, run_id=scheduled__2024-04-05T01:33:00+00:00, run_start_date=2024-04-05 01:34:01.089109+00:00, run_end_date=2024-04-05 01:34:05.889690+00:00, run_duration=4.800581, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:33:00+00:00, data_interval_end=2024-04-05 01:34:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:34:05.903228856Z [2024-04-05T01:34:05.902+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:34:00+00:00, run_after=2024-04-05T01:35:00+00:00 2024-04-05T01:34:05.917668940Z [2024-04-05T01:34:05.917+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:34:05.918728702Z [2024-04-05T01:34:05.918+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:33:00+00:00, run_id=scheduled__2024-04-05T01:33:00+00:00, run_start_date=2024-04-05 01:34:01.090226+00:00, run_end_date=2024-04-05 01:34:05.917501+00:00, run_duration=4.827275, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:33:00+00:00, data_interval_end=2024-04-05 01:34:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:34:05.931543211Z [2024-04-05T01:34:05.931+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:34:00+00:00, run_after=2024-04-05T01:35:00+00:00 2024-04-05T01:34:05.971294581Z [2024-04-05T01:34:05.970+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:33:00+00:00 exited with status success for try_number 1 2024-04-05T01:34:05.971459468Z [2024-04-05T01:34:05.971+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:33:00+00:00 exited with status success for try_number 1 2024-04-05T01:34:05.980295148Z [2024-04-05T01:34:05.979+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:33:00+00:00, map_index=-1, run_start_date=2024-04-05 01:34:03.925321+00:00, run_end_date=2024-04-05 01:34:05.618778+00:00, run_duration=1.693457, state=success, executor_state=success, try_number=1, max_tries=1, job_id=826, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:34:01.193974+00:00, queued_by_job_id=1, pid=12108 2024-04-05T01:34:05.980499589Z [2024-04-05T01:34:05.980+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:33:00+00:00, map_index=-1, run_start_date=2024-04-05 01:34:03.689012+00:00, run_end_date=2024-04-05 01:34:05.770884+00:00, run_duration=2.081872, state=success, executor_state=success, try_number=1, max_tries=1, job_id=825, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:34:01.193974+00:00, queued_by_job_id=1, pid=12102 2024-04-05T01:35:00.039653473Z [2024-04-05T01:35:00.039+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:35:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:35:00.049619200Z [2024-04-05T01:35:00.049+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:35:00.064565643Z [2024-04-05T01:35:00.064+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:35:00+00:00, run_after=2024-04-05T01:36:00+00:00 2024-04-05T01:35:00.078186521Z [2024-04-05T01:35:00.077+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:35:00+00:00, run_after=2024-04-05T01:36:00+00:00 2024-04-05T01:35:00.173204080Z [2024-04-05T01:35:00.172+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:35:00.173231535Z 2024-04-05T01:35:00.173236933Z 2024-04-05T01:35:00.173241874Z 2024-04-05T01:35:00.173246059Z 2024-04-05T01:35:00.173485085Z [2024-04-05T01:35:00.173+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:35:00.174592080Z [2024-04-05T01:35:00.173+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:35:00.174910170Z [2024-04-05T01:35:00.174+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:35:00.175174786Z [2024-04-05T01:35:00.174+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:35:00.176135459Z [2024-04-05T01:35:00.175+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:35:00.176147557Z 2024-04-05T01:35:00.176151181Z 2024-04-05T01:35:00.176154773Z 2024-04-05T01:35:00.176157990Z 2024-04-05T01:35:00.181988632Z [2024-04-05T01:35:00.181+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:35:00.182247314Z [2024-04-05T01:35:00.181+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:35:00.182797874Z [2024-04-05T01:35:00.182+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:35:00.183017452Z [2024-04-05T01:35:00.182+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:35:00.183357606Z [2024-04-05T01:35:00.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:35:00.183570663Z [2024-04-05T01:35:00.183+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:35:00.183904367Z [2024-04-05T01:35:00.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:35:00.184205545Z [2024-04-05T01:35:00.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:35:00.932753438Z [2024-04-05T01:35:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status queued for try_number 1 2024-04-05T01:35:00.932998052Z [2024-04-05T01:35:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status queued for try_number 1 2024-04-05T01:35:00.933034403Z [2024-04-05T01:35:00.932+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status queued for try_number 1 2024-04-05T01:35:00.933156163Z [2024-04-05T01:35:00.933+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status queued for try_number 1 2024-04-05T01:35:00.971176038Z [2024-04-05T01:35:00.970+0000] {scheduler_job.py:635} INFO - Setting external_id for to 78e1919f-60c7-45a3-8e45-57933223c18b 2024-04-05T01:35:00.975367849Z [2024-04-05T01:35:00.975+0000] {scheduler_job.py:635} INFO - Setting external_id for to e7efd7ab-7a9d-4aad-9fd5-1e99fd471af9 2024-04-05T01:35:00.975598836Z [2024-04-05T01:35:00.975+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fb0e5fc-017a-44d3-9fde-f4dcea2df0ab 2024-04-05T01:35:00.975859381Z [2024-04-05T01:35:00.975+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e04a41d-df94-4eff-bbd7-70a2cdea78c9 2024-04-05T01:35:03.450603243Z [2024-04-05T01:35:03.450+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:35:03.451235301Z [2024-04-05T01:35:03.450+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:34:00+00:00, run_id=scheduled__2024-04-05T01:34:00+00:00, run_start_date=2024-04-05 01:35:00.091570+00:00, run_end_date=2024-04-05 01:35:03.450541+00:00, run_duration=3.358971, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:34:00+00:00, data_interval_end=2024-04-05 01:35:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:35:03.469795477Z [2024-04-05T01:35:03.469+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:35:00+00:00, run_after=2024-04-05T01:36:00+00:00 2024-04-05T01:35:03.555719982Z [2024-04-05T01:35:03.555+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status success for try_number 1 2024-04-05T01:35:03.572071783Z [2024-04-05T01:35:03.571+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:34:00+00:00, map_index=-1, run_start_date=2024-04-05 01:35:02.318103+00:00, run_end_date=2024-04-05 01:35:03.037604+00:00, run_duration=0.719501, state=success, executor_state=success, try_number=1, max_tries=1, job_id=827, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:35:00.177040+00:00, queued_by_job_id=1, pid=12144 2024-04-05T01:35:04.114099747Z [2024-04-05T01:35:04.113+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:35:04.114131254Z 2024-04-05T01:35:04.114135836Z [2024-04-05T01:35:04.113+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:35:04.114871507Z [2024-04-05T01:35:04.114+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:35:04.114884740Z 2024-04-05T01:35:04.119390073Z [2024-04-05T01:35:04.118+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:35:04.119589403Z [2024-04-05T01:35:04.119+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:35:04.214100519Z [2024-04-05T01:35:04.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status queued for try_number 1 2024-04-05T01:35:04.215983730Z [2024-04-05T01:35:04.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status success for try_number 1 2024-04-05T01:35:04.226346715Z [2024-04-05T01:35:04.225+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6b9aec51-4b6e-4261-ab5d-f19cc8b48f4c 2024-04-05T01:35:04.227142212Z [2024-04-05T01:35:04.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:30:00+00:00, map_index=-1, run_start_date=2024-04-05 01:35:03.316883+00:00, run_end_date=2024-04-05 01:35:03.940018+00:00, run_duration=0.623135, state=success, executor_state=success, try_number=1, max_tries=1, job_id=828, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:35:00.177040+00:00, queued_by_job_id=1, pid=12161 2024-04-05T01:35:06.315868410Z [2024-04-05T01:35:06.315+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:35:06.316124490Z [2024-04-05T01:35:06.315+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:34:00+00:00, run_id=scheduled__2024-04-05T01:34:00+00:00, run_start_date=2024-04-05 01:35:00.093025+00:00, run_end_date=2024-04-05 01:35:06.315743+00:00, run_duration=6.222718, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:34:00+00:00, data_interval_end=2024-04-05 01:35:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:35:06.325491695Z [2024-04-05T01:35:06.325+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:35:00+00:00, run_after=2024-04-05T01:36:00+00:00 2024-04-05T01:35:06.332700558Z [2024-04-05T01:35:06.332+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:35:06.333046578Z [2024-04-05T01:35:06.332+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:34:00+00:00, run_id=scheduled__2024-04-05T01:34:00+00:00, run_start_date=2024-04-05 01:35:00.094654+00:00, run_end_date=2024-04-05 01:35:06.332583+00:00, run_duration=6.237929, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:34:00+00:00, data_interval_end=2024-04-05 01:35:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:35:06.342544762Z [2024-04-05T01:35:06.342+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:35:00+00:00, run_after=2024-04-05T01:36:00+00:00 2024-04-05T01:35:06.431516169Z [2024-04-05T01:35:06.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status success for try_number 1 2024-04-05T01:35:06.431540319Z [2024-04-05T01:35:06.430+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status success for try_number 1 2024-04-05T01:35:06.444233270Z [2024-04-05T01:35:06.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:34:00+00:00, map_index=-1, run_start_date=2024-04-05 01:35:03.713326+00:00, run_end_date=2024-04-05 01:35:05.338088+00:00, run_duration=1.624762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=829, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:35:00.177040+00:00, queued_by_job_id=1, pid=12167 2024-04-05T01:35:06.444611099Z [2024-04-05T01:35:06.444+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:34:00+00:00, map_index=-1, run_start_date=2024-04-05 01:35:03.805609+00:00, run_end_date=2024-04-05 01:35:05.831840+00:00, run_duration=2.026231, state=success, executor_state=success, try_number=1, max_tries=1, job_id=830, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:35:00.177040+00:00, queued_by_job_id=1, pid=12172 2024-04-05T01:35:07.530122516Z [2024-04-05T01:35:07.529+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:35:07.530158310Z 2024-04-05T01:35:07.530379359Z [2024-04-05T01:35:07.530+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:35:07.531399984Z [2024-04-05T01:35:07.531+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:35:07.531411252Z 2024-04-05T01:35:07.535225916Z [2024-04-05T01:35:07.534+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:35:07.535719140Z [2024-04-05T01:35:07.535+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:35:07.592018966Z [2024-04-05T01:35:07.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status queued for try_number 1 2024-04-05T01:35:07.592278654Z [2024-04-05T01:35:07.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status success for try_number 1 2024-04-05T01:35:07.600890950Z [2024-04-05T01:35:07.600+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e69c8b4-c15d-4236-a75a-cd9079db8a8f 2024-04-05T01:35:07.601263310Z [2024-04-05T01:35:07.601+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T01:30:00+00:00, map_index=-1, run_start_date=2024-04-05 01:35:06.023660+00:00, run_end_date=2024-04-05 01:35:06.406496+00:00, run_duration=0.382836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=831, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:35:04.115512+00:00, queued_by_job_id=1, pid=12191 2024-04-05T01:35:10.520749974Z [2024-04-05T01:35:10.520+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:35:10.520814780Z 2024-04-05T01:35:10.521017779Z [2024-04-05T01:35:10.520+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:35:10.521988422Z [2024-04-05T01:35:10.521+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:35:10.522012048Z 2024-04-05T01:35:10.526245402Z [2024-04-05T01:35:10.525+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:35:10.526494134Z [2024-04-05T01:35:10.526+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:35:10.607127557Z [2024-04-05T01:35:10.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status queued for try_number 1 2024-04-05T01:35:10.607475734Z [2024-04-05T01:35:10.607+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status success for try_number 1 2024-04-05T01:35:10.625988036Z [2024-04-05T01:35:10.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2036172-305a-4a29-b0ce-ccf15695988b 2024-04-05T01:35:10.626433755Z [2024-04-05T01:35:10.626+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:30:00+00:00, map_index=0, run_start_date=2024-04-05 01:35:09.159835+00:00, run_end_date=2024-04-05 01:35:09.570972+00:00, run_duration=0.411137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=832, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:35:07.532086+00:00, queued_by_job_id=1, pid=12199 2024-04-05T01:35:14.122563258Z [2024-04-05T01:35:14.122+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:35:14.123091957Z [2024-04-05T01:35:14.122+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:30:00+00:00, run_id=scheduled__2024-04-05T01:30:00+00:00, run_start_date=2024-04-05 01:35:00.089870+00:00, run_end_date=2024-04-05 01:35:14.122447+00:00, run_duration=14.032577, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:30:00+00:00, data_interval_end=2024-04-05 01:35:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T01:35:14.134526201Z [2024-04-05T01:35:14.133+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:35:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:35:14.178438017Z [2024-04-05T01:35:14.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:30:00+00:00 exited with status success for try_number 1 2024-04-05T01:35:14.188234320Z [2024-04-05T01:35:14.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:30:00+00:00, map_index=-1, run_start_date=2024-04-05 01:35:12.631341+00:00, run_end_date=2024-04-05 01:35:13.058966+00:00, run_duration=0.427625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=833, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:35:10.522597+00:00, queued_by_job_id=1, pid=12220 2024-04-05T01:35:41.380528803Z [2024-04-05T01:35:41.380+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T01:36:01.144920708Z [2024-04-05T01:36:01.144+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:36:00+00:00, run_after=2024-04-05T01:37:00+00:00 2024-04-05T01:36:01.225922549Z [2024-04-05T01:36:01.225+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:36:00+00:00, run_after=2024-04-05T01:37:00+00:00 2024-04-05T01:36:01.267852167Z [2024-04-05T01:36:01.267+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:36:01.340651166Z [2024-04-05T01:36:01.340+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:36:01.611904487Z [2024-04-05T01:36:01.610+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:36:01.611937235Z 2024-04-05T01:36:01.611946209Z 2024-04-05T01:36:01.611952050Z 2024-04-05T01:36:01.611957563Z 2024-04-05T01:36:01.612452645Z [2024-04-05T01:36:01.612+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:36:01.613079714Z [2024-04-05T01:36:01.612+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:36:01.613626902Z [2024-04-05T01:36:01.613+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:36:01.614036271Z [2024-04-05T01:36:01.613+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:36:01.615424074Z [2024-04-05T01:36:01.615+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:36:01.615473934Z 2024-04-05T01:36:01.615481975Z 2024-04-05T01:36:01.615487570Z 2024-04-05T01:36:01.615493238Z 2024-04-05T01:36:01.626031758Z [2024-04-05T01:36:01.625+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:36:01.626540973Z [2024-04-05T01:36:01.626+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:36:01.627410397Z [2024-04-05T01:36:01.627+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:36:01.627874580Z [2024-04-05T01:36:01.627+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:36:01.628732329Z [2024-04-05T01:36:01.628+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:36:01.629076967Z [2024-04-05T01:36:01.628+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:36:01.629633127Z [2024-04-05T01:36:01.629+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:36:01.630006267Z [2024-04-05T01:36:01.629+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:36:02.389319334Z [2024-04-05T01:36:02.388+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status queued for try_number 1 2024-04-05T01:36:02.389541823Z [2024-04-05T01:36:02.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status queued for try_number 1 2024-04-05T01:36:02.389761586Z [2024-04-05T01:36:02.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status queued for try_number 1 2024-04-05T01:36:02.389964825Z [2024-04-05T01:36:02.389+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status queued for try_number 1 2024-04-05T01:36:02.406351485Z [2024-04-05T01:36:02.405+0000] {scheduler_job.py:635} INFO - Setting external_id for to de805cc6-457b-4811-a463-0b728b4162aa 2024-04-05T01:36:02.406709987Z [2024-04-05T01:36:02.406+0000] {scheduler_job.py:635} INFO - Setting external_id for to ff39f206-401d-4ff1-9a9f-d0ad16849e55 2024-04-05T01:36:02.407071988Z [2024-04-05T01:36:02.406+0000] {scheduler_job.py:635} INFO - Setting external_id for to d22dc387-98e8-4ca0-b165-d3a168db31bb 2024-04-05T01:36:02.407442227Z [2024-04-05T01:36:02.407+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfaada28-faa7-4f94-bd64-f333a158d959 2024-04-05T01:36:05.147011168Z [2024-04-05T01:36:05.146+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:36:05.147786469Z [2024-04-05T01:36:05.147+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:34:00+00:00, run_id=scheduled__2024-04-05T01:34:00+00:00, run_start_date=2024-04-05 01:36:01.410105+00:00, run_end_date=2024-04-05 01:36:05.146975+00:00, run_duration=3.73687, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:34:00+00:00, data_interval_end=2024-04-05 01:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:36:05.158754649Z [2024-04-05T01:36:05.158+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:36:00+00:00, run_after=2024-04-05T01:38:00+00:00 2024-04-05T01:36:05.166211475Z [2024-04-05T01:36:05.165+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:36:05.166320509Z [2024-04-05T01:36:05.166+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:35:00+00:00, run_id=scheduled__2024-04-05T01:35:00+00:00, run_start_date=2024-04-05 01:36:01.420247+00:00, run_end_date=2024-04-05 01:36:05.166081+00:00, run_duration=3.745834, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:35:00+00:00, data_interval_end=2024-04-05 01:36:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:36:05.176519512Z [2024-04-05T01:36:05.176+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:36:00+00:00, run_after=2024-04-05T01:37:00+00:00 2024-04-05T01:36:05.227936406Z [2024-04-05T01:36:05.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:34:00+00:00 exited with status success for try_number 1 2024-04-05T01:36:05.228014939Z [2024-04-05T01:36:05.227+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status success for try_number 1 2024-04-05T01:36:05.235345525Z [2024-04-05T01:36:05.234+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:35:00+00:00, map_index=-1, run_start_date=2024-04-05 01:36:03.651396+00:00, run_end_date=2024-04-05 01:36:04.271426+00:00, run_duration=0.62003, state=success, executor_state=success, try_number=1, max_tries=1, job_id=835, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:36:01.617506+00:00, queued_by_job_id=1, pid=12231 2024-04-05T01:36:05.235595561Z [2024-04-05T01:36:05.235+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:34:00+00:00, map_index=-1, run_start_date=2024-04-05 01:36:03.583473+00:00, run_end_date=2024-04-05 01:36:04.145094+00:00, run_duration=0.561621, state=success, executor_state=success, try_number=1, max_tries=1, job_id=834, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:36:01.617506+00:00, queued_by_job_id=1, pid=12230 2024-04-05T01:36:07.996280708Z [2024-04-05T01:36:07.995+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:36:07.996776908Z [2024-04-05T01:36:07.996+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:35:00+00:00, run_id=scheduled__2024-04-05T01:35:00+00:00, run_start_date=2024-04-05 01:36:01.422976+00:00, run_end_date=2024-04-05 01:36:07.996376+00:00, run_duration=6.5734, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:35:00+00:00, data_interval_end=2024-04-05 01:36:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:36:08.006246309Z [2024-04-05T01:36:08.005+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:36:00+00:00, run_after=2024-04-05T01:37:00+00:00 2024-04-05T01:36:08.013609756Z [2024-04-05T01:36:08.013+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:36:08.013996436Z [2024-04-05T01:36:08.013+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:35:00+00:00, run_id=scheduled__2024-04-05T01:35:00+00:00, run_start_date=2024-04-05 01:36:01.426071+00:00, run_end_date=2024-04-05 01:36:08.013504+00:00, run_duration=6.587433, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:35:00+00:00, data_interval_end=2024-04-05 01:36:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:36:08.023389170Z [2024-04-05T01:36:08.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:36:00+00:00, run_after=2024-04-05T01:37:00+00:00 2024-04-05T01:36:08.058123304Z [2024-04-05T01:36:08.057+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status success for try_number 1 2024-04-05T01:36:08.064531314Z [2024-04-05T01:36:08.064+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:35:00+00:00, map_index=-1, run_start_date=2024-04-05 01:36:05.156074+00:00, run_end_date=2024-04-05 01:36:07.421564+00:00, run_duration=2.26549, state=success, executor_state=success, try_number=1, max_tries=1, job_id=836, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:36:01.617506+00:00, queued_by_job_id=1, pid=12249 2024-04-05T01:36:09.148824527Z [2024-04-05T01:36:09.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status success for try_number 1 2024-04-05T01:36:09.160501150Z [2024-04-05T01:36:09.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:35:00+00:00, map_index=-1, run_start_date=2024-04-05 01:36:05.430335+00:00, run_end_date=2024-04-05 01:36:07.942938+00:00, run_duration=2.512603, state=success, executor_state=success, try_number=1, max_tries=1, job_id=837, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:36:01.617506+00:00, queued_by_job_id=1, pid=12255 2024-04-05T01:37:00.358482741Z [2024-04-05T01:37:00.358+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:37:00+00:00, run_after=2024-04-05T01:38:00+00:00 2024-04-05T01:37:00.367818109Z [2024-04-05T01:37:00.367+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:37:00.381744599Z [2024-04-05T01:37:00.381+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:37:00+00:00, run_after=2024-04-05T01:38:00+00:00 2024-04-05T01:37:00.478435126Z [2024-04-05T01:37:00.478+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:37:00.478454256Z 2024-04-05T01:37:00.478465162Z 2024-04-05T01:37:00.478469198Z 2024-04-05T01:37:00.478480783Z [2024-04-05T01:37:00.478+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:37:00.478749368Z [2024-04-05T01:37:00.478+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:37:00.478796447Z [2024-04-05T01:37:00.478+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:37:00.480195143Z [2024-04-05T01:37:00.479+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:37:00.480210635Z 2024-04-05T01:37:00.480214622Z 2024-04-05T01:37:00.480218359Z 2024-04-05T01:37:00.487352579Z [2024-04-05T01:37:00.486+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:37:00.487631502Z [2024-04-05T01:37:00.487+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:37:00.488113820Z [2024-04-05T01:37:00.487+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:37:00.488276442Z [2024-04-05T01:37:00.488+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:37:00.488686954Z [2024-04-05T01:37:00.488+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:37:00.488856253Z [2024-04-05T01:37:00.488+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:37:00.887701669Z [2024-04-05T01:37:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:36:00+00:00 exited with status queued for try_number 1 2024-04-05T01:37:00.887760581Z [2024-04-05T01:37:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:36:00+00:00 exited with status queued for try_number 1 2024-04-05T01:37:00.887978871Z [2024-04-05T01:37:00.887+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:36:00+00:00 exited with status queued for try_number 1 2024-04-05T01:37:00.909191032Z [2024-04-05T01:37:00.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to 21be10dc-fa5c-46fc-9c7e-53466dece0ed 2024-04-05T01:37:00.909266464Z [2024-04-05T01:37:00.909+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1af72178-a42c-42c4-a028-cd4f2218b442 2024-04-05T01:37:00.909542759Z [2024-04-05T01:37:00.909+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e2c7b97-cf9a-40ba-845c-24c8f9b437a8 2024-04-05T01:37:03.098963295Z [2024-04-05T01:37:03.098+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:37:03.099314376Z [2024-04-05T01:37:03.099+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:36:00+00:00, run_id=scheduled__2024-04-05T01:36:00+00:00, run_start_date=2024-04-05 01:37:00.394640+00:00, run_end_date=2024-04-05 01:37:03.098933+00:00, run_duration=2.704293, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:36:00+00:00, data_interval_end=2024-04-05 01:37:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:37:03.119582071Z [2024-04-05T01:37:03.118+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:37:00+00:00, run_after=2024-04-05T01:38:00+00:00 2024-04-05T01:37:04.480767502Z [2024-04-05T01:37:04.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:36:00+00:00 exited with status success for try_number 1 2024-04-05T01:37:04.502960325Z [2024-04-05T01:37:04.493+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:36:00+00:00, map_index=-1, run_start_date=2024-04-05 01:37:02.574802+00:00, run_end_date=2024-04-05 01:37:03.046427+00:00, run_duration=0.471625, state=success, executor_state=success, try_number=1, max_tries=1, job_id=838, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:37:00.481507+00:00, queued_by_job_id=1, pid=12289 2024-04-05T01:37:07.390588833Z [2024-04-05T01:37:07.390+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:37:07.390818627Z [2024-04-05T01:37:07.390+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:36:00+00:00, run_id=scheduled__2024-04-05T01:36:00+00:00, run_start_date=2024-04-05 01:37:00.396220+00:00, run_end_date=2024-04-05 01:37:07.390424+00:00, run_duration=6.994204, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:36:00+00:00, data_interval_end=2024-04-05 01:37:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:37:07.399272897Z [2024-04-05T01:37:07.398+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:37:00+00:00, run_after=2024-04-05T01:38:00+00:00 2024-04-05T01:37:07.406209884Z [2024-04-05T01:37:07.405+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:37:07.406443952Z [2024-04-05T01:37:07.406+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:36:00+00:00, run_id=scheduled__2024-04-05T01:36:00+00:00, run_start_date=2024-04-05 01:37:00.397485+00:00, run_end_date=2024-04-05 01:37:07.406116+00:00, run_duration=7.008631, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:36:00+00:00, data_interval_end=2024-04-05 01:37:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:37:07.415453158Z [2024-04-05T01:37:07.415+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:37:00+00:00, run_after=2024-04-05T01:38:00+00:00 2024-04-05T01:37:07.476140728Z [2024-04-05T01:37:07.475+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:36:00+00:00 exited with status success for try_number 1 2024-04-05T01:37:07.476402157Z [2024-04-05T01:37:07.476+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:36:00+00:00 exited with status success for try_number 1 2024-04-05T01:37:07.495434878Z [2024-04-05T01:37:07.494+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:36:00+00:00, map_index=-1, run_start_date=2024-04-05 01:37:04.090834+00:00, run_end_date=2024-04-05 01:37:06.742440+00:00, run_duration=2.651606, state=success, executor_state=success, try_number=1, max_tries=1, job_id=840, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:37:00.481507+00:00, queued_by_job_id=1, pid=12306 2024-04-05T01:37:07.495758550Z [2024-04-05T01:37:07.495+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:36:00+00:00, map_index=-1, run_start_date=2024-04-05 01:37:03.951038+00:00, run_end_date=2024-04-05 01:37:06.831190+00:00, run_duration=2.880152, state=success, executor_state=success, try_number=1, max_tries=1, job_id=839, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:37:00.481507+00:00, queued_by_job_id=1, pid=12305 2024-04-05T01:38:01.088127205Z [2024-04-05T01:38:01.087+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:38:00+00:00, run_after=2024-04-05T01:39:00+00:00 2024-04-05T01:38:01.113870014Z [2024-04-05T01:38:01.113+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:38:00+00:00, run_after=2024-04-05T01:39:00+00:00 2024-04-05T01:38:01.125480539Z [2024-04-05T01:38:01.125+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:38:01.137272313Z [2024-04-05T01:38:01.136+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:38:01.325657159Z [2024-04-05T01:38:01.325+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:38:01.325692973Z 2024-04-05T01:38:01.325699713Z 2024-04-05T01:38:01.325705591Z 2024-04-05T01:38:01.325711098Z 2024-04-05T01:38:01.326221828Z [2024-04-05T01:38:01.325+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:38:01.326528250Z [2024-04-05T01:38:01.326+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:38:01.326739989Z [2024-04-05T01:38:01.326+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:38:01.326942227Z [2024-04-05T01:38:01.326+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:38:01.328038728Z [2024-04-05T01:38:01.327+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:38:01.328078521Z 2024-04-05T01:38:01.328082891Z 2024-04-05T01:38:01.328086291Z 2024-04-05T01:38:01.328089591Z 2024-04-05T01:38:01.347585980Z [2024-04-05T01:38:01.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:38:01.347714494Z [2024-04-05T01:38:01.347+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:38:01.347941393Z [2024-04-05T01:38:01.347+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:38:01.348020911Z [2024-04-05T01:38:01.347+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:38:01.348202859Z [2024-04-05T01:38:01.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:38:01.348338870Z [2024-04-05T01:38:01.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:38:01.348548065Z [2024-04-05T01:38:01.348+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:38:01.348667809Z [2024-04-05T01:38:01.348+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:38:01.969164071Z [2024-04-05T01:38:01.968+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:36:00+00:00 exited with status queued for try_number 1 2024-04-05T01:38:01.969335122Z [2024-04-05T01:38:01.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:37:00+00:00 exited with status queued for try_number 1 2024-04-05T01:38:01.969524879Z [2024-04-05T01:38:01.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:37:00+00:00 exited with status queued for try_number 1 2024-04-05T01:38:01.969652375Z [2024-04-05T01:38:01.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:37:00+00:00 exited with status queued for try_number 1 2024-04-05T01:38:01.994348832Z [2024-04-05T01:38:01.993+0000] {scheduler_job.py:635} INFO - Setting external_id for to 516ffd3b-fced-4e58-94d9-f0b7c135426a 2024-04-05T01:38:01.996038696Z [2024-04-05T01:38:01.994+0000] {scheduler_job.py:635} INFO - Setting external_id for to 251fcf0b-2a73-4faf-a138-d65443802df0 2024-04-05T01:38:01.996408568Z [2024-04-05T01:38:01.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to d76ad16c-c6a6-4fbf-a1df-b154dbec3c4b 2024-04-05T01:38:01.996558019Z [2024-04-05T01:38:01.996+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0bd63ebb-2986-4ad1-b42f-4de46f536379 2024-04-05T01:38:03.315456580Z [2024-04-05T01:38:03.314+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:38:03.316220639Z [2024-04-05T01:38:03.315+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:37:00+00:00, run_id=scheduled__2024-04-05T01:37:00+00:00, run_start_date=2024-04-05 01:38:01.160204+00:00, run_end_date=2024-04-05 01:38:03.315484+00:00, run_duration=2.15528, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:37:00+00:00, data_interval_end=2024-04-05 01:38:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:38:03.345223776Z [2024-04-05T01:38:03.344+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:38:00+00:00, run_after=2024-04-05T01:39:00+00:00 2024-04-05T01:38:04.465783192Z [2024-04-05T01:38:04.465+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:38:04.466063073Z [2024-04-05T01:38:04.465+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:36:00+00:00, run_id=scheduled__2024-04-05T01:36:00+00:00, run_start_date=2024-04-05 01:38:01.158233+00:00, run_end_date=2024-04-05 01:38:04.465661+00:00, run_duration=3.307428, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:36:00+00:00, data_interval_end=2024-04-05 01:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:38:04.478811770Z [2024-04-05T01:38:04.478+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:38:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:38:04.551008454Z [2024-04-05T01:38:04.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:36:00+00:00 exited with status success for try_number 1 2024-04-05T01:38:04.553653466Z [2024-04-05T01:38:04.550+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:37:00+00:00 exited with status success for try_number 1 2024-04-05T01:38:04.561709675Z [2024-04-05T01:38:04.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:37:00+00:00, map_index=-1, run_start_date=2024-04-05 01:38:02.614614+00:00, run_end_date=2024-04-05 01:38:03.213616+00:00, run_duration=0.599002, state=success, executor_state=success, try_number=1, max_tries=1, job_id=841, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:38:01.329126+00:00, queued_by_job_id=1, pid=12340 2024-04-05T01:38:04.562128466Z [2024-04-05T01:38:04.561+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:36:00+00:00, map_index=-1, run_start_date=2024-04-05 01:38:02.837853+00:00, run_end_date=2024-04-05 01:38:03.428061+00:00, run_duration=0.590208, state=success, executor_state=success, try_number=1, max_tries=1, job_id=842, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:38:01.329126+00:00, queued_by_job_id=1, pid=12341 2024-04-05T01:38:06.704718052Z [2024-04-05T01:38:06.703+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:38:06.705061598Z [2024-04-05T01:38:06.704+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:37:00+00:00, run_id=scheduled__2024-04-05T01:37:00+00:00, run_start_date=2024-04-05 01:38:01.162148+00:00, run_end_date=2024-04-05 01:38:06.704643+00:00, run_duration=5.542495, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:37:00+00:00, data_interval_end=2024-04-05 01:38:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:38:06.729590997Z [2024-04-05T01:38:06.728+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:38:00+00:00, run_after=2024-04-05T01:39:00+00:00 2024-04-05T01:38:06.782506928Z [2024-04-05T01:38:06.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:37:00+00:00 exited with status success for try_number 1 2024-04-05T01:38:06.789283054Z [2024-04-05T01:38:06.788+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:37:00+00:00, map_index=-1, run_start_date=2024-04-05 01:38:04.299302+00:00, run_end_date=2024-04-05 01:38:06.443939+00:00, run_duration=2.144637, state=success, executor_state=success, try_number=1, max_tries=1, job_id=844, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:38:01.329126+00:00, queued_by_job_id=1, pid=12365 2024-04-05T01:38:07.133183670Z [2024-04-05T01:38:07.132+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:38:07.133333419Z [2024-04-05T01:38:07.133+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:37:00+00:00, run_id=scheduled__2024-04-05T01:37:00+00:00, run_start_date=2024-04-05 01:38:01.163935+00:00, run_end_date=2024-04-05 01:38:07.133048+00:00, run_duration=5.969113, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:37:00+00:00, data_interval_end=2024-04-05 01:38:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:38:07.143079128Z [2024-04-05T01:38:07.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:38:00+00:00, run_after=2024-04-05T01:39:00+00:00 2024-04-05T01:38:07.178694855Z [2024-04-05T01:38:07.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:37:00+00:00 exited with status success for try_number 1 2024-04-05T01:38:07.184935959Z [2024-04-05T01:38:07.184+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:37:00+00:00, map_index=-1, run_start_date=2024-04-05 01:38:04.204536+00:00, run_end_date=2024-04-05 01:38:06.937222+00:00, run_duration=2.732686, state=success, executor_state=success, try_number=1, max_tries=1, job_id=843, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:38:01.329126+00:00, queued_by_job_id=1, pid=12364 2024-04-05T01:39:01.063371902Z [2024-04-05T01:39:01.062+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:39:01.109121147Z [2024-04-05T01:39:01.108+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:39:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:39:01.125525076Z [2024-04-05T01:39:01.125+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:39:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:39:01.299549473Z [2024-04-05T01:39:01.299+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:39:01.299604050Z 2024-04-05T01:39:01.299609938Z 2024-04-05T01:39:01.299615024Z 2024-04-05T01:39:01.299948404Z [2024-04-05T01:39:01.299+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:39:01.300177371Z [2024-04-05T01:39:01.300+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:39:01.300400201Z [2024-04-05T01:39:01.300+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:39:01.301264527Z [2024-04-05T01:39:01.301+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:39:01.301298254Z 2024-04-05T01:39:01.301304533Z 2024-04-05T01:39:01.301328300Z 2024-04-05T01:39:01.306235822Z [2024-04-05T01:39:01.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:39:01.306538234Z [2024-04-05T01:39:01.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:39:01.306916704Z [2024-04-05T01:39:01.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:39:01.307128550Z [2024-04-05T01:39:01.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:39:01.307434478Z [2024-04-05T01:39:01.307+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:39:01.307688253Z [2024-04-05T01:39:01.307+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:39:01.843409194Z [2024-04-05T01:39:01.824+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:38:00+00:00 exited with status queued for try_number 1 2024-04-05T01:39:01.844363465Z [2024-04-05T01:39:01.843+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:38:00+00:00 exited with status queued for try_number 1 2024-04-05T01:39:01.846734350Z [2024-04-05T01:39:01.845+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:38:00+00:00 exited with status queued for try_number 1 2024-04-05T01:39:01.872562230Z [2024-04-05T01:39:01.872+0000] {scheduler_job.py:635} INFO - Setting external_id for to 23fe1118-6148-403f-857d-0c1e8d6ac558 2024-04-05T01:39:01.873072182Z [2024-04-05T01:39:01.872+0000] {scheduler_job.py:635} INFO - Setting external_id for to a9dea849-8237-46ae-97ee-ca031ccfb548 2024-04-05T01:39:01.873521545Z [2024-04-05T01:39:01.873+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34a1a648-eaa5-4ca1-8c97-7976d41bf64b 2024-04-05T01:39:03.636049850Z [2024-04-05T01:39:03.635+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:39:03.636870616Z [2024-04-05T01:39:03.636+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:38:00+00:00, run_id=scheduled__2024-04-05T01:38:00+00:00, run_start_date=2024-04-05 01:39:01.147769+00:00, run_end_date=2024-04-05 01:39:03.636332+00:00, run_duration=2.488563, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:38:00+00:00, data_interval_end=2024-04-05 01:39:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:39:03.650019628Z [2024-04-05T01:39:03.649+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:39:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:39:03.728068292Z [2024-04-05T01:39:03.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:38:00+00:00 exited with status success for try_number 1 2024-04-05T01:39:03.743776066Z [2024-04-05T01:39:03.743+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:38:00+00:00, map_index=-1, run_start_date=2024-04-05 01:39:02.611945+00:00, run_end_date=2024-04-05 01:39:03.143069+00:00, run_duration=0.531124, state=success, executor_state=success, try_number=1, max_tries=1, job_id=845, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:39:01.302130+00:00, queued_by_job_id=1, pid=12397 2024-04-05T01:39:05.931257574Z [2024-04-05T01:39:05.930+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:39:05.931917286Z [2024-04-05T01:39:05.931+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:38:00+00:00, run_id=scheduled__2024-04-05T01:38:00+00:00, run_start_date=2024-04-05 01:39:01.152596+00:00, run_end_date=2024-04-05 01:39:05.931108+00:00, run_duration=4.778512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:38:00+00:00, data_interval_end=2024-04-05 01:39:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:39:05.943420742Z [2024-04-05T01:39:05.943+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:39:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:39:05.990909037Z [2024-04-05T01:39:05.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:38:00+00:00 exited with status success for try_number 1 2024-04-05T01:39:05.996567744Z [2024-04-05T01:39:05.996+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:38:00+00:00, map_index=-1, run_start_date=2024-04-05 01:39:03.961061+00:00, run_end_date=2024-04-05 01:39:05.697349+00:00, run_duration=1.736288, state=success, executor_state=success, try_number=1, max_tries=1, job_id=846, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:39:01.302130+00:00, queued_by_job_id=1, pid=12410 2024-04-05T01:39:07.056136480Z [2024-04-05T01:39:07.055+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:39:07.056631733Z [2024-04-05T01:39:07.056+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:38:00+00:00, run_id=scheduled__2024-04-05T01:38:00+00:00, run_start_date=2024-04-05 01:39:01.150651+00:00, run_end_date=2024-04-05 01:39:07.055984+00:00, run_duration=5.905333, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:38:00+00:00, data_interval_end=2024-04-05 01:39:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:39:07.066664088Z [2024-04-05T01:39:07.066+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:39:00+00:00, run_after=2024-04-05T01:40:00+00:00 2024-04-05T01:39:07.120288567Z [2024-04-05T01:39:07.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:38:00+00:00 exited with status success for try_number 1 2024-04-05T01:39:07.133422705Z [2024-04-05T01:39:07.132+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:38:00+00:00, map_index=-1, run_start_date=2024-04-05 01:39:04.312426+00:00, run_end_date=2024-04-05 01:39:06.056332+00:00, run_duration=1.743906, state=success, executor_state=success, try_number=1, max_tries=1, job_id=847, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:39:01.302130+00:00, queued_by_job_id=1, pid=12421 2024-04-05T01:40:00.908295668Z [2024-04-05T01:40:00.907+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:40:00.929015843Z [2024-04-05T01:40:00.928+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:40:00+00:00, run_after=2024-04-05T01:41:00+00:00 2024-04-05T01:40:00.945989566Z [2024-04-05T01:40:00.945+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:40:00+00:00, run_after=2024-04-05T01:45:00+00:00 2024-04-05T01:40:00.967239628Z [2024-04-05T01:40:00.966+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:40:00+00:00, run_after=2024-04-05T01:41:00+00:00 2024-04-05T01:40:00.976405783Z [2024-04-05T01:40:00.975+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:40:01.095538913Z [2024-04-05T01:40:01.095+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T01:40:01.095612396Z 2024-04-05T01:40:01.095621048Z 2024-04-05T01:40:01.095627585Z 2024-04-05T01:40:01.095633820Z 2024-04-05T01:40:01.095656675Z 2024-04-05T01:40:01.095947381Z [2024-04-05T01:40:01.095+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:40:01.096235594Z [2024-04-05T01:40:01.096+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:40:01.096509919Z [2024-04-05T01:40:01.096+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:40:01.096770979Z [2024-04-05T01:40:01.096+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:40:01.097030960Z [2024-04-05T01:40:01.096+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:40:01.098031172Z [2024-04-05T01:40:01.097+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:40:01.098046743Z 2024-04-05T01:40:01.098053352Z 2024-04-05T01:40:01.098057376Z 2024-04-05T01:40:01.098061139Z 2024-04-05T01:40:01.098064921Z 2024-04-05T01:40:01.103812392Z [2024-04-05T01:40:01.103+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:40:01.104278318Z [2024-04-05T01:40:01.104+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:40:01.104750839Z [2024-04-05T01:40:01.104+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:40:01.105009379Z [2024-04-05T01:40:01.104+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:40:01.105439154Z [2024-04-05T01:40:01.105+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:40:01.105698154Z [2024-04-05T01:40:01.105+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:40:01.106143818Z [2024-04-05T01:40:01.105+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:40:01.106381201Z [2024-04-05T01:40:01.106+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:40:01.106763132Z [2024-04-05T01:40:01.106+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:40:01.107053132Z [2024-04-05T01:40:01.106+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:40:01.907060346Z [2024-04-05T01:40:01.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status queued for try_number 1 2024-04-05T01:40:01.907334697Z [2024-04-05T01:40:01.906+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:38:00+00:00 exited with status queued for try_number 1 2024-04-05T01:40:01.907420622Z [2024-04-05T01:40:01.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:39:00+00:00 exited with status queued for try_number 1 2024-04-05T01:40:01.907667404Z [2024-04-05T01:40:01.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:39:00+00:00 exited with status queued for try_number 1 2024-04-05T01:40:01.907677243Z [2024-04-05T01:40:01.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:39:00+00:00 exited with status queued for try_number 1 2024-04-05T01:40:01.939619378Z [2024-04-05T01:40:01.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to c22d244e-3774-4071-9798-c99c3d9d86b5 2024-04-05T01:40:01.940060867Z [2024-04-05T01:40:01.939+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6d82be6-cf8d-492d-b168-4dbeb1b68fbc 2024-04-05T01:40:01.940353952Z [2024-04-05T01:40:01.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to c5f48c88-e246-4d93-833e-201b276174f6 2024-04-05T01:40:01.941526676Z [2024-04-05T01:40:01.940+0000] {scheduler_job.py:635} INFO - Setting external_id for to e479f734-131e-4e75-8acb-abf871a7db8c 2024-04-05T01:40:01.941862803Z [2024-04-05T01:40:01.941+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62979399-4dd1-4f8a-aa43-60b3fa1269b9 2024-04-05T01:40:03.382365289Z [2024-04-05T01:40:03.381+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:40:03.383350203Z [2024-04-05T01:40:03.382+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:38:00+00:00, run_id=scheduled__2024-04-05T01:38:00+00:00, run_start_date=2024-04-05 01:40:00.997434+00:00, run_end_date=2024-04-05 01:40:03.382659+00:00, run_duration=2.385225, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:38:00+00:00, data_interval_end=2024-04-05 01:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:40:03.401897191Z [2024-04-05T01:40:03.401+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:40:00+00:00, run_after=2024-04-05T01:42:00+00:00 2024-04-05T01:40:03.652004190Z [2024-04-05T01:40:03.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:38:00+00:00 exited with status success for try_number 1 2024-04-05T01:40:03.674106970Z [2024-04-05T01:40:03.673+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:38:00+00:00, map_index=-1, run_start_date=2024-04-05 01:40:02.440397+00:00, run_end_date=2024-04-05 01:40:02.996930+00:00, run_duration=0.556533, state=success, executor_state=success, try_number=1, max_tries=1, job_id=848, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:01.099543+00:00, queued_by_job_id=1, pid=12448 2024-04-05T01:40:03.868782674Z [2024-04-05T01:40:03.868+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:40:03.869517825Z [2024-04-05T01:40:03.869+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:39:00+00:00, run_id=scheduled__2024-04-05T01:39:00+00:00, run_start_date=2024-04-05 01:40:00.999450+00:00, run_end_date=2024-04-05 01:40:03.869145+00:00, run_duration=2.869695, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:39:00+00:00, data_interval_end=2024-04-05 01:40:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:40:03.888999324Z [2024-04-05T01:40:03.888+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:40:00+00:00, run_after=2024-04-05T01:41:00+00:00 2024-04-05T01:40:03.979461026Z [2024-04-05T01:40:03.978+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:39:00+00:00 exited with status success for try_number 1 2024-04-05T01:40:03.988866363Z [2024-04-05T01:40:03.988+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:39:00+00:00, map_index=-1, run_start_date=2024-04-05 01:40:02.843272+00:00, run_end_date=2024-04-05 01:40:03.500034+00:00, run_duration=0.656762, state=success, executor_state=success, try_number=1, max_tries=1, job_id=849, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:01.099543+00:00, queued_by_job_id=1, pid=12451 2024-04-05T01:40:05.148020544Z [2024-04-05T01:40:05.147+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:40:05.148060453Z 2024-04-05T01:40:05.148201465Z [2024-04-05T01:40:05.147+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:40:05.149226011Z [2024-04-05T01:40:05.148+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:40:05.149249991Z 2024-04-05T01:40:05.153217037Z [2024-04-05T01:40:05.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:40:05.153631948Z [2024-04-05T01:40:05.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:40:05.220757165Z [2024-04-05T01:40:05.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status queued for try_number 1 2024-04-05T01:40:05.221729810Z [2024-04-05T01:40:05.220+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status success for try_number 1 2024-04-05T01:40:05.232150348Z [2024-04-05T01:40:05.231+0000] {scheduler_job.py:635} INFO - Setting external_id for to cac0e0c8-9977-4f72-90b2-9c70ca0becf6 2024-04-05T01:40:05.232656285Z [2024-04-05T01:40:05.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:35:00+00:00, map_index=-1, run_start_date=2024-04-05 01:40:04.293409+00:00, run_end_date=2024-04-05 01:40:04.857403+00:00, run_duration=0.563994, state=success, executor_state=success, try_number=1, max_tries=1, job_id=850, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:01.099543+00:00, queued_by_job_id=1, pid=12480 2024-04-05T01:40:07.451390626Z [2024-04-05T01:40:07.450+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:40:07.468588437Z [2024-04-05T01:40:07.466+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:39:00+00:00, run_id=scheduled__2024-04-05T01:39:00+00:00, run_start_date=2024-04-05 01:40:01.006970+00:00, run_end_date=2024-04-05 01:40:07.451413+00:00, run_duration=6.444443, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:39:00+00:00, data_interval_end=2024-04-05 01:40:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:40:07.484846105Z [2024-04-05T01:40:07.484+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:40:00+00:00, run_after=2024-04-05T01:41:00+00:00 2024-04-05T01:40:07.496111549Z [2024-04-05T01:40:07.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:40:07.496669796Z [2024-04-05T01:40:07.496+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:39:00+00:00, run_id=scheduled__2024-04-05T01:39:00+00:00, run_start_date=2024-04-05 01:40:01.008650+00:00, run_end_date=2024-04-05 01:40:07.496007+00:00, run_duration=6.487357, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:39:00+00:00, data_interval_end=2024-04-05 01:40:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:40:07.512119038Z [2024-04-05T01:40:07.511+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:40:00+00:00, run_after=2024-04-05T01:41:00+00:00 2024-04-05T01:40:07.576074898Z [2024-04-05T01:40:07.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:39:00+00:00 exited with status success for try_number 1 2024-04-05T01:40:07.576346389Z [2024-04-05T01:40:07.575+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:39:00+00:00 exited with status success for try_number 1 2024-04-05T01:40:07.586237920Z [2024-04-05T01:40:07.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:39:00+00:00, map_index=-1, run_start_date=2024-04-05 01:40:04.543360+00:00, run_end_date=2024-04-05 01:40:06.541286+00:00, run_duration=1.997926, state=success, executor_state=success, try_number=1, max_tries=1, job_id=852, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:01.099543+00:00, queued_by_job_id=1, pid=12482 2024-04-05T01:40:07.586481255Z [2024-04-05T01:40:07.586+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:39:00+00:00, map_index=-1, run_start_date=2024-04-05 01:40:04.375759+00:00, run_end_date=2024-04-05 01:40:06.493968+00:00, run_duration=2.118209, state=success, executor_state=success, try_number=1, max_tries=1, job_id=851, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:01.099543+00:00, queued_by_job_id=1, pid=12481 2024-04-05T01:40:08.679547037Z [2024-04-05T01:40:08.679+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:40:08.679604373Z 2024-04-05T01:40:08.680150438Z [2024-04-05T01:40:08.679+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:40:08.681556171Z [2024-04-05T01:40:08.681+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:40:08.681571714Z 2024-04-05T01:40:08.685098493Z [2024-04-05T01:40:08.684+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:40:08.685553517Z [2024-04-05T01:40:08.685+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:40:08.748004617Z [2024-04-05T01:40:08.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status queued for try_number 1 2024-04-05T01:40:08.748344612Z [2024-04-05T01:40:08.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status success for try_number 1 2024-04-05T01:40:08.756995737Z [2024-04-05T01:40:08.756+0000] {scheduler_job.py:635} INFO - Setting external_id for to 20da6dd2-022d-49cf-a892-56c6f1b35b3b 2024-04-05T01:40:08.757488218Z [2024-04-05T01:40:08.757+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T01:35:00+00:00, map_index=-1, run_start_date=2024-04-05 01:40:07.236243+00:00, run_end_date=2024-04-05 01:40:07.597988+00:00, run_duration=0.361745, state=success, executor_state=success, try_number=1, max_tries=1, job_id=853, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:05.149705+00:00, queued_by_job_id=1, pid=12505 2024-04-05T01:40:11.283484160Z [2024-04-05T01:40:11.283+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:40:11.283514202Z 2024-04-05T01:40:11.284006093Z [2024-04-05T01:40:11.283+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:40:11.284750559Z [2024-04-05T01:40:11.284+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:40:11.284774221Z 2024-04-05T01:40:11.291649641Z [2024-04-05T01:40:11.291+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:40:11.292158237Z [2024-04-05T01:40:11.291+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:40:11.383741346Z [2024-04-05T01:40:11.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status queued for try_number 1 2024-04-05T01:40:11.384017027Z [2024-04-05T01:40:11.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status success for try_number 1 2024-04-05T01:40:11.390485749Z [2024-04-05T01:40:11.390+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6b5f32b-28c0-4fdb-84e9-9e3808bb11e1 2024-04-05T01:40:11.390736008Z [2024-04-05T01:40:11.390+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:35:00+00:00, map_index=0, run_start_date=2024-04-05 01:40:10.630262+00:00, run_end_date=2024-04-05 01:40:10.996168+00:00, run_duration=0.365906, state=success, executor_state=success, try_number=1, max_tries=1, job_id=854, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:08.682249+00:00, queued_by_job_id=1, pid=12523 2024-04-05T01:40:14.157890225Z [2024-04-05T01:40:14.157+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:40:14.158510802Z [2024-04-05T01:40:14.158+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:35:00+00:00, run_id=scheduled__2024-04-05T01:35:00+00:00, run_start_date=2024-04-05 01:40:00.995181+00:00, run_end_date=2024-04-05 01:40:14.157974+00:00, run_duration=13.162793, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:35:00+00:00, data_interval_end=2024-04-05 01:40:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T01:40:14.168696305Z [2024-04-05T01:40:14.168+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:40:00+00:00, run_after=2024-04-05T01:45:00+00:00 2024-04-05T01:40:14.209249980Z [2024-04-05T01:40:14.208+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:35:00+00:00 exited with status success for try_number 1 2024-04-05T01:40:14.216315207Z [2024-04-05T01:40:14.215+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:35:00+00:00, map_index=-1, run_start_date=2024-04-05 01:40:13.268893+00:00, run_end_date=2024-04-05 01:40:13.699998+00:00, run_duration=0.431105, state=success, executor_state=success, try_number=1, max_tries=1, job_id=855, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:40:11.285419+00:00, queued_by_job_id=1, pid=12534 2024-04-05T01:40:41.440085100Z [2024-04-05T01:40:41.439+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T01:41:00.907492269Z [2024-04-05T01:41:00.907+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:41:00+00:00, run_after=2024-04-05T01:42:00+00:00 2024-04-05T01:41:00.936078550Z [2024-04-05T01:41:00.935+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:41:00+00:00, run_after=2024-04-05T01:42:00+00:00 2024-04-05T01:41:00.952055402Z [2024-04-05T01:41:00.950+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:41:01.081131110Z [2024-04-05T01:41:01.080+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:41:01.081188794Z 2024-04-05T01:41:01.081195103Z 2024-04-05T01:41:01.081200367Z 2024-04-05T01:41:01.081575238Z [2024-04-05T01:41:01.081+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:41:01.081938998Z [2024-04-05T01:41:01.081+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:41:01.082255637Z [2024-04-05T01:41:01.082+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:41:01.083324608Z [2024-04-05T01:41:01.083+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:41:01.083340720Z 2024-04-05T01:41:01.083346220Z 2024-04-05T01:41:01.083351664Z 2024-04-05T01:41:01.090634314Z [2024-04-05T01:41:01.090+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:41:01.091121760Z [2024-04-05T01:41:01.090+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:41:01.091944419Z [2024-04-05T01:41:01.091+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:41:01.092342199Z [2024-04-05T01:41:01.092+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:41:01.092947250Z [2024-04-05T01:41:01.092+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:41:01.093328051Z [2024-04-05T01:41:01.093+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:41:01.673087595Z [2024-04-05T01:41:01.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status queued for try_number 1 2024-04-05T01:41:01.673141641Z [2024-04-05T01:41:01.672+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status queued for try_number 1 2024-04-05T01:41:01.675729922Z [2024-04-05T01:41:01.673+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status queued for try_number 1 2024-04-05T01:41:01.693970181Z [2024-04-05T01:41:01.693+0000] {scheduler_job.py:635} INFO - Setting external_id for to fd699950-2c0a-491c-91df-86661f53b177 2024-04-05T01:41:01.696110528Z [2024-04-05T01:41:01.693+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e1c5383-e4ef-4de9-a31e-2216b123c50a 2024-04-05T01:41:01.696497736Z [2024-04-05T01:41:01.696+0000] {scheduler_job.py:635} INFO - Setting external_id for to aba43376-106c-47c3-9e59-dbc1835cc6cc 2024-04-05T01:41:03.009227319Z [2024-04-05T01:41:03.008+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:41:03.010335117Z [2024-04-05T01:41:03.009+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:40:00+00:00, run_id=scheduled__2024-04-05T01:40:00+00:00, run_start_date=2024-04-05 01:41:00.973368+00:00, run_end_date=2024-04-05 01:41:03.009197+00:00, run_duration=2.035829, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:40:00+00:00, data_interval_end=2024-04-05 01:41:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:41:03.039313898Z [2024-04-05T01:41:03.038+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:41:00+00:00, run_after=2024-04-05T01:42:00+00:00 2024-04-05T01:41:03.125518921Z [2024-04-05T01:41:03.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status success for try_number 1 2024-04-05T01:41:03.135103792Z [2024-04-05T01:41:03.134+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:40:00+00:00, map_index=-1, run_start_date=2024-04-05 01:41:02.374289+00:00, run_end_date=2024-04-05 01:41:02.844802+00:00, run_duration=0.470513, state=success, executor_state=success, try_number=1, max_tries=1, job_id=856, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:41:01.084842+00:00, queued_by_job_id=1, pid=12543 2024-04-05T01:41:04.891686458Z [2024-04-05T01:41:04.891+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:41:04.891926477Z [2024-04-05T01:41:04.891+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:40:00+00:00, run_id=scheduled__2024-04-05T01:40:00+00:00, run_start_date=2024-04-05 01:41:00.976385+00:00, run_end_date=2024-04-05 01:41:04.891481+00:00, run_duration=3.915096, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:40:00+00:00, data_interval_end=2024-04-05 01:41:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:41:04.910675353Z [2024-04-05T01:41:04.910+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:41:00+00:00, run_after=2024-04-05T01:42:00+00:00 2024-04-05T01:41:06.040228654Z [2024-04-05T01:41:06.039+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:41:06.040903157Z [2024-04-05T01:41:06.040+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:40:00+00:00, run_id=scheduled__2024-04-05T01:40:00+00:00, run_start_date=2024-04-05 01:41:00.978199+00:00, run_end_date=2024-04-05 01:41:06.040375+00:00, run_duration=5.062176, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:40:00+00:00, data_interval_end=2024-04-05 01:41:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:41:06.053889539Z [2024-04-05T01:41:06.053+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:41:00+00:00, run_after=2024-04-05T01:42:00+00:00 2024-04-05T01:41:06.104338248Z [2024-04-05T01:41:06.103+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status success for try_number 1 2024-04-05T01:41:06.104399413Z [2024-04-05T01:41:06.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status success for try_number 1 2024-04-05T01:41:06.115651519Z [2024-04-05T01:41:06.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:40:00+00:00, map_index=-1, run_start_date=2024-04-05 01:41:03.424464+00:00, run_end_date=2024-04-05 01:41:04.807040+00:00, run_duration=1.382576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=857, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:41:01.084842+00:00, queued_by_job_id=1, pid=12561 2024-04-05T01:41:06.116131849Z [2024-04-05T01:41:06.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:40:00+00:00, map_index=-1, run_start_date=2024-04-05 01:41:03.527750+00:00, run_end_date=2024-04-05 01:41:05.317710+00:00, run_duration=1.78996, state=success, executor_state=success, try_number=1, max_tries=1, job_id=858, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:41:01.084842+00:00, queued_by_job_id=1, pid=12562 2024-04-05T01:42:00.361309851Z [2024-04-05T01:42:00.360+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:42:00+00:00, run_after=2024-04-05T01:43:00+00:00 2024-04-05T01:42:00.372498609Z [2024-04-05T01:42:00.372+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:42:00.386213097Z [2024-04-05T01:42:00.385+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:42:00.400983378Z [2024-04-05T01:42:00.400+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:42:00+00:00, run_after=2024-04-05T01:43:00+00:00 2024-04-05T01:42:00.489601696Z [2024-04-05T01:42:00.489+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:42:00.489640918Z 2024-04-05T01:42:00.489651501Z 2024-04-05T01:42:00.489659434Z 2024-04-05T01:42:00.489667420Z 2024-04-05T01:42:00.489842773Z [2024-04-05T01:42:00.489+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:42:00.490070972Z [2024-04-05T01:42:00.489+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:42:00.490483101Z [2024-04-05T01:42:00.490+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:42:00.493119436Z [2024-04-05T01:42:00.490+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:42:00.493809514Z [2024-04-05T01:42:00.493+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:42:00.493832427Z 2024-04-05T01:42:00.493839688Z 2024-04-05T01:42:00.493845475Z 2024-04-05T01:42:00.493851216Z 2024-04-05T01:42:00.505951640Z [2024-04-05T01:42:00.505+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:42:00.506302353Z [2024-04-05T01:42:00.506+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:42:00.506666669Z [2024-04-05T01:42:00.506+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:42:00.506855335Z [2024-04-05T01:42:00.506+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:42:00.507155173Z [2024-04-05T01:42:00.506+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:42:00.507397300Z [2024-04-05T01:42:00.507+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:42:00.507807369Z [2024-04-05T01:42:00.507+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:42:00.507975015Z [2024-04-05T01:42:00.507+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:42:00.859291754Z [2024-04-05T01:42:00.858+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status queued for try_number 1 2024-04-05T01:42:00.859634456Z [2024-04-05T01:42:00.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:41:00+00:00 exited with status queued for try_number 1 2024-04-05T01:42:00.861341575Z [2024-04-05T01:42:00.859+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:41:00+00:00 exited with status queued for try_number 1 2024-04-05T01:42:00.861623258Z [2024-04-05T01:42:00.861+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:41:00+00:00 exited with status queued for try_number 1 2024-04-05T01:42:00.880515986Z [2024-04-05T01:42:00.880+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1b034a8a-6a59-46ae-a4a2-0eec5a031c48 2024-04-05T01:42:00.880945550Z [2024-04-05T01:42:00.880+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3308be7-0c72-4500-b7b4-d4efb1bbbfcf 2024-04-05T01:42:00.881256797Z [2024-04-05T01:42:00.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to dbbb628f-e125-435c-abb4-9ccb703ca70b 2024-04-05T01:42:00.881542939Z [2024-04-05T01:42:00.881+0000] {scheduler_job.py:635} INFO - Setting external_id for to 550cceb5-1e25-41e5-9542-81ae8b6c9c4b 2024-04-05T01:42:03.443529536Z [2024-04-05T01:42:03.442+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:42:03.444318478Z [2024-04-05T01:42:03.443+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:41:00+00:00, run_id=scheduled__2024-04-05T01:41:00+00:00, run_start_date=2024-04-05 01:42:00.415016+00:00, run_end_date=2024-04-05 01:42:03.443429+00:00, run_duration=3.028413, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:41:00+00:00, data_interval_end=2024-04-05 01:42:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:42:03.473738790Z [2024-04-05T01:42:03.471+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:42:00+00:00, run_after=2024-04-05T01:43:00+00:00 2024-04-05T01:42:03.492623722Z [2024-04-05T01:42:03.492+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:42:03.493343331Z [2024-04-05T01:42:03.492+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:40:00+00:00, run_id=scheduled__2024-04-05T01:40:00+00:00, run_start_date=2024-04-05 01:42:00.413762+00:00, run_end_date=2024-04-05 01:42:03.492698+00:00, run_duration=3.078936, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:40:00+00:00, data_interval_end=2024-04-05 01:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:42:03.510404152Z [2024-04-05T01:42:03.509+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:42:00+00:00, run_after=2024-04-05T01:44:00+00:00 2024-04-05T01:42:03.604883387Z [2024-04-05T01:42:03.604+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status success for try_number 1 2024-04-05T01:42:03.605692572Z [2024-04-05T01:42:03.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:41:00+00:00 exited with status success for try_number 1 2024-04-05T01:42:03.619379533Z [2024-04-05T01:42:03.618+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:40:00+00:00, map_index=-1, run_start_date=2024-04-05 01:42:02.124935+00:00, run_end_date=2024-04-05 01:42:02.769486+00:00, run_duration=0.644551, state=success, executor_state=success, try_number=1, max_tries=1, job_id=859, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:42:00.495043+00:00, queued_by_job_id=1, pid=12595 2024-04-05T01:42:03.620313590Z [2024-04-05T01:42:03.619+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:41:00+00:00, map_index=-1, run_start_date=2024-04-05 01:42:02.448725+00:00, run_end_date=2024-04-05 01:42:02.992549+00:00, run_duration=0.543824, state=success, executor_state=success, try_number=1, max_tries=1, job_id=860, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:42:00.495043+00:00, queued_by_job_id=1, pid=12596 2024-04-05T01:42:07.174867576Z [2024-04-05T01:42:07.174+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:42:07.176287754Z [2024-04-05T01:42:07.175+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:41:00+00:00, run_id=scheduled__2024-04-05T01:41:00+00:00, run_start_date=2024-04-05 01:42:00.416166+00:00, run_end_date=2024-04-05 01:42:07.174773+00:00, run_duration=6.758607, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:41:00+00:00, data_interval_end=2024-04-05 01:42:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:42:07.192317049Z [2024-04-05T01:42:07.191+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:42:00+00:00, run_after=2024-04-05T01:43:00+00:00 2024-04-05T01:42:07.242184560Z [2024-04-05T01:42:07.241+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:41:00+00:00 exited with status success for try_number 1 2024-04-05T01:42:07.250250506Z [2024-04-05T01:42:07.249+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:41:00+00:00, map_index=-1, run_start_date=2024-04-05 01:42:03.829244+00:00, run_end_date=2024-04-05 01:42:06.298748+00:00, run_duration=2.469504, state=success, executor_state=success, try_number=1, max_tries=1, job_id=861, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:42:00.495043+00:00, queued_by_job_id=1, pid=12620 2024-04-05T01:42:08.293607206Z [2024-04-05T01:42:08.293+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:42:08.294117699Z [2024-04-05T01:42:08.293+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:41:00+00:00, run_id=scheduled__2024-04-05T01:41:00+00:00, run_start_date=2024-04-05 01:42:00.417266+00:00, run_end_date=2024-04-05 01:42:08.293385+00:00, run_duration=7.876119, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:41:00+00:00, data_interval_end=2024-04-05 01:42:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:42:08.307361198Z [2024-04-05T01:42:08.306+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:42:00+00:00, run_after=2024-04-05T01:43:00+00:00 2024-04-05T01:42:08.351744212Z [2024-04-05T01:42:08.350+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:41:00+00:00 exited with status success for try_number 1 2024-04-05T01:42:08.364224452Z [2024-04-05T01:42:08.363+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:41:00+00:00, map_index=-1, run_start_date=2024-04-05 01:42:03.827437+00:00, run_end_date=2024-04-05 01:42:07.212776+00:00, run_duration=3.385339, state=success, executor_state=success, try_number=1, max_tries=1, job_id=862, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:42:00.495043+00:00, queued_by_job_id=1, pid=12619 2024-04-05T01:43:00.776695964Z [2024-04-05T01:43:00.776+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:43:00+00:00, run_after=2024-04-05T01:44:00+00:00 2024-04-05T01:43:00.789868845Z [2024-04-05T01:43:00.789+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:43:00+00:00, run_after=2024-04-05T01:44:00+00:00 2024-04-05T01:43:00.797860799Z [2024-04-05T01:43:00.797+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:43:00.872770096Z [2024-04-05T01:43:00.872+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:43:00.872802324Z 2024-04-05T01:43:00.872806318Z 2024-04-05T01:43:00.872809579Z 2024-04-05T01:43:00.872813103Z [2024-04-05T01:43:00.872+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:43:00.872894379Z [2024-04-05T01:43:00.872+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:43:00.872929870Z [2024-04-05T01:43:00.872+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:43:00.873563899Z [2024-04-05T01:43:00.873+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:43:00.873578690Z 2024-04-05T01:43:00.873582662Z 2024-04-05T01:43:00.873586145Z 2024-04-05T01:43:00.876723411Z [2024-04-05T01:43:00.876+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:43:00.876789548Z [2024-04-05T01:43:00.876+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:43:00.877000923Z [2024-04-05T01:43:00.876+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:43:00.877066157Z [2024-04-05T01:43:00.876+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:43:00.877244224Z [2024-04-05T01:43:00.877+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:43:00.877285245Z [2024-04-05T01:43:00.877+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:43:01.378869425Z [2024-04-05T01:43:01.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:42:00+00:00 exited with status queued for try_number 1 2024-04-05T01:43:01.378918855Z [2024-04-05T01:43:01.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:42:00+00:00 exited with status queued for try_number 1 2024-04-05T01:43:01.378927715Z [2024-04-05T01:43:01.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:42:00+00:00 exited with status queued for try_number 1 2024-04-05T01:43:01.390205220Z [2024-04-05T01:43:01.389+0000] {scheduler_job.py:635} INFO - Setting external_id for to e93f3d57-1cad-4439-8756-93d4925a1446 2024-04-05T01:43:01.390245494Z [2024-04-05T01:43:01.390+0000] {scheduler_job.py:635} INFO - Setting external_id for to 527ca11d-e6da-4390-80c2-efe344875492 2024-04-05T01:43:01.390340453Z [2024-04-05T01:43:01.390+0000] {scheduler_job.py:635} INFO - Setting external_id for to c75f3d57-d19b-49ca-80c6-f839bc50ee4c 2024-04-05T01:43:03.293315486Z [2024-04-05T01:43:03.292+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:43:03.296068084Z [2024-04-05T01:43:03.295+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:42:00+00:00, run_id=scheduled__2024-04-05T01:42:00+00:00, run_start_date=2024-04-05 01:43:00.812221+00:00, run_end_date=2024-04-05 01:43:03.295298+00:00, run_duration=2.483077, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:42:00+00:00, data_interval_end=2024-04-05 01:43:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:43:03.314653033Z [2024-04-05T01:43:03.314+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:43:00+00:00, run_after=2024-04-05T01:44:00+00:00 2024-04-05T01:43:03.394350230Z [2024-04-05T01:43:03.393+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:42:00+00:00 exited with status success for try_number 1 2024-04-05T01:43:03.402354298Z [2024-04-05T01:43:03.401+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:42:00+00:00, map_index=-1, run_start_date=2024-04-05 01:43:02.655978+00:00, run_end_date=2024-04-05 01:43:03.151270+00:00, run_duration=0.495292, state=success, executor_state=success, try_number=1, max_tries=1, job_id=863, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:43:00.874233+00:00, queued_by_job_id=1, pid=12653 2024-04-05T01:43:07.025516345Z [2024-04-05T01:43:07.025+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:43:07.025791256Z [2024-04-05T01:43:07.025+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:42:00+00:00, run_id=scheduled__2024-04-05T01:42:00+00:00, run_start_date=2024-04-05 01:43:00.813650+00:00, run_end_date=2024-04-05 01:43:07.025455+00:00, run_duration=6.211805, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:42:00+00:00, data_interval_end=2024-04-05 01:43:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:43:07.034097139Z [2024-04-05T01:43:07.033+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:43:00+00:00, run_after=2024-04-05T01:44:00+00:00 2024-04-05T01:43:07.236033299Z [2024-04-05T01:43:07.235+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:43:07.236418785Z [2024-04-05T01:43:07.236+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:42:00+00:00, run_id=scheduled__2024-04-05T01:42:00+00:00, run_start_date=2024-04-05 01:43:00.814877+00:00, run_end_date=2024-04-05 01:43:07.235920+00:00, run_duration=6.421043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:42:00+00:00, data_interval_end=2024-04-05 01:43:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:43:07.248913120Z [2024-04-05T01:43:07.248+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:43:00+00:00, run_after=2024-04-05T01:44:00+00:00 2024-04-05T01:43:07.278040276Z [2024-04-05T01:43:07.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:42:00+00:00 exited with status success for try_number 1 2024-04-05T01:43:07.278327541Z [2024-04-05T01:43:07.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:42:00+00:00 exited with status success for try_number 1 2024-04-05T01:43:07.285239067Z [2024-04-05T01:43:07.284+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:42:00+00:00, map_index=-1, run_start_date=2024-04-05 01:43:03.759416+00:00, run_end_date=2024-04-05 01:43:06.940256+00:00, run_duration=3.18084, state=success, executor_state=success, try_number=1, max_tries=1, job_id=864, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:43:00.874233+00:00, queued_by_job_id=1, pid=12666 2024-04-05T01:43:07.285652904Z [2024-04-05T01:43:07.285+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:42:00+00:00, map_index=-1, run_start_date=2024-04-05 01:43:04.237485+00:00, run_end_date=2024-04-05 01:43:06.993296+00:00, run_duration=2.755811, state=success, executor_state=success, try_number=1, max_tries=1, job_id=865, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:43:00.874233+00:00, queued_by_job_id=1, pid=12677 2024-04-05T01:44:00.142336017Z [2024-04-05T01:44:00.141+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:44:00+00:00, run_after=2024-04-05T01:45:00+00:00 2024-04-05T01:44:00.148919502Z [2024-04-05T01:44:00.148+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:44:00.155050277Z [2024-04-05T01:44:00.154+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:44:00.165691781Z [2024-04-05T01:44:00.165+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:44:00+00:00, run_after=2024-04-05T01:45:00+00:00 2024-04-05T01:44:00.228614838Z [2024-04-05T01:44:00.228+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:44:00.228692516Z 2024-04-05T01:44:00.228703618Z 2024-04-05T01:44:00.228712338Z 2024-04-05T01:44:00.228721200Z 2024-04-05T01:44:00.228745732Z [2024-04-05T01:44:00.228+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:44:00.228951507Z [2024-04-05T01:44:00.228+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:44:00.229088020Z [2024-04-05T01:44:00.228+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:44:00.229267570Z [2024-04-05T01:44:00.229+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:44:00.229858324Z [2024-04-05T01:44:00.229+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:44:00.229896323Z 2024-04-05T01:44:00.229906742Z 2024-04-05T01:44:00.229916867Z 2024-04-05T01:44:00.229925436Z 2024-04-05T01:44:00.233320131Z [2024-04-05T01:44:00.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:44:00.233498827Z [2024-04-05T01:44:00.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:44:00.233793934Z [2024-04-05T01:44:00.233+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:44:00.233911474Z [2024-04-05T01:44:00.233+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:44:00.234256773Z [2024-04-05T01:44:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:44:00.234416334Z [2024-04-05T01:44:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:44:00.234691578Z [2024-04-05T01:44:00.234+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:44:00.234804594Z [2024-04-05T01:44:00.234+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:44:00.725306136Z [2024-04-05T01:44:00.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:42:00+00:00 exited with status queued for try_number 1 2024-04-05T01:44:00.725515763Z [2024-04-05T01:44:00.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:43:00+00:00 exited with status queued for try_number 1 2024-04-05T01:44:00.725668284Z [2024-04-05T01:44:00.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:43:00+00:00 exited with status queued for try_number 1 2024-04-05T01:44:00.725852857Z [2024-04-05T01:44:00.725+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:43:00+00:00 exited with status queued for try_number 1 2024-04-05T01:44:00.747101822Z [2024-04-05T01:44:00.746+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1aa1096f-29b4-4059-98a2-9bb4a513ca48 2024-04-05T01:44:00.747333909Z [2024-04-05T01:44:00.747+0000] {scheduler_job.py:635} INFO - Setting external_id for to c45db53c-2872-43bb-b40e-2f1a62ad8af9 2024-04-05T01:44:00.747540398Z [2024-04-05T01:44:00.747+0000] {scheduler_job.py:635} INFO - Setting external_id for to b17e8f45-ae5a-46ed-9d40-4392f4a9a323 2024-04-05T01:44:00.747753490Z [2024-04-05T01:44:00.747+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc88de08-f332-48ef-98a4-93e18bc8c7a8 2024-04-05T01:44:03.127880944Z [2024-04-05T01:44:03.127+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:44:03.128281827Z [2024-04-05T01:44:03.128+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:43:00+00:00, run_id=scheduled__2024-04-05T01:43:00+00:00, run_start_date=2024-04-05 01:44:00.176371+00:00, run_end_date=2024-04-05 01:44:03.127796+00:00, run_duration=2.951425, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:43:00+00:00, data_interval_end=2024-04-05 01:44:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:44:03.140838740Z [2024-04-05T01:44:03.140+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:44:00+00:00, run_after=2024-04-05T01:45:00+00:00 2024-04-05T01:44:03.149829967Z [2024-04-05T01:44:03.149+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:44:03.150069967Z [2024-04-05T01:44:03.149+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:42:00+00:00, run_id=scheduled__2024-04-05T01:42:00+00:00, run_start_date=2024-04-05 01:44:00.175184+00:00, run_end_date=2024-04-05 01:44:03.149726+00:00, run_duration=2.974542, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:42:00+00:00, data_interval_end=2024-04-05 01:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:44:03.160122984Z [2024-04-05T01:44:03.159+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:44:00+00:00, run_after=2024-04-05T01:46:00+00:00 2024-04-05T01:44:03.223158072Z [2024-04-05T01:44:03.222+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:42:00+00:00 exited with status success for try_number 1 2024-04-05T01:44:03.223592374Z [2024-04-05T01:44:03.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:43:00+00:00 exited with status success for try_number 1 2024-04-05T01:44:03.231745143Z [2024-04-05T01:44:03.231+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:42:00+00:00, map_index=-1, run_start_date=2024-04-05 01:44:01.130004+00:00, run_end_date=2024-04-05 01:44:02.252305+00:00, run_duration=1.122301, state=success, executor_state=success, try_number=1, max_tries=1, job_id=866, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:44:00.230660+00:00, queued_by_job_id=1, pid=12706 2024-04-05T01:44:03.231958913Z [2024-04-05T01:44:03.231+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:43:00+00:00, map_index=-1, run_start_date=2024-04-05 01:44:01.665619+00:00, run_end_date=2024-04-05 01:44:02.674151+00:00, run_duration=1.008532, state=success, executor_state=success, try_number=1, max_tries=1, job_id=867, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:44:00.230660+00:00, queued_by_job_id=1, pid=12707 2024-04-05T01:44:05.146236955Z [2024-04-05T01:44:05.145+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:44:05.146667921Z [2024-04-05T01:44:05.146+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:43:00+00:00, run_id=scheduled__2024-04-05T01:43:00+00:00, run_start_date=2024-04-05 01:44:00.177399+00:00, run_end_date=2024-04-05 01:44:05.146127+00:00, run_duration=4.968728, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:43:00+00:00, data_interval_end=2024-04-05 01:44:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:44:05.161513844Z [2024-04-05T01:44:05.161+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:44:00+00:00, run_after=2024-04-05T01:45:00+00:00 2024-04-05T01:44:05.212549476Z [2024-04-05T01:44:05.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:43:00+00:00 exited with status success for try_number 1 2024-04-05T01:44:05.221274624Z [2024-04-05T01:44:05.220+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:43:00+00:00, map_index=-1, run_start_date=2024-04-05 01:44:02.935561+00:00, run_end_date=2024-04-05 01:44:04.585412+00:00, run_duration=1.649851, state=success, executor_state=success, try_number=1, max_tries=1, job_id=868, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:44:00.230660+00:00, queued_by_job_id=1, pid=12725 2024-04-05T01:44:07.348480620Z [2024-04-05T01:44:07.347+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:44:07.348830990Z [2024-04-05T01:44:07.348+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:43:00+00:00, run_id=scheduled__2024-04-05T01:43:00+00:00, run_start_date=2024-04-05 01:44:00.178367+00:00, run_end_date=2024-04-05 01:44:07.348478+00:00, run_duration=7.170111, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:43:00+00:00, data_interval_end=2024-04-05 01:44:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:44:07.359610017Z [2024-04-05T01:44:07.359+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:44:00+00:00, run_after=2024-04-05T01:45:00+00:00 2024-04-05T01:44:07.400667714Z [2024-04-05T01:44:07.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:43:00+00:00 exited with status success for try_number 1 2024-04-05T01:44:07.408692391Z [2024-04-05T01:44:07.408+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:43:00+00:00, map_index=-1, run_start_date=2024-04-05 01:44:03.791478+00:00, run_end_date=2024-04-05 01:44:07.210322+00:00, run_duration=3.418844, state=success, executor_state=success, try_number=1, max_tries=1, job_id=869, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:44:00.230660+00:00, queued_by_job_id=1, pid=12736 2024-04-05T01:45:00.580846620Z [2024-04-05T01:45:00.580+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:45:00+00:00, run_after=2024-04-05T01:50:00+00:00 2024-04-05T01:45:00.627464500Z [2024-04-05T01:45:00.627+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:45:00+00:00, run_after=2024-04-05T01:46:00+00:00 2024-04-05T01:45:00.658841545Z [2024-04-05T01:45:00.658+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:45:00.690488276Z [2024-04-05T01:45:00.690+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:45:00+00:00, run_after=2024-04-05T01:46:00+00:00 2024-04-05T01:45:01.089194581Z [2024-04-05T01:45:01.088+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:45:01.089221879Z 2024-04-05T01:45:01.089225991Z 2024-04-05T01:45:01.089229485Z 2024-04-05T01:45:01.089232857Z 2024-04-05T01:45:01.096379559Z [2024-04-05T01:45:01.089+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:45:01.109403767Z [2024-04-05T01:45:01.108+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:45:01.109771196Z [2024-04-05T01:45:01.109+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:45:01.110084099Z [2024-04-05T01:45:01.109+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:45:01.111106842Z [2024-04-05T01:45:01.110+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:45:01.111121000Z 2024-04-05T01:45:01.111124934Z 2024-04-05T01:45:01.111128254Z 2024-04-05T01:45:01.111134624Z 2024-04-05T01:45:01.120842154Z [2024-04-05T01:45:01.120+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:45:01.121026386Z [2024-04-05T01:45:01.120+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:45:01.121250465Z [2024-04-05T01:45:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:45:01.121361545Z [2024-04-05T01:45:01.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:45:01.121684165Z [2024-04-05T01:45:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:45:01.121816397Z [2024-04-05T01:45:01.121+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:45:01.122106113Z [2024-04-05T01:45:01.121+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:45:01.122251053Z [2024-04-05T01:45:01.122+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:45:02.138575376Z [2024-04-05T01:45:02.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status queued for try_number 1 2024-04-05T01:45:02.138848237Z [2024-04-05T01:45:02.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:44:00+00:00 exited with status queued for try_number 1 2024-04-05T01:45:02.139022075Z [2024-04-05T01:45:02.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:44:00+00:00 exited with status queued for try_number 1 2024-04-05T01:45:02.139168385Z [2024-04-05T01:45:02.138+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:44:00+00:00 exited with status queued for try_number 1 2024-04-05T01:45:02.162178337Z [2024-04-05T01:45:02.161+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b4c5142-0879-43f2-8cd4-b7a5b554dd2c 2024-04-05T01:45:02.163997202Z [2024-04-05T01:45:02.162+0000] {scheduler_job.py:635} INFO - Setting external_id for to 817b632d-1b7a-48df-87d8-09ec0f96ffae 2024-04-05T01:45:02.164447699Z [2024-04-05T01:45:02.164+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99052bf2-11b2-4b9d-9b5e-f533673fbc0c 2024-04-05T01:45:02.164751056Z [2024-04-05T01:45:02.164+0000] {scheduler_job.py:635} INFO - Setting external_id for to c3e9f024-77a5-4dfa-9d7d-454f3070abc3 2024-04-05T01:45:05.461557937Z [2024-04-05T01:45:05.460+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:45:05.462388398Z [2024-04-05T01:45:05.461+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:44:00+00:00, run_id=scheduled__2024-04-05T01:44:00+00:00, run_start_date=2024-04-05 01:45:00.758036+00:00, run_end_date=2024-04-05 01:45:05.461688+00:00, run_duration=4.703652, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:44:00+00:00, data_interval_end=2024-04-05 01:45:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:45:05.485431972Z [2024-04-05T01:45:05.484+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:45:00+00:00, run_after=2024-04-05T01:46:00+00:00 2024-04-05T01:45:05.574374768Z [2024-04-05T01:45:05.573+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:45:05.574410063Z 2024-04-05T01:45:05.574752948Z [2024-04-05T01:45:05.574+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:45:05.576112808Z [2024-04-05T01:45:05.575+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:45:05.576132750Z 2024-04-05T01:45:05.580691177Z [2024-04-05T01:45:05.580+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:45:05.580980476Z [2024-04-05T01:45:05.580+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:45:05.676183033Z [2024-04-05T01:45:05.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status queued for try_number 1 2024-04-05T01:45:05.676737055Z [2024-04-05T01:45:05.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status success for try_number 1 2024-04-05T01:45:05.677206835Z [2024-04-05T01:45:05.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:44:00+00:00 exited with status success for try_number 1 2024-04-05T01:45:05.701040622Z [2024-04-05T01:45:05.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:44:00+00:00, map_index=-1, run_start_date=2024-04-05 01:45:03.455183+00:00, run_end_date=2024-04-05 01:45:04.474385+00:00, run_duration=1.019202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=870, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:45:01.112943+00:00, queued_by_job_id=1, pid=12766 2024-04-05T01:45:05.701439300Z [2024-04-05T01:45:05.700+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:40:00+00:00, map_index=-1, run_start_date=2024-04-05 01:45:04.681715+00:00, run_end_date=2024-04-05 01:45:05.306097+00:00, run_duration=0.624382, state=success, executor_state=success, try_number=1, max_tries=1, job_id=871, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:45:01.112943+00:00, queued_by_job_id=1, pid=12779 2024-04-05T01:45:05.701830698Z [2024-04-05T01:45:05.701+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8a34318c-101f-4d58-b9e0-ff9cb38b9b83 2024-04-05T01:45:08.078182564Z [2024-04-05T01:45:08.077+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:45:08.078585815Z [2024-04-05T01:45:08.078+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:44:00+00:00, run_id=scheduled__2024-04-05T01:44:00+00:00, run_start_date=2024-04-05 01:45:00.768139+00:00, run_end_date=2024-04-05 01:45:08.078117+00:00, run_duration=7.309978, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:44:00+00:00, data_interval_end=2024-04-05 01:45:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:45:08.093129841Z [2024-04-05T01:45:08.092+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:45:00+00:00, run_after=2024-04-05T01:46:00+00:00 2024-04-05T01:45:08.107717672Z [2024-04-05T01:45:08.104+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:45:08.107746050Z [2024-04-05T01:45:08.105+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:44:00+00:00, run_id=scheduled__2024-04-05T01:44:00+00:00, run_start_date=2024-04-05 01:45:00.776138+00:00, run_end_date=2024-04-05 01:45:08.105033+00:00, run_duration=7.328895, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:44:00+00:00, data_interval_end=2024-04-05 01:45:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:45:08.117430238Z [2024-04-05T01:45:08.117+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:45:00+00:00, run_after=2024-04-05T01:46:00+00:00 2024-04-05T01:45:08.175957507Z [2024-04-05T01:45:08.175+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:45:08.175998374Z 2024-04-05T01:45:08.176140878Z [2024-04-05T01:45:08.175+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:45:08.177067175Z [2024-04-05T01:45:08.176+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:45:08.177109562Z 2024-04-05T01:45:08.179911182Z [2024-04-05T01:45:08.179+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:45:08.180250797Z [2024-04-05T01:45:08.180+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:45:08.252399464Z [2024-04-05T01:45:08.251+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status queued for try_number 1 2024-04-05T01:45:08.252581284Z [2024-04-05T01:45:08.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:44:00+00:00 exited with status success for try_number 1 2024-04-05T01:45:08.252834340Z [2024-04-05T01:45:08.252+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:44:00+00:00 exited with status success for try_number 1 2024-04-05T01:45:08.267231314Z [2024-04-05T01:45:08.266+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:44:00+00:00, map_index=-1, run_start_date=2024-04-05 01:45:05.519893+00:00, run_end_date=2024-04-05 01:45:07.037843+00:00, run_duration=1.51795, state=success, executor_state=success, try_number=1, max_tries=1, job_id=872, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:45:01.112943+00:00, queued_by_job_id=1, pid=12795 2024-04-05T01:45:08.267928572Z [2024-04-05T01:45:08.267+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:44:00+00:00, map_index=-1, run_start_date=2024-04-05 01:45:05.555881+00:00, run_end_date=2024-04-05 01:45:07.755482+00:00, run_duration=2.199601, state=success, executor_state=success, try_number=1, max_tries=1, job_id=873, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:45:01.112943+00:00, queued_by_job_id=1, pid=12796 2024-04-05T01:45:08.268416196Z [2024-04-05T01:45:08.268+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7284e2d7-7574-4f4c-b5d9-d2cefca0a259 2024-04-05T01:45:08.370657333Z [2024-04-05T01:45:08.370+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status success for try_number 1 2024-04-05T01:45:08.377727433Z [2024-04-05T01:45:08.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T01:40:00+00:00, map_index=-1, run_start_date=2024-04-05 01:45:07.627500+00:00, run_end_date=2024-04-05 01:45:08.041014+00:00, run_duration=0.413514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=874, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:45:05.576873+00:00, queued_by_job_id=1, pid=12814 2024-04-05T01:45:10.774880052Z [2024-04-05T01:45:10.774+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:45:10.774931861Z 2024-04-05T01:45:10.775411093Z [2024-04-05T01:45:10.775+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:45:10.776199720Z [2024-04-05T01:45:10.775+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:45:10.776211854Z 2024-04-05T01:45:10.779232435Z [2024-04-05T01:45:10.778+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:45:10.779589178Z [2024-04-05T01:45:10.779+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:45:10.872695594Z [2024-04-05T01:45:10.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status queued for try_number 1 2024-04-05T01:45:10.874995692Z [2024-04-05T01:45:10.872+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status success for try_number 1 2024-04-05T01:45:10.882631457Z [2024-04-05T01:45:10.882+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0d35f04b-d9d1-432d-a9ae-0c14ef877537 2024-04-05T01:45:10.883045661Z [2024-04-05T01:45:10.882+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:40:00+00:00, map_index=0, run_start_date=2024-04-05 01:45:10.316864+00:00, run_end_date=2024-04-05 01:45:10.679963+00:00, run_duration=0.363099, state=success, executor_state=success, try_number=1, max_tries=1, job_id=875, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:45:08.177585+00:00, queued_by_job_id=1, pid=12832 2024-04-05T01:45:14.264491064Z [2024-04-05T01:45:14.263+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:45:14.264826886Z [2024-04-05T01:45:14.264+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:40:00+00:00, run_id=scheduled__2024-04-05T01:40:00+00:00, run_start_date=2024-04-05 01:45:00.748324+00:00, run_end_date=2024-04-05 01:45:14.264329+00:00, run_duration=13.516005, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:40:00+00:00, data_interval_end=2024-04-05 01:45:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T01:45:14.275271631Z [2024-04-05T01:45:14.274+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:45:00+00:00, run_after=2024-04-05T01:50:00+00:00 2024-04-05T01:45:14.311489115Z [2024-04-05T01:45:14.310+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:40:00+00:00 exited with status success for try_number 1 2024-04-05T01:45:14.317667977Z [2024-04-05T01:45:14.317+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:40:00+00:00, map_index=-1, run_start_date=2024-04-05 01:45:12.804396+00:00, run_end_date=2024-04-05 01:45:13.115910+00:00, run_duration=0.311514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=876, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:45:10.776891+00:00, queued_by_job_id=1, pid=12843 2024-04-05T01:45:41.492308974Z [2024-04-05T01:45:41.491+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T01:46:00.053789303Z [2024-04-05T01:46:00.053+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:46:00+00:00, run_after=2024-04-05T01:47:00+00:00 2024-04-05T01:46:00.064173344Z [2024-04-05T01:46:00.063+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:46:00.073463316Z [2024-04-05T01:46:00.073+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:46:00.086831304Z [2024-04-05T01:46:00.086+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:46:00+00:00, run_after=2024-04-05T01:47:00+00:00 2024-04-05T01:46:00.165745575Z [2024-04-05T01:46:00.165+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:46:00.165769921Z 2024-04-05T01:46:00.165780281Z 2024-04-05T01:46:00.165784085Z 2024-04-05T01:46:00.165787608Z 2024-04-05T01:46:00.165799310Z [2024-04-05T01:46:00.165+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:46:00.166064645Z [2024-04-05T01:46:00.165+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:46:00.166292369Z [2024-04-05T01:46:00.166+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:46:00.166409661Z [2024-04-05T01:46:00.166+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:46:00.167287868Z [2024-04-05T01:46:00.167+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:46:00.167300493Z 2024-04-05T01:46:00.167304255Z 2024-04-05T01:46:00.167307315Z 2024-04-05T01:46:00.167310235Z 2024-04-05T01:46:00.170909013Z [2024-04-05T01:46:00.170+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:46:00.171047008Z [2024-04-05T01:46:00.170+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:46:00.171374200Z [2024-04-05T01:46:00.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:46:00.171409123Z [2024-04-05T01:46:00.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:46:00.171747485Z [2024-04-05T01:46:00.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:46:00.171890434Z [2024-04-05T01:46:00.171+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:46:00.172103948Z [2024-04-05T01:46:00.171+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:46:00.172248484Z [2024-04-05T01:46:00.172+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:46:00.730322904Z [2024-04-05T01:46:00.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:44:00+00:00 exited with status queued for try_number 1 2024-04-05T01:46:00.730739456Z [2024-04-05T01:46:00.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status queued for try_number 1 2024-04-05T01:46:00.730856470Z [2024-04-05T01:46:00.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status queued for try_number 1 2024-04-05T01:46:00.730987795Z [2024-04-05T01:46:00.730+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status queued for try_number 1 2024-04-05T01:46:00.755086327Z [2024-04-05T01:46:00.754+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2d51f2ef-81b3-4fd2-a18e-9867aa297dab 2024-04-05T01:46:00.755437864Z [2024-04-05T01:46:00.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to 796d5ca3-5738-43fd-a598-ad3def941b03 2024-04-05T01:46:00.755726912Z [2024-04-05T01:46:00.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to 985543c8-a020-440f-b0f5-9335e74b464b 2024-04-05T01:46:00.755945917Z [2024-04-05T01:46:00.755+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3dd32c91-d38c-47c5-bca1-6168da3b6066 2024-04-05T01:46:03.332969515Z [2024-04-05T01:46:03.332+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:46:03.333458221Z [2024-04-05T01:46:03.333+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:44:00+00:00, run_id=scheduled__2024-04-05T01:44:00+00:00, run_start_date=2024-04-05 01:46:00.099137+00:00, run_end_date=2024-04-05 01:46:03.332845+00:00, run_duration=3.233708, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:44:00+00:00, data_interval_end=2024-04-05 01:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:46:03.343205308Z [2024-04-05T01:46:03.342+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:46:00+00:00, run_after=2024-04-05T01:48:00+00:00 2024-04-05T01:46:03.352108372Z [2024-04-05T01:46:03.351+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:46:03.352747965Z [2024-04-05T01:46:03.352+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:45:00+00:00, run_id=scheduled__2024-04-05T01:45:00+00:00, run_start_date=2024-04-05 01:46:00.100413+00:00, run_end_date=2024-04-05 01:46:03.352235+00:00, run_duration=3.251822, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:45:00+00:00, data_interval_end=2024-04-05 01:46:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:46:03.368385732Z [2024-04-05T01:46:03.368+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:46:00+00:00, run_after=2024-04-05T01:47:00+00:00 2024-04-05T01:46:03.429108413Z [2024-04-05T01:46:03.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:44:00+00:00 exited with status success for try_number 1 2024-04-05T01:46:03.429426224Z [2024-04-05T01:46:03.428+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status success for try_number 1 2024-04-05T01:46:03.437375277Z [2024-04-05T01:46:03.436+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:44:00+00:00, map_index=-1, run_start_date=2024-04-05 01:46:02.188559+00:00, run_end_date=2024-04-05 01:46:02.797923+00:00, run_duration=0.609364, state=success, executor_state=success, try_number=1, max_tries=1, job_id=878, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:46:00.168135+00:00, queued_by_job_id=1, pid=12856 2024-04-05T01:46:03.437736654Z [2024-04-05T01:46:03.437+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:45:00+00:00, map_index=-1, run_start_date=2024-04-05 01:46:02.093779+00:00, run_end_date=2024-04-05 01:46:02.684936+00:00, run_duration=0.591157, state=success, executor_state=success, try_number=1, max_tries=1, job_id=877, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:46:00.168135+00:00, queued_by_job_id=1, pid=12855 2024-04-05T01:46:05.609974099Z [2024-04-05T01:46:05.609+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:46:05.610279357Z [2024-04-05T01:46:05.610+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:45:00+00:00, run_id=scheduled__2024-04-05T01:45:00+00:00, run_start_date=2024-04-05 01:46:00.102530+00:00, run_end_date=2024-04-05 01:46:05.609906+00:00, run_duration=5.507376, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:45:00+00:00, data_interval_end=2024-04-05 01:46:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:46:05.624334370Z [2024-04-05T01:46:05.623+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:46:00+00:00, run_after=2024-04-05T01:47:00+00:00 2024-04-05T01:46:05.634820303Z [2024-04-05T01:46:05.634+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:46:05.635032528Z [2024-04-05T01:46:05.634+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:45:00+00:00, run_id=scheduled__2024-04-05T01:45:00+00:00, run_start_date=2024-04-05 01:46:00.103723+00:00, run_end_date=2024-04-05 01:46:05.634707+00:00, run_duration=5.530984, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:45:00+00:00, data_interval_end=2024-04-05 01:46:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:46:05.647667366Z [2024-04-05T01:46:05.647+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:46:00+00:00, run_after=2024-04-05T01:47:00+00:00 2024-04-05T01:46:05.687335620Z [2024-04-05T01:46:05.686+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status success for try_number 1 2024-04-05T01:46:05.687370184Z [2024-04-05T01:46:05.687+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status success for try_number 1 2024-04-05T01:46:05.695253746Z [2024-04-05T01:46:05.694+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:45:00+00:00, map_index=-1, run_start_date=2024-04-05 01:46:03.103736+00:00, run_end_date=2024-04-05 01:46:04.636923+00:00, run_duration=1.533187, state=success, executor_state=success, try_number=1, max_tries=1, job_id=880, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:46:00.168135+00:00, queued_by_job_id=1, pid=12878 2024-04-05T01:46:05.695542595Z [2024-04-05T01:46:05.695+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:45:00+00:00, map_index=-1, run_start_date=2024-04-05 01:46:03.073792+00:00, run_end_date=2024-04-05 01:46:04.904149+00:00, run_duration=1.830357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=879, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:46:00.168135+00:00, queued_by_job_id=1, pid=12877 2024-04-05T01:47:00.277916439Z [2024-04-05T01:47:00.277+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:47:00+00:00, run_after=2024-04-05T01:48:00+00:00 2024-04-05T01:47:00.304346523Z [2024-04-05T01:47:00.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:47:00+00:00, run_after=2024-04-05T01:48:00+00:00 2024-04-05T01:47:00.325002697Z [2024-04-05T01:47:00.324+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:47:00.445392111Z [2024-04-05T01:47:00.445+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:47:00.445422490Z 2024-04-05T01:47:00.445427042Z 2024-04-05T01:47:00.445430563Z 2024-04-05T01:47:00.445502264Z [2024-04-05T01:47:00.445+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:47:00.445531455Z [2024-04-05T01:47:00.445+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:47:00.445594195Z [2024-04-05T01:47:00.445+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:47:00.446142875Z [2024-04-05T01:47:00.445+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:47:00.446158858Z 2024-04-05T01:47:00.446162329Z 2024-04-05T01:47:00.446165852Z 2024-04-05T01:47:00.450424659Z [2024-04-05T01:47:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:47:00.450541453Z [2024-04-05T01:47:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:47:00.450833620Z [2024-04-05T01:47:00.450+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:47:00.450950010Z [2024-04-05T01:47:00.450+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:47:00.451195938Z [2024-04-05T01:47:00.451+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:47:00.451331334Z [2024-04-05T01:47:00.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:47:00.817452260Z [2024-04-05T01:47:00.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:46:00+00:00 exited with status queued for try_number 1 2024-04-05T01:47:00.817801159Z [2024-04-05T01:47:00.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:46:00+00:00 exited with status queued for try_number 1 2024-04-05T01:47:00.818038894Z [2024-04-05T01:47:00.817+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:46:00+00:00 exited with status queued for try_number 1 2024-04-05T01:47:00.825671224Z [2024-04-05T01:47:00.825+0000] {scheduler_job.py:635} INFO - Setting external_id for to 52a8f77c-9501-4a30-9153-b0c7b3403639 2024-04-05T01:47:00.826073737Z [2024-04-05T01:47:00.825+0000] {scheduler_job.py:635} INFO - Setting external_id for to 839a2179-b4bb-4d02-98ad-9c2168b434a4 2024-04-05T01:47:00.826347774Z [2024-04-05T01:47:00.826+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1969f635-09d7-47e5-80c8-fd3030132d35 2024-04-05T01:47:04.111941177Z [2024-04-05T01:47:04.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:47:04.112696063Z [2024-04-05T01:47:04.112+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:46:00+00:00, run_id=scheduled__2024-04-05T01:46:00+00:00, run_start_date=2024-04-05 01:47:00.343475+00:00, run_end_date=2024-04-05 01:47:04.111841+00:00, run_duration=3.768366, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:46:00+00:00, data_interval_end=2024-04-05 01:47:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:47:04.136165202Z [2024-04-05T01:47:04.135+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:47:00+00:00, run_after=2024-04-05T01:48:00+00:00 2024-04-05T01:47:04.227822274Z [2024-04-05T01:47:04.224+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:46:00+00:00 exited with status success for try_number 1 2024-04-05T01:47:04.230774418Z [2024-04-05T01:47:04.230+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:46:00+00:00, map_index=-1, run_start_date=2024-04-05 01:47:02.326692+00:00, run_end_date=2024-04-05 01:47:03.188412+00:00, run_duration=0.86172, state=success, executor_state=success, try_number=1, max_tries=1, job_id=881, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:47:00.446781+00:00, queued_by_job_id=1, pid=12910 2024-04-05T01:47:09.203761072Z [2024-04-05T01:47:09.203+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:47:09.204128550Z [2024-04-05T01:47:09.203+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:46:00+00:00, run_id=scheduled__2024-04-05T01:46:00+00:00, run_start_date=2024-04-05 01:47:00.344930+00:00, run_end_date=2024-04-05 01:47:09.203761+00:00, run_duration=8.858831, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:46:00+00:00, data_interval_end=2024-04-05 01:47:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:47:09.213231946Z [2024-04-05T01:47:09.212+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:47:00+00:00, run_after=2024-04-05T01:48:00+00:00 2024-04-05T01:47:09.281891369Z [2024-04-05T01:47:09.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:46:00+00:00 exited with status success for try_number 1 2024-04-05T01:47:09.286214260Z [2024-04-05T01:47:09.284+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:46:00+00:00, map_index=-1, run_start_date=2024-04-05 01:47:04.410708+00:00, run_end_date=2024-04-05 01:47:07.879134+00:00, run_duration=3.468426, state=success, executor_state=success, try_number=1, max_tries=1, job_id=882, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:47:00.446781+00:00, queued_by_job_id=1, pid=12923 2024-04-05T01:47:10.364287855Z [2024-04-05T01:47:10.363+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:47:10.364497599Z [2024-04-05T01:47:10.364+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:46:00+00:00, run_id=scheduled__2024-04-05T01:46:00+00:00, run_start_date=2024-04-05 01:47:00.346017+00:00, run_end_date=2024-04-05 01:47:10.364184+00:00, run_duration=10.018167, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:46:00+00:00, data_interval_end=2024-04-05 01:47:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:47:10.374621782Z [2024-04-05T01:47:10.374+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:47:00+00:00, run_after=2024-04-05T01:48:00+00:00 2024-04-05T01:47:10.433168873Z [2024-04-05T01:47:10.432+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:46:00+00:00 exited with status success for try_number 1 2024-04-05T01:47:10.440909741Z [2024-04-05T01:47:10.440+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:46:00+00:00, map_index=-1, run_start_date=2024-04-05 01:47:05.037406+00:00, run_end_date=2024-04-05 01:47:09.437312+00:00, run_duration=4.399906, state=success, executor_state=success, try_number=1, max_tries=1, job_id=883, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:47:00.446781+00:00, queued_by_job_id=1, pid=12934 2024-04-05T01:48:00.761143655Z [2024-04-05T01:48:00.760+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:48:00.783746835Z [2024-04-05T01:48:00.783+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:48:00+00:00, run_after=2024-04-05T01:49:00+00:00 2024-04-05T01:48:00.795486805Z [2024-04-05T01:48:00.795+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:48:00.821025189Z [2024-04-05T01:48:00.820+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:48:00+00:00, run_after=2024-04-05T01:49:00+00:00 2024-04-05T01:48:00.929554674Z [2024-04-05T01:48:00.929+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:48:00.929582503Z 2024-04-05T01:48:00.929592035Z 2024-04-05T01:48:00.929616247Z 2024-04-05T01:48:00.929619900Z 2024-04-05T01:48:00.929901109Z [2024-04-05T01:48:00.929+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:48:00.930180687Z [2024-04-05T01:48:00.929+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:48:00.930388647Z [2024-04-05T01:48:00.930+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:48:00.930611289Z [2024-04-05T01:48:00.930+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:48:00.931748209Z [2024-04-05T01:48:00.931+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:48:00.931764994Z 2024-04-05T01:48:00.931770037Z 2024-04-05T01:48:00.931791936Z 2024-04-05T01:48:00.931796043Z 2024-04-05T01:48:00.944285532Z [2024-04-05T01:48:00.943+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:48:00.944864377Z [2024-04-05T01:48:00.944+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:48:00.945510903Z [2024-04-05T01:48:00.945+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:48:00.945886428Z [2024-04-05T01:48:00.945+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:48:00.946297737Z [2024-04-05T01:48:00.946+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:48:00.946506224Z [2024-04-05T01:48:00.946+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:48:00.946849082Z [2024-04-05T01:48:00.946+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:48:00.947090752Z [2024-04-05T01:48:00.946+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:48:01.657765075Z [2024-04-05T01:48:01.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:46:00+00:00 exited with status queued for try_number 1 2024-04-05T01:48:01.658344241Z [2024-04-05T01:48:01.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:47:00+00:00 exited with status queued for try_number 1 2024-04-05T01:48:01.658916588Z [2024-04-05T01:48:01.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:47:00+00:00 exited with status queued for try_number 1 2024-04-05T01:48:01.659207037Z [2024-04-05T01:48:01.658+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:47:00+00:00 exited with status queued for try_number 1 2024-04-05T01:48:01.679131100Z [2024-04-05T01:48:01.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2b9aa0b0-2fc9-475c-b959-5a6717c53d95 2024-04-05T01:48:01.679637226Z [2024-04-05T01:48:01.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1e5ad2e5-de43-43ae-9e12-657c75ca20aa 2024-04-05T01:48:01.680014268Z [2024-04-05T01:48:01.679+0000] {scheduler_job.py:635} INFO - Setting external_id for to 062ce222-196c-4bed-b26a-efa2c80d1cfa 2024-04-05T01:48:01.680414543Z [2024-04-05T01:48:01.680+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9b137b9-6f9d-4d83-9bd1-0551e3093a29 2024-04-05T01:48:03.943297540Z [2024-04-05T01:48:03.942+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:48:03.943873305Z [2024-04-05T01:48:03.943+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:46:00+00:00, run_id=scheduled__2024-04-05T01:46:00+00:00, run_start_date=2024-04-05 01:48:00.837042+00:00, run_end_date=2024-04-05 01:48:03.943287+00:00, run_duration=3.106245, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:46:00+00:00, data_interval_end=2024-04-05 01:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:48:03.966727995Z [2024-04-05T01:48:03.966+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:48:00+00:00, run_after=2024-04-05T01:50:00+00:00 2024-04-05T01:48:03.985225467Z [2024-04-05T01:48:03.984+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:48:03.985737469Z [2024-04-05T01:48:03.985+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:47:00+00:00, run_id=scheduled__2024-04-05T01:47:00+00:00, run_start_date=2024-04-05 01:48:00.839139+00:00, run_end_date=2024-04-05 01:48:03.985183+00:00, run_duration=3.146044, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:47:00+00:00, data_interval_end=2024-04-05 01:48:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:48:04.005030441Z [2024-04-05T01:48:04.004+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:48:00+00:00, run_after=2024-04-05T01:49:00+00:00 2024-04-05T01:48:04.086137104Z [2024-04-05T01:48:04.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:46:00+00:00 exited with status success for try_number 1 2024-04-05T01:48:04.086491112Z [2024-04-05T01:48:04.085+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:47:00+00:00 exited with status success for try_number 1 2024-04-05T01:48:04.099431809Z [2024-04-05T01:48:04.098+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:47:00+00:00, map_index=-1, run_start_date=2024-04-05 01:48:02.477830+00:00, run_end_date=2024-04-05 01:48:03.131170+00:00, run_duration=0.65334, state=success, executor_state=success, try_number=1, max_tries=1, job_id=884, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:48:00.937354+00:00, queued_by_job_id=1, pid=12962 2024-04-05T01:48:04.100029688Z [2024-04-05T01:48:04.099+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:46:00+00:00, map_index=-1, run_start_date=2024-04-05 01:48:02.870386+00:00, run_end_date=2024-04-05 01:48:03.398268+00:00, run_duration=0.527882, state=success, executor_state=success, try_number=1, max_tries=1, job_id=885, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:48:00.937354+00:00, queued_by_job_id=1, pid=12964 2024-04-05T01:48:06.264804374Z [2024-04-05T01:48:06.263+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:48:06.264856168Z [2024-04-05T01:48:06.264+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:47:00+00:00, run_id=scheduled__2024-04-05T01:47:00+00:00, run_start_date=2024-04-05 01:48:00.841640+00:00, run_end_date=2024-04-05 01:48:06.264070+00:00, run_duration=5.42243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:47:00+00:00, data_interval_end=2024-04-05 01:48:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:48:06.274599606Z [2024-04-05T01:48:06.274+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:48:00+00:00, run_after=2024-04-05T01:49:00+00:00 2024-04-05T01:48:06.322947185Z [2024-04-05T01:48:06.321+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:47:00+00:00 exited with status success for try_number 1 2024-04-05T01:48:06.328916184Z [2024-04-05T01:48:06.328+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:47:00+00:00, map_index=-1, run_start_date=2024-04-05 01:48:03.923381+00:00, run_end_date=2024-04-05 01:48:05.450813+00:00, run_duration=1.527432, state=success, executor_state=success, try_number=1, max_tries=1, job_id=886, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:48:00.937354+00:00, queued_by_job_id=1, pid=12981 2024-04-05T01:48:06.684628775Z [2024-04-05T01:48:06.684+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:48:06.684841615Z [2024-04-05T01:48:06.684+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:47:00+00:00, run_id=scheduled__2024-04-05T01:47:00+00:00, run_start_date=2024-04-05 01:48:00.843627+00:00, run_end_date=2024-04-05 01:48:06.684385+00:00, run_duration=5.840758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:47:00+00:00, data_interval_end=2024-04-05 01:48:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:48:06.695090812Z [2024-04-05T01:48:06.694+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:48:00+00:00, run_after=2024-04-05T01:49:00+00:00 2024-04-05T01:48:06.739821622Z [2024-04-05T01:48:06.739+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:47:00+00:00 exited with status success for try_number 1 2024-04-05T01:48:06.746843957Z [2024-04-05T01:48:06.746+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:47:00+00:00, map_index=-1, run_start_date=2024-04-05 01:48:04.290141+00:00, run_end_date=2024-04-05 01:48:06.588443+00:00, run_duration=2.298302, state=success, executor_state=success, try_number=1, max_tries=1, job_id=887, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:48:00.937354+00:00, queued_by_job_id=1, pid=12992 2024-04-05T01:49:00.663395100Z [2024-04-05T01:49:00.663+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:49:00+00:00, run_after=2024-04-05T01:50:00+00:00 2024-04-05T01:49:00.680665708Z [2024-04-05T01:49:00.680+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:49:00+00:00, run_after=2024-04-05T01:50:00+00:00 2024-04-05T01:49:00.695001155Z [2024-04-05T01:49:00.694+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:49:00.762598760Z [2024-04-05T01:49:00.762+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:49:00.762632421Z 2024-04-05T01:49:00.762638807Z 2024-04-05T01:49:00.762644602Z 2024-04-05T01:49:00.763241619Z [2024-04-05T01:49:00.762+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:49:00.763500460Z [2024-04-05T01:49:00.763+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:49:00.763885315Z [2024-04-05T01:49:00.763+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:49:00.764753169Z [2024-04-05T01:49:00.764+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:49:00.764768388Z 2024-04-05T01:49:00.764777897Z 2024-04-05T01:49:00.764781227Z 2024-04-05T01:49:00.770302533Z [2024-04-05T01:49:00.769+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:49:00.771105282Z [2024-04-05T01:49:00.770+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:49:00.771656228Z [2024-04-05T01:49:00.771+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:49:00.771953338Z [2024-04-05T01:49:00.771+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:49:00.772527449Z [2024-04-05T01:49:00.772+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:49:00.772868852Z [2024-04-05T01:49:00.772+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:49:01.279136190Z [2024-04-05T01:49:01.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:48:00+00:00 exited with status queued for try_number 1 2024-04-05T01:49:01.280839861Z [2024-04-05T01:49:01.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:48:00+00:00 exited with status queued for try_number 1 2024-04-05T01:49:01.280869469Z [2024-04-05T01:49:01.274+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:48:00+00:00 exited with status queued for try_number 1 2024-04-05T01:49:01.346863800Z [2024-04-05T01:49:01.344+0000] {scheduler_job.py:635} INFO - Setting external_id for to 554819f6-0387-4dc6-b46b-33854f378341 2024-04-05T01:49:01.346895038Z [2024-04-05T01:49:01.344+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2e8e7832-ed28-4859-97e3-8501f6b0c5ca 2024-04-05T01:49:01.346901232Z [2024-04-05T01:49:01.344+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ec86231-b867-4c0c-9244-c1e3ea9be22d 2024-04-05T01:49:03.207787020Z [2024-04-05T01:49:03.207+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:49:03.208006838Z [2024-04-05T01:49:03.207+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:48:00+00:00, run_id=scheduled__2024-04-05T01:48:00+00:00, run_start_date=2024-04-05 01:49:00.705483+00:00, run_end_date=2024-04-05 01:49:03.207551+00:00, run_duration=2.502068, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:48:00+00:00, data_interval_end=2024-04-05 01:49:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:49:03.218815974Z [2024-04-05T01:49:03.218+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:49:00+00:00, run_after=2024-04-05T01:50:00+00:00 2024-04-05T01:49:03.279414643Z [2024-04-05T01:49:03.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:48:00+00:00 exited with status success for try_number 1 2024-04-05T01:49:03.287010518Z [2024-04-05T01:49:03.286+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:48:00+00:00, map_index=-1, run_start_date=2024-04-05 01:49:02.011675+00:00, run_end_date=2024-04-05 01:49:02.425435+00:00, run_duration=0.41376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=888, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:49:00.766067+00:00, queued_by_job_id=1, pid=13019 2024-04-05T01:49:05.846861009Z [2024-04-05T01:49:05.846+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:49:05.847231836Z [2024-04-05T01:49:05.846+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:48:00+00:00, run_id=scheduled__2024-04-05T01:48:00+00:00, run_start_date=2024-04-05 01:49:00.706715+00:00, run_end_date=2024-04-05 01:49:05.846791+00:00, run_duration=5.140076, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:48:00+00:00, data_interval_end=2024-04-05 01:49:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:49:05.867438977Z [2024-04-05T01:49:05.867+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:49:00+00:00, run_after=2024-04-05T01:50:00+00:00 2024-04-05T01:49:05.880758368Z [2024-04-05T01:49:05.880+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:49:05.881326062Z [2024-04-05T01:49:05.880+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:48:00+00:00, run_id=scheduled__2024-04-05T01:48:00+00:00, run_start_date=2024-04-05 01:49:00.707788+00:00, run_end_date=2024-04-05 01:49:05.880707+00:00, run_duration=5.172919, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:48:00+00:00, data_interval_end=2024-04-05 01:49:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:49:05.901792313Z [2024-04-05T01:49:05.901+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:49:00+00:00, run_after=2024-04-05T01:50:00+00:00 2024-04-05T01:49:05.942972244Z [2024-04-05T01:49:05.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:48:00+00:00 exited with status success for try_number 1 2024-04-05T01:49:05.943004104Z [2024-04-05T01:49:05.942+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:48:00+00:00 exited with status success for try_number 1 2024-04-05T01:49:05.950425788Z [2024-04-05T01:49:05.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:48:00+00:00, map_index=-1, run_start_date=2024-04-05 01:49:03.352700+00:00, run_end_date=2024-04-05 01:49:05.151821+00:00, run_duration=1.799121, state=success, executor_state=success, try_number=1, max_tries=1, job_id=889, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:49:00.766067+00:00, queued_by_job_id=1, pid=13037 2024-04-05T01:49:05.950711040Z [2024-04-05T01:49:05.950+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:48:00+00:00, map_index=-1, run_start_date=2024-04-05 01:49:03.389994+00:00, run_end_date=2024-04-05 01:49:05.269354+00:00, run_duration=1.87936, state=success, executor_state=success, try_number=1, max_tries=1, job_id=890, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:49:00.766067+00:00, queued_by_job_id=1, pid=13038 2024-04-05T01:50:00.543027889Z [2024-04-05T01:50:00.542+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:50:00+00:00, run_after=2024-04-05T01:51:00+00:00 2024-04-05T01:50:00.552713108Z [2024-04-05T01:50:00.552+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:50:00.566907399Z [2024-04-05T01:50:00.566+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:50:00+00:00, run_after=2024-04-05T01:55:00+00:00 2024-04-05T01:50:00.574682161Z [2024-04-05T01:50:00.574+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:50:00.587916223Z [2024-04-05T01:50:00.587+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:50:00+00:00, run_after=2024-04-05T01:51:00+00:00 2024-04-05T01:50:00.696950036Z [2024-04-05T01:50:00.696+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T01:50:00.696992592Z 2024-04-05T01:50:00.696998221Z 2024-04-05T01:50:00.697004241Z 2024-04-05T01:50:00.697008000Z 2024-04-05T01:50:00.697011680Z 2024-04-05T01:50:00.697314451Z [2024-04-05T01:50:00.696+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:50:00.697602238Z [2024-04-05T01:50:00.697+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:50:00.697790429Z [2024-04-05T01:50:00.697+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:50:00.697955388Z [2024-04-05T01:50:00.697+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:50:00.698129834Z [2024-04-05T01:50:00.698+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:50:00.700183096Z [2024-04-05T01:50:00.699+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:50:00.700201836Z 2024-04-05T01:50:00.700206333Z 2024-04-05T01:50:00.700210037Z 2024-04-05T01:50:00.700213648Z 2024-04-05T01:50:00.700217222Z 2024-04-05T01:50:00.706735155Z [2024-04-05T01:50:00.706+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:50:00.707103660Z [2024-04-05T01:50:00.706+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:50:00.707522957Z [2024-04-05T01:50:00.707+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:50:00.707732587Z [2024-04-05T01:50:00.707+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:50:00.708026618Z [2024-04-05T01:50:00.707+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:50:00.708416049Z [2024-04-05T01:50:00.707+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:50:00.708768292Z [2024-04-05T01:50:00.708+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:50:00.708937350Z [2024-04-05T01:50:00.708+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:50:00.709206269Z [2024-04-05T01:50:00.709+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:50:00.709386377Z [2024-04-05T01:50:00.709+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:50:01.629255836Z [2024-04-05T01:50:01.625+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status queued for try_number 1 2024-04-05T01:50:01.629380621Z [2024-04-05T01:50:01.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:48:00+00:00 exited with status queued for try_number 1 2024-04-05T01:50:01.629501241Z [2024-04-05T01:50:01.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:49:00+00:00 exited with status queued for try_number 1 2024-04-05T01:50:01.629608105Z [2024-04-05T01:50:01.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:49:00+00:00 exited with status queued for try_number 1 2024-04-05T01:50:01.629716769Z [2024-04-05T01:50:01.629+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:49:00+00:00 exited with status queued for try_number 1 2024-04-05T01:50:01.641687253Z [2024-04-05T01:50:01.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to c0e33a63-bd6e-4faf-ba51-6ec04ddfb6e7 2024-04-05T01:50:01.641718693Z [2024-04-05T01:50:01.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9fc171ad-8671-434f-87f9-f4be0d73f1e8 2024-04-05T01:50:01.641949159Z [2024-04-05T01:50:01.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to f588c652-3b40-433f-8320-db94476c2812 2024-04-05T01:50:01.642593437Z [2024-04-05T01:50:01.641+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d744a02-124e-467b-91b4-157475532570 2024-04-05T01:50:01.642835092Z [2024-04-05T01:50:01.642+0000] {scheduler_job.py:635} INFO - Setting external_id for to f8a00952-e327-4564-91f1-10ea7679c72f 2024-04-05T01:50:03.800669295Z [2024-04-05T01:50:03.799+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:50:03.801067222Z [2024-04-05T01:50:03.800+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:49:00+00:00, run_id=scheduled__2024-04-05T01:49:00+00:00, run_start_date=2024-04-05 01:50:00.602844+00:00, run_end_date=2024-04-05 01:50:03.800525+00:00, run_duration=3.197681, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:49:00+00:00, data_interval_end=2024-04-05 01:50:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:50:03.813277221Z [2024-04-05T01:50:03.812+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:50:00+00:00, run_after=2024-04-05T01:51:00+00:00 2024-04-05T01:50:03.853885229Z [2024-04-05T01:50:03.853+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:50:03.854034520Z [2024-04-05T01:50:03.853+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:48:00+00:00, run_id=scheduled__2024-04-05T01:48:00+00:00, run_start_date=2024-04-05 01:50:00.601786+00:00, run_end_date=2024-04-05 01:50:03.853706+00:00, run_duration=3.25192, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:48:00+00:00, data_interval_end=2024-04-05 01:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:50:03.865161613Z [2024-04-05T01:50:03.864+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:50:00+00:00, run_after=2024-04-05T01:52:00+00:00 2024-04-05T01:50:03.946919273Z [2024-04-05T01:50:03.946+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:48:00+00:00 exited with status success for try_number 1 2024-04-05T01:50:03.950101712Z [2024-04-05T01:50:03.949+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:49:00+00:00 exited with status success for try_number 1 2024-04-05T01:50:03.960105869Z [2024-04-05T01:50:03.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:49:00+00:00, map_index=-1, run_start_date=2024-04-05 01:50:02.750821+00:00, run_end_date=2024-04-05 01:50:03.330785+00:00, run_duration=0.579964, state=success, executor_state=success, try_number=1, max_tries=1, job_id=891, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:50:00.701725+00:00, queued_by_job_id=1, pid=13073 2024-04-05T01:50:03.960350365Z [2024-04-05T01:50:03.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:48:00+00:00, map_index=-1, run_start_date=2024-04-05 01:50:02.883921+00:00, run_end_date=2024-04-05 01:50:03.523327+00:00, run_duration=0.639406, state=success, executor_state=success, try_number=1, max_tries=1, job_id=892, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:50:00.701725+00:00, queued_by_job_id=1, pid=13074 2024-04-05T01:50:05.818132401Z [2024-04-05T01:50:05.817+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:50:05.818169058Z 2024-04-05T01:50:05.818569290Z [2024-04-05T01:50:05.818+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:50:05.819589974Z [2024-04-05T01:50:05.819+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:50:05.819607838Z 2024-04-05T01:50:05.825172956Z [2024-04-05T01:50:05.824+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:50:05.825686728Z [2024-04-05T01:50:05.825+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:50:05.897965527Z [2024-04-05T01:50:05.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status queued for try_number 1 2024-04-05T01:50:05.897999311Z [2024-04-05T01:50:05.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status success for try_number 1 2024-04-05T01:50:05.906413714Z [2024-04-05T01:50:05.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to 106d9af1-8b6a-4eb6-a7df-076ca77b53e9 2024-04-05T01:50:05.906551820Z [2024-04-05T01:50:05.906+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:45:00+00:00, map_index=-1, run_start_date=2024-04-05 01:50:04.140202+00:00, run_end_date=2024-04-05 01:50:04.710103+00:00, run_duration=0.569901, state=success, executor_state=success, try_number=1, max_tries=1, job_id=893, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:50:00.701725+00:00, queued_by_job_id=1, pid=13098 2024-04-05T01:50:07.103135764Z [2024-04-05T01:50:07.102+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:50:07.103941137Z [2024-04-05T01:50:07.103+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:49:00+00:00, run_id=scheduled__2024-04-05T01:49:00+00:00, run_start_date=2024-04-05 01:50:00.603819+00:00, run_end_date=2024-04-05 01:50:07.103066+00:00, run_duration=6.499247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:49:00+00:00, data_interval_end=2024-04-05 01:50:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:50:07.124265713Z [2024-04-05T01:50:07.123+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:50:00+00:00, run_after=2024-04-05T01:51:00+00:00 2024-04-05T01:50:07.135497179Z [2024-04-05T01:50:07.133+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:50:07.136319825Z [2024-04-05T01:50:07.135+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:49:00+00:00, run_id=scheduled__2024-04-05T01:49:00+00:00, run_start_date=2024-04-05 01:50:00.604852+00:00, run_end_date=2024-04-05 01:50:07.135671+00:00, run_duration=6.530819, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:49:00+00:00, data_interval_end=2024-04-05 01:50:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:50:07.155272773Z [2024-04-05T01:50:07.154+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:50:00+00:00, run_after=2024-04-05T01:51:00+00:00 2024-04-05T01:50:07.215726394Z [2024-04-05T01:50:07.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:49:00+00:00 exited with status success for try_number 1 2024-04-05T01:50:07.215783035Z [2024-04-05T01:50:07.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:49:00+00:00 exited with status success for try_number 1 2024-04-05T01:50:07.225134312Z [2024-04-05T01:50:07.224+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:49:00+00:00, map_index=-1, run_start_date=2024-04-05 01:50:04.405222+00:00, run_end_date=2024-04-05 01:50:06.456531+00:00, run_duration=2.051309, state=success, executor_state=success, try_number=1, max_tries=1, job_id=894, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:50:00.701725+00:00, queued_by_job_id=1, pid=13099 2024-04-05T01:50:07.225330732Z [2024-04-05T01:50:07.225+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:49:00+00:00, map_index=-1, run_start_date=2024-04-05 01:50:04.789330+00:00, run_end_date=2024-04-05 01:50:06.248721+00:00, run_duration=1.459391, state=success, executor_state=success, try_number=1, max_tries=1, job_id=895, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:50:00.701725+00:00, queued_by_job_id=1, pid=13110 2024-04-05T01:50:08.329360595Z [2024-04-05T01:50:08.328+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:50:08.329421030Z 2024-04-05T01:50:08.329491378Z [2024-04-05T01:50:08.329+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:50:08.330176109Z [2024-04-05T01:50:08.329+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:50:08.330197200Z 2024-04-05T01:50:08.333071467Z [2024-04-05T01:50:08.332+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:50:08.333229141Z [2024-04-05T01:50:08.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:50:08.399455327Z [2024-04-05T01:50:08.398+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status queued for try_number 1 2024-04-05T01:50:08.409686723Z [2024-04-05T01:50:08.409+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71921164-0ad7-40b4-80aa-fd705c5be763 2024-04-05T01:50:08.524550078Z [2024-04-05T01:50:08.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status success for try_number 1 2024-04-05T01:50:08.530752773Z [2024-04-05T01:50:08.530+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T01:45:00+00:00, map_index=-1, run_start_date=2024-04-05 01:50:07.794755+00:00, run_end_date=2024-04-05 01:50:08.225867+00:00, run_duration=0.431112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=896, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:50:05.820273+00:00, queued_by_job_id=1, pid=13128 2024-04-05T01:50:10.916693105Z [2024-04-05T01:50:10.916+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:50:10.916733173Z 2024-04-05T01:50:10.916965425Z [2024-04-05T01:50:10.916+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:50:10.917702245Z [2024-04-05T01:50:10.917+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:50:10.917714713Z 2024-04-05T01:50:10.920873197Z [2024-04-05T01:50:10.920+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:50:10.921140975Z [2024-04-05T01:50:10.920+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:50:10.994710192Z [2024-04-05T01:50:10.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status queued for try_number 1 2024-04-05T01:50:10.994855839Z [2024-04-05T01:50:10.994+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status success for try_number 1 2024-04-05T01:50:11.002860998Z [2024-04-05T01:50:11.002+0000] {scheduler_job.py:635} INFO - Setting external_id for to 019ab8aa-ce8b-4789-b762-9e99be91656a 2024-04-05T01:50:11.003385473Z [2024-04-05T01:50:11.003+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:45:00+00:00, map_index=0, run_start_date=2024-04-05 01:50:10.225778+00:00, run_end_date=2024-04-05 01:50:10.621253+00:00, run_duration=0.395475, state=success, executor_state=success, try_number=1, max_tries=1, job_id=897, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:50:08.330583+00:00, queued_by_job_id=1, pid=13146 2024-04-05T01:50:13.928548477Z [2024-04-05T01:50:13.927+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:50:13.929211825Z [2024-04-05T01:50:13.928+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:45:00+00:00, run_id=scheduled__2024-04-05T01:45:00+00:00, run_start_date=2024-04-05 01:50:00.600376+00:00, run_end_date=2024-04-05 01:50:13.928754+00:00, run_duration=13.328378, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:45:00+00:00, data_interval_end=2024-04-05 01:50:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T01:50:13.944036124Z [2024-04-05T01:50:13.943+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:50:00+00:00, run_after=2024-04-05T01:55:00+00:00 2024-04-05T01:50:13.988646597Z [2024-04-05T01:50:13.988+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:45:00+00:00 exited with status success for try_number 1 2024-04-05T01:50:14.001784918Z [2024-04-05T01:50:14.001+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:45:00+00:00, map_index=-1, run_start_date=2024-04-05 01:50:13.285117+00:00, run_end_date=2024-04-05 01:50:13.761525+00:00, run_duration=0.476408, state=success, executor_state=success, try_number=1, max_tries=1, job_id=898, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:50:10.918306+00:00, queued_by_job_id=1, pid=13157 2024-04-05T01:50:41.552437661Z [2024-04-05T01:50:41.551+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T01:51:00.443806937Z [2024-04-05T01:51:00.443+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:51:00.472650113Z [2024-04-05T01:51:00.472+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:51:00+00:00, run_after=2024-04-05T01:52:00+00:00 2024-04-05T01:51:00.489392542Z [2024-04-05T01:51:00.489+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:51:00+00:00, run_after=2024-04-05T01:52:00+00:00 2024-04-05T01:51:00.555159920Z [2024-04-05T01:51:00.554+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:51:00.555200529Z 2024-04-05T01:51:00.555204579Z 2024-04-05T01:51:00.555207801Z 2024-04-05T01:51:00.555211013Z [2024-04-05T01:51:00.555+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:51:00.555221348Z [2024-04-05T01:51:00.555+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:51:00.555299903Z [2024-04-05T01:51:00.555+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:51:00.556042853Z [2024-04-05T01:51:00.555+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:51:00.556054431Z 2024-04-05T01:51:00.556057865Z 2024-04-05T01:51:00.556061338Z 2024-04-05T01:51:00.559684728Z [2024-04-05T01:51:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:51:00.559713381Z [2024-04-05T01:51:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:51:00.560029272Z [2024-04-05T01:51:00.559+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:51:00.560157757Z [2024-04-05T01:51:00.559+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:51:00.560490794Z [2024-04-05T01:51:00.560+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:51:00.560647909Z [2024-04-05T01:51:00.560+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:51:00.840082832Z [2024-04-05T01:51:00.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status queued for try_number 1 2024-04-05T01:51:00.840107232Z [2024-04-05T01:51:00.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status queued for try_number 1 2024-04-05T01:51:00.840132808Z [2024-04-05T01:51:00.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status queued for try_number 1 2024-04-05T01:51:00.859078491Z [2024-04-05T01:51:00.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6a2cbe23-0647-4049-950a-a20ac3129095 2024-04-05T01:51:00.859160617Z [2024-04-05T01:51:00.858+0000] {scheduler_job.py:635} INFO - Setting external_id for to 242230d4-5335-407b-8a7f-f2b4beac314f 2024-04-05T01:51:00.859543699Z [2024-04-05T01:51:00.859+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8d63eca3-97c1-4de3-bbe3-328a57b89947 2024-04-05T01:51:03.175745791Z [2024-04-05T01:51:03.175+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:51:03.176141566Z [2024-04-05T01:51:03.175+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:50:00+00:00, run_id=scheduled__2024-04-05T01:50:00+00:00, run_start_date=2024-04-05 01:51:00.500570+00:00, run_end_date=2024-04-05 01:51:03.175728+00:00, run_duration=2.675158, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:50:00+00:00, data_interval_end=2024-04-05 01:51:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:51:03.194662161Z [2024-04-05T01:51:03.194+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:51:00+00:00, run_after=2024-04-05T01:52:00+00:00 2024-04-05T01:51:03.266963427Z [2024-04-05T01:51:03.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status success for try_number 1 2024-04-05T01:51:03.274990725Z [2024-04-05T01:51:03.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:50:00+00:00, map_index=-1, run_start_date=2024-04-05 01:51:01.888170+00:00, run_end_date=2024-04-05 01:51:02.312975+00:00, run_duration=0.424805, state=success, executor_state=success, try_number=1, max_tries=1, job_id=899, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:51:00.557129+00:00, queued_by_job_id=1, pid=13166 2024-04-05T01:51:05.415943716Z [2024-04-05T01:51:05.415+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:51:05.416334611Z [2024-04-05T01:51:05.416+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:50:00+00:00, run_id=scheduled__2024-04-05T01:50:00+00:00, run_start_date=2024-04-05 01:51:00.501881+00:00, run_end_date=2024-04-05 01:51:05.415936+00:00, run_duration=4.914055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:50:00+00:00, data_interval_end=2024-04-05 01:51:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:51:05.427178983Z [2024-04-05T01:51:05.426+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:51:00+00:00, run_after=2024-04-05T01:52:00+00:00 2024-04-05T01:51:05.436437037Z [2024-04-05T01:51:05.435+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:51:05.436901370Z [2024-04-05T01:51:05.436+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:50:00+00:00, run_id=scheduled__2024-04-05T01:50:00+00:00, run_start_date=2024-04-05 01:51:00.502928+00:00, run_end_date=2024-04-05 01:51:05.436443+00:00, run_duration=4.933515, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:50:00+00:00, data_interval_end=2024-04-05 01:51:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:51:05.447800857Z [2024-04-05T01:51:05.447+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:51:00+00:00, run_after=2024-04-05T01:52:00+00:00 2024-04-05T01:51:05.483890401Z [2024-04-05T01:51:05.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status success for try_number 1 2024-04-05T01:51:05.484251898Z [2024-04-05T01:51:05.484+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status success for try_number 1 2024-04-05T01:51:05.492049794Z [2024-04-05T01:51:05.491+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:50:00+00:00, map_index=-1, run_start_date=2024-04-05 01:51:03.037822+00:00, run_end_date=2024-04-05 01:51:04.572021+00:00, run_duration=1.534199, state=success, executor_state=success, try_number=1, max_tries=1, job_id=900, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:51:00.557129+00:00, queued_by_job_id=1, pid=13184 2024-04-05T01:51:05.492425065Z [2024-04-05T01:51:05.492+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:50:00+00:00, map_index=-1, run_start_date=2024-04-05 01:51:03.144346+00:00, run_end_date=2024-04-05 01:51:05.008354+00:00, run_duration=1.864008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=901, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:51:00.557129+00:00, queued_by_job_id=1, pid=13185 2024-04-05T01:52:00.890988225Z [2024-04-05T01:52:00.890+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:52:00+00:00, run_after=2024-04-05T01:53:00+00:00 2024-04-05T01:52:00.933285732Z [2024-04-05T01:52:00.932+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:52:00+00:00, run_after=2024-04-05T01:53:00+00:00 2024-04-05T01:52:00.946684655Z [2024-04-05T01:52:00.946+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:52:00.962097076Z [2024-04-05T01:52:00.961+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:52:01.125956686Z [2024-04-05T01:52:01.125+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:52:01.125992486Z 2024-04-05T01:52:01.125997910Z 2024-04-05T01:52:01.126001901Z 2024-04-05T01:52:01.126005552Z 2024-04-05T01:52:01.126085972Z [2024-04-05T01:52:01.125+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:52:01.126205856Z [2024-04-05T01:52:01.126+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:52:01.126361194Z [2024-04-05T01:52:01.126+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:52:01.126562204Z [2024-04-05T01:52:01.126+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:52:01.127295601Z [2024-04-05T01:52:01.127+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:52:01.127304442Z 2024-04-05T01:52:01.127308836Z 2024-04-05T01:52:01.127313557Z 2024-04-05T01:52:01.127361757Z 2024-04-05T01:52:01.131686526Z [2024-04-05T01:52:01.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:52:01.131807020Z [2024-04-05T01:52:01.131+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:52:01.132091647Z [2024-04-05T01:52:01.131+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:52:01.132219574Z [2024-04-05T01:52:01.132+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:52:01.132471627Z [2024-04-05T01:52:01.132+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:52:01.132585651Z [2024-04-05T01:52:01.132+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:52:01.132819089Z [2024-04-05T01:52:01.132+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:52:01.132937362Z [2024-04-05T01:52:01.132+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:52:02.126187692Z [2024-04-05T01:52:02.117+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status queued for try_number 1 2024-04-05T01:52:02.127253689Z [2024-04-05T01:52:02.126+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:51:00+00:00 exited with status queued for try_number 1 2024-04-05T01:52:02.135601768Z [2024-04-05T01:52:02.127+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:51:00+00:00 exited with status queued for try_number 1 2024-04-05T01:52:02.136862036Z [2024-04-05T01:52:02.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:51:00+00:00 exited with status queued for try_number 1 2024-04-05T01:52:02.215810734Z [2024-04-05T01:52:02.215+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7be5a37-1ab9-4f2b-ae4b-6d650cceda79 2024-04-05T01:52:02.216232483Z [2024-04-05T01:52:02.215+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4562e253-bca5-4d6f-8661-74f805b54b3b 2024-04-05T01:52:02.217292340Z [2024-04-05T01:52:02.217+0000] {scheduler_job.py:635} INFO - Setting external_id for to f668babe-e337-49bb-a4a7-e7facf0fbe43 2024-04-05T01:52:02.222685850Z [2024-04-05T01:52:02.218+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53e3fb02-5412-4fae-84b5-442bf7ed81e7 2024-04-05T01:52:05.149383794Z [2024-04-05T01:52:05.148+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:52:05.152260219Z [2024-04-05T01:52:05.151+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:50:00+00:00, run_id=scheduled__2024-04-05T01:50:00+00:00, run_start_date=2024-04-05 01:52:00.990631+00:00, run_end_date=2024-04-05 01:52:05.151680+00:00, run_duration=4.161049, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:50:00+00:00, data_interval_end=2024-04-05 01:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:52:05.165748649Z [2024-04-05T01:52:05.165+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:52:00+00:00, run_after=2024-04-05T01:54:00+00:00 2024-04-05T01:52:05.181338516Z [2024-04-05T01:52:05.180+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:52:05.181847730Z [2024-04-05T01:52:05.181+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:51:00+00:00, run_id=scheduled__2024-04-05T01:51:00+00:00, run_start_date=2024-04-05 01:52:00.995024+00:00, run_end_date=2024-04-05 01:52:05.181485+00:00, run_duration=4.186461, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:51:00+00:00, data_interval_end=2024-04-05 01:52:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:52:05.194929333Z [2024-04-05T01:52:05.194+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:52:00+00:00, run_after=2024-04-05T01:53:00+00:00 2024-04-05T01:52:05.279270668Z [2024-04-05T01:52:05.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:51:00+00:00 exited with status success for try_number 1 2024-04-05T01:52:05.286391913Z [2024-04-05T01:52:05.285+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:51:00+00:00, map_index=-1, run_start_date=2024-04-05 01:52:03.851792+00:00, run_end_date=2024-04-05 01:52:04.957223+00:00, run_duration=1.105431, state=success, executor_state=success, try_number=1, max_tries=1, job_id=902, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:52:01.128289+00:00, queued_by_job_id=1, pid=13218 2024-04-05T01:52:06.379193750Z [2024-04-05T01:52:06.378+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status success for try_number 1 2024-04-05T01:52:06.384276530Z [2024-04-05T01:52:06.383+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:50:00+00:00, map_index=-1, run_start_date=2024-04-05 01:52:04.150011+00:00, run_end_date=2024-04-05 01:52:05.089038+00:00, run_duration=0.939027, state=success, executor_state=success, try_number=1, max_tries=1, job_id=903, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:52:01.128289+00:00, queued_by_job_id=1, pid=13219 2024-04-05T01:52:07.427525440Z [2024-04-05T01:52:07.426+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:52:07.427754732Z [2024-04-05T01:52:07.427+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:51:00+00:00, run_id=scheduled__2024-04-05T01:51:00+00:00, run_start_date=2024-04-05 01:52:00.997169+00:00, run_end_date=2024-04-05 01:52:07.427416+00:00, run_duration=6.430247, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:51:00+00:00, data_interval_end=2024-04-05 01:52:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:52:07.438446933Z [2024-04-05T01:52:07.438+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:52:00+00:00, run_after=2024-04-05T01:53:00+00:00 2024-04-05T01:52:07.491255598Z [2024-04-05T01:52:07.490+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:51:00+00:00 exited with status success for try_number 1 2024-04-05T01:52:07.499311514Z [2024-04-05T01:52:07.498+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:51:00+00:00, map_index=-1, run_start_date=2024-04-05 01:52:05.884141+00:00, run_end_date=2024-04-05 01:52:07.347476+00:00, run_duration=1.463335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=905, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:52:01.128289+00:00, queued_by_job_id=1, pid=13243 2024-04-05T01:52:07.630761864Z [2024-04-05T01:52:07.630+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:52:07.631179398Z [2024-04-05T01:52:07.630+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:51:00+00:00, run_id=scheduled__2024-04-05T01:51:00+00:00, run_start_date=2024-04-05 01:52:00.998459+00:00, run_end_date=2024-04-05 01:52:07.630620+00:00, run_duration=6.632161, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:51:00+00:00, data_interval_end=2024-04-05 01:52:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:52:07.641401900Z [2024-04-05T01:52:07.641+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:52:00+00:00, run_after=2024-04-05T01:53:00+00:00 2024-04-05T01:52:07.675794721Z [2024-04-05T01:52:07.675+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:51:00+00:00 exited with status success for try_number 1 2024-04-05T01:52:07.681121779Z [2024-04-05T01:52:07.680+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:51:00+00:00, map_index=-1, run_start_date=2024-04-05 01:52:05.712036+00:00, run_end_date=2024-04-05 01:52:07.508883+00:00, run_duration=1.796847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=904, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:52:01.128289+00:00, queued_by_job_id=1, pid=13242 2024-04-05T01:53:00.333559449Z [2024-04-05T01:53:00.333+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:53:00+00:00, run_after=2024-04-05T01:54:00+00:00 2024-04-05T01:53:00.348383188Z [2024-04-05T01:53:00.348+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:53:00.370904945Z [2024-04-05T01:53:00.370+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:53:00+00:00, run_after=2024-04-05T01:54:00+00:00 2024-04-05T01:53:00.491865562Z [2024-04-05T01:53:00.491+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:53:00.491895085Z 2024-04-05T01:53:00.491899087Z 2024-04-05T01:53:00.491902423Z 2024-04-05T01:53:00.492120143Z [2024-04-05T01:53:00.491+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:53:00.492369909Z [2024-04-05T01:53:00.492+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:53:00.492631152Z [2024-04-05T01:53:00.492+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:53:00.493828904Z [2024-04-05T01:53:00.493+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:53:00.493848405Z 2024-04-05T01:53:00.493860235Z 2024-04-05T01:53:00.493865504Z 2024-04-05T01:53:00.507762481Z [2024-04-05T01:53:00.507+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:53:00.508169418Z [2024-04-05T01:53:00.507+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:53:00.508600363Z [2024-04-05T01:53:00.508+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:53:00.508886100Z [2024-04-05T01:53:00.508+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:53:00.509181818Z [2024-04-05T01:53:00.509+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:53:00.509364360Z [2024-04-05T01:53:00.509+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:53:01.489171869Z [2024-04-05T01:53:01.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:52:00+00:00 exited with status queued for try_number 1 2024-04-05T01:53:01.499217683Z [2024-04-05T01:53:01.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:52:00+00:00 exited with status queued for try_number 1 2024-04-05T01:53:01.501738350Z [2024-04-05T01:53:01.499+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:52:00+00:00 exited with status queued for try_number 1 2024-04-05T01:53:01.640669171Z [2024-04-05T01:53:01.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to aa11122f-64ee-425c-8f9f-39050cced135 2024-04-05T01:53:01.640761557Z [2024-04-05T01:53:01.640+0000] {scheduler_job.py:635} INFO - Setting external_id for to de501cef-2c68-4034-b905-f2652707a20d 2024-04-05T01:53:01.644663593Z [2024-04-05T01:53:01.644+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f65e478-573a-43da-ab70-7816e1ed8016 2024-04-05T01:53:05.650598717Z [2024-04-05T01:53:05.650+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:53:05.650945937Z [2024-04-05T01:53:05.650+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:52:00+00:00, run_id=scheduled__2024-04-05T01:52:00+00:00, run_start_date=2024-04-05 01:53:00.392205+00:00, run_end_date=2024-04-05 01:53:05.650504+00:00, run_duration=5.258299, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:52:00+00:00, data_interval_end=2024-04-05 01:53:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:53:05.664243752Z [2024-04-05T01:53:05.663+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:53:00+00:00, run_after=2024-04-05T01:54:00+00:00 2024-04-05T01:53:05.748104859Z [2024-04-05T01:53:05.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:52:00+00:00 exited with status success for try_number 1 2024-04-05T01:53:05.754588464Z [2024-04-05T01:53:05.754+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:52:00+00:00, map_index=-1, run_start_date=2024-04-05 01:53:03.722687+00:00, run_end_date=2024-04-05 01:53:04.602805+00:00, run_duration=0.880118, state=success, executor_state=success, try_number=1, max_tries=1, job_id=906, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:53:00.496240+00:00, queued_by_job_id=1, pid=13276 2024-04-05T01:53:07.856888392Z [2024-04-05T01:53:07.856+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:53:07.857022167Z [2024-04-05T01:53:07.856+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:52:00+00:00, run_id=scheduled__2024-04-05T01:52:00+00:00, run_start_date=2024-04-05 01:53:00.396913+00:00, run_end_date=2024-04-05 01:53:07.856736+00:00, run_duration=7.459823, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:52:00+00:00, data_interval_end=2024-04-05 01:53:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:53:07.866289299Z [2024-04-05T01:53:07.865+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:53:00+00:00, run_after=2024-04-05T01:54:00+00:00 2024-04-05T01:53:07.901850498Z [2024-04-05T01:53:07.901+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:52:00+00:00 exited with status success for try_number 1 2024-04-05T01:53:07.907651545Z [2024-04-05T01:53:07.907+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:52:00+00:00, map_index=-1, run_start_date=2024-04-05 01:53:05.023042+00:00, run_end_date=2024-04-05 01:53:06.897053+00:00, run_duration=1.874011, state=success, executor_state=success, try_number=1, max_tries=1, job_id=907, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:53:00.496240+00:00, queued_by_job_id=1, pid=13288 2024-04-05T01:53:09.660923027Z [2024-04-05T01:53:09.659+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:53:09.660959943Z [2024-04-05T01:53:09.659+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:52:00+00:00, run_id=scheduled__2024-04-05T01:52:00+00:00, run_start_date=2024-04-05 01:53:00.398078+00:00, run_end_date=2024-04-05 01:53:09.659648+00:00, run_duration=9.26157, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:52:00+00:00, data_interval_end=2024-04-05 01:53:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:53:09.673520790Z [2024-04-05T01:53:09.673+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:53:00+00:00, run_after=2024-04-05T01:54:00+00:00 2024-04-05T01:53:09.714468217Z [2024-04-05T01:53:09.714+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:52:00+00:00 exited with status success for try_number 1 2024-04-05T01:53:09.721419334Z [2024-04-05T01:53:09.721+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:52:00+00:00, map_index=-1, run_start_date=2024-04-05 01:53:05.871313+00:00, run_end_date=2024-04-05 01:53:08.876831+00:00, run_duration=3.005518, state=success, executor_state=success, try_number=1, max_tries=1, job_id=908, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:53:00.496240+00:00, queued_by_job_id=1, pid=13299 2024-04-05T01:54:00.274900804Z [2024-04-05T01:54:00.274+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:54:00.283353418Z [2024-04-05T01:54:00.283+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:54:00.295968227Z [2024-04-05T01:54:00.295+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:54:00+00:00, run_after=2024-04-05T01:55:00+00:00 2024-04-05T01:54:00.309417032Z [2024-04-05T01:54:00.309+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:54:00+00:00, run_after=2024-04-05T01:55:00+00:00 2024-04-05T01:54:00.392960193Z [2024-04-05T01:54:00.392+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:54:00.392985365Z 2024-04-05T01:54:00.392989919Z 2024-04-05T01:54:00.392993293Z 2024-04-05T01:54:00.393002213Z 2024-04-05T01:54:00.393130754Z [2024-04-05T01:54:00.392+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:54:00.393324803Z [2024-04-05T01:54:00.393+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:54:00.393503314Z [2024-04-05T01:54:00.393+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:54:00.393758999Z [2024-04-05T01:54:00.393+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:54:00.394862802Z [2024-04-05T01:54:00.394+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:54:00.394875305Z 2024-04-05T01:54:00.394879355Z 2024-04-05T01:54:00.394882729Z 2024-04-05T01:54:00.394886148Z 2024-04-05T01:54:00.399279587Z [2024-04-05T01:54:00.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:54:00.399524551Z [2024-04-05T01:54:00.399+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:54:00.399905119Z [2024-04-05T01:54:00.399+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:54:00.400376133Z [2024-04-05T01:54:00.400+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:54:00.401144955Z [2024-04-05T01:54:00.400+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:54:00.401297745Z [2024-04-05T01:54:00.401+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:54:00.401588781Z [2024-04-05T01:54:00.401+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:54:00.401793872Z [2024-04-05T01:54:00.401+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:54:00.990623238Z [2024-04-05T01:54:00.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:52:00+00:00 exited with status queued for try_number 1 2024-04-05T01:54:00.990651235Z [2024-04-05T01:54:00.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:53:00+00:00 exited with status queued for try_number 1 2024-04-05T01:54:00.990806433Z [2024-04-05T01:54:00.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:53:00+00:00 exited with status queued for try_number 1 2024-04-05T01:54:00.990914755Z [2024-04-05T01:54:00.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:53:00+00:00 exited with status queued for try_number 1 2024-04-05T01:54:01.015550827Z [2024-04-05T01:54:01.015+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4754d66d-b54c-4e5c-8fe5-6556cbc6573e 2024-04-05T01:54:01.016051730Z [2024-04-05T01:54:01.015+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae62240c-6ade-4561-8cf7-9692f8e91429 2024-04-05T01:54:01.016312021Z [2024-04-05T01:54:01.016+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62208776-a4bc-4517-98e2-a29caf18aac5 2024-04-05T01:54:01.016451031Z [2024-04-05T01:54:01.016+0000] {scheduler_job.py:635} INFO - Setting external_id for to 53c5d1df-b938-4351-ae7d-7fbd8687c774 2024-04-05T01:54:02.526356838Z [2024-04-05T01:54:02.525+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:54:02.526880044Z [2024-04-05T01:54:02.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:52:00+00:00, run_id=scheduled__2024-04-05T01:52:00+00:00, run_start_date=2024-04-05 01:54:00.319890+00:00, run_end_date=2024-04-05 01:54:02.526265+00:00, run_duration=2.206375, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:52:00+00:00, data_interval_end=2024-04-05 01:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:54:02.539404809Z [2024-04-05T01:54:02.539+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:54:00+00:00, run_after=2024-04-05T01:56:00+00:00 2024-04-05T01:54:03.781839804Z [2024-04-05T01:54:03.781+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:54:03.784533341Z [2024-04-05T01:54:03.784+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:53:00+00:00, run_id=scheduled__2024-04-05T01:53:00+00:00, run_start_date=2024-04-05 01:54:00.321414+00:00, run_end_date=2024-04-05 01:54:03.781720+00:00, run_duration=3.460306, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:53:00+00:00, data_interval_end=2024-04-05 01:54:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:54:03.802171693Z [2024-04-05T01:54:03.801+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:54:00+00:00, run_after=2024-04-05T01:55:00+00:00 2024-04-05T01:54:03.875757416Z [2024-04-05T01:54:03.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:52:00+00:00 exited with status success for try_number 1 2024-04-05T01:54:03.875809485Z [2024-04-05T01:54:03.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:53:00+00:00 exited with status success for try_number 1 2024-04-05T01:54:03.896419073Z [2024-04-05T01:54:03.896+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:52:00+00:00, map_index=-1, run_start_date=2024-04-05 01:54:01.936220+00:00, run_end_date=2024-04-05 01:54:02.500160+00:00, run_duration=0.56394, state=success, executor_state=success, try_number=1, max_tries=1, job_id=909, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:54:00.395981+00:00, queued_by_job_id=1, pid=13322 2024-04-05T01:54:03.896689517Z [2024-04-05T01:54:03.896+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:53:00+00:00, map_index=-1, run_start_date=2024-04-05 01:54:02.737877+00:00, run_end_date=2024-04-05 01:54:03.198671+00:00, run_duration=0.460794, state=success, executor_state=success, try_number=1, max_tries=1, job_id=910, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:54:00.395981+00:00, queued_by_job_id=1, pid=13334 2024-04-05T01:54:06.051392579Z [2024-04-05T01:54:06.051+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:54:06.051834473Z [2024-04-05T01:54:06.051+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:53:00+00:00, run_id=scheduled__2024-04-05T01:53:00+00:00, run_start_date=2024-04-05 01:54:00.323845+00:00, run_end_date=2024-04-05 01:54:06.051431+00:00, run_duration=5.727586, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:53:00+00:00, data_interval_end=2024-04-05 01:54:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:54:06.062076896Z [2024-04-05T01:54:06.061+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:54:00+00:00, run_after=2024-04-05T01:55:00+00:00 2024-04-05T01:54:06.071327968Z [2024-04-05T01:54:06.070+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:54:06.071824914Z [2024-04-05T01:54:06.071+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:53:00+00:00, run_id=scheduled__2024-04-05T01:53:00+00:00, run_start_date=2024-04-05 01:54:00.322665+00:00, run_end_date=2024-04-05 01:54:06.071442+00:00, run_duration=5.748777, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:53:00+00:00, data_interval_end=2024-04-05 01:54:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:54:06.083867486Z [2024-04-05T01:54:06.083+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:54:00+00:00, run_after=2024-04-05T01:55:00+00:00 2024-04-05T01:54:06.116801108Z [2024-04-05T01:54:06.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:53:00+00:00 exited with status success for try_number 1 2024-04-05T01:54:06.117087092Z [2024-04-05T01:54:06.116+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:53:00+00:00 exited with status success for try_number 1 2024-04-05T01:54:06.127071611Z [2024-04-05T01:54:06.126+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:53:00+00:00, map_index=-1, run_start_date=2024-04-05 01:54:03.793936+00:00, run_end_date=2024-04-05 01:54:05.303647+00:00, run_duration=1.509711, state=success, executor_state=success, try_number=1, max_tries=1, job_id=912, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:54:00.395981+00:00, queued_by_job_id=1, pid=13352 2024-04-05T01:54:06.127480008Z [2024-04-05T01:54:06.127+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:53:00+00:00, map_index=-1, run_start_date=2024-04-05 01:54:03.605237+00:00, run_end_date=2024-04-05 01:54:05.315647+00:00, run_duration=1.71041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=911, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:54:00.395981+00:00, queued_by_job_id=1, pid=13351 2024-04-05T01:55:00.173839389Z [2024-04-05T01:55:00.173+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:55:00.186733888Z [2024-04-05T01:55:00.186+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:55:00+00:00, run_after=2024-04-05T02:00:00+00:00 2024-04-05T01:55:00.199783126Z [2024-04-05T01:55:00.199+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:55:00+00:00, run_after=2024-04-05T01:56:00+00:00 2024-04-05T01:55:00.212804689Z [2024-04-05T01:55:00.212+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:55:00+00:00, run_after=2024-04-05T01:56:00+00:00 2024-04-05T01:55:00.317515530Z [2024-04-05T01:55:00.316+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:55:00.317540613Z 2024-04-05T01:55:00.317545135Z 2024-04-05T01:55:00.317548405Z 2024-04-05T01:55:00.317551521Z 2024-04-05T01:55:00.317739986Z [2024-04-05T01:55:00.317+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:55:00.317926383Z [2024-04-05T01:55:00.317+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:55:00.318135236Z [2024-04-05T01:55:00.317+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:55:00.318331239Z [2024-04-05T01:55:00.318+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:55:00.318938478Z [2024-04-05T01:55:00.318+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:55:00.318953657Z 2024-04-05T01:55:00.318961957Z 2024-04-05T01:55:00.318967967Z 2024-04-05T01:55:00.318984354Z 2024-04-05T01:55:00.322648847Z [2024-04-05T01:55:00.322+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T01:55:00.322754936Z [2024-04-05T01:55:00.322+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:55:00.323106638Z [2024-04-05T01:55:00.322+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:55:00.323187228Z [2024-04-05T01:55:00.323+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:55:00.323356971Z [2024-04-05T01:55:00.323+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:55:00.323452718Z [2024-04-05T01:55:00.323+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:55:00.323791986Z [2024-04-05T01:55:00.323+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:55:00.323893110Z [2024-04-05T01:55:00.323+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:55:00.879133135Z [2024-04-05T01:55:00.878+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status queued for try_number 1 2024-04-05T01:55:00.882006148Z [2024-04-05T01:55:00.878+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:54:00+00:00 exited with status queued for try_number 1 2024-04-05T01:55:00.882148927Z [2024-04-05T01:55:00.881+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:54:00+00:00 exited with status queued for try_number 1 2024-04-05T01:55:00.882233236Z [2024-04-05T01:55:00.882+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:54:00+00:00 exited with status queued for try_number 1 2024-04-05T01:55:00.906758499Z [2024-04-05T01:55:00.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to 86726377-a3af-495c-957a-598cf73c4b86 2024-04-05T01:55:00.906830844Z [2024-04-05T01:55:00.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to 31b371c6-efc1-4f2b-bf72-c1abffe21b4d 2024-04-05T01:55:00.906908616Z [2024-04-05T01:55:00.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f6dc066-8917-44d2-bbf2-e0c8a8e631cc 2024-04-05T01:55:00.907002960Z [2024-04-05T01:55:00.906+0000] {scheduler_job.py:635} INFO - Setting external_id for to 75c28c91-e38e-4888-9879-e982eb0a4164 2024-04-05T01:55:04.716690736Z [2024-04-05T01:55:04.716+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:55:04.717005875Z [2024-04-05T01:55:04.716+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:54:00+00:00, run_id=scheduled__2024-04-05T01:54:00+00:00, run_start_date=2024-04-05 01:55:00.236112+00:00, run_end_date=2024-04-05 01:55:04.716540+00:00, run_duration=4.480428, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:54:00+00:00, data_interval_end=2024-04-05 01:55:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:55:04.733523272Z [2024-04-05T01:55:04.733+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:55:00+00:00, run_after=2024-04-05T01:56:00+00:00 2024-04-05T01:55:04.870352469Z [2024-04-05T01:55:04.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:54:00+00:00 exited with status success for try_number 1 2024-04-05T01:55:04.878190016Z [2024-04-05T01:55:04.877+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:54:00+00:00, map_index=-1, run_start_date=2024-04-05 01:55:02.663704+00:00, run_end_date=2024-04-05 01:55:03.333241+00:00, run_duration=0.669537, state=success, executor_state=success, try_number=1, max_tries=1, job_id=913, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:55:00.319771+00:00, queued_by_job_id=1, pid=13386 2024-04-05T01:55:05.465915965Z [2024-04-05T01:55:05.465+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:55:05.465969069Z 2024-04-05T01:55:05.465986028Z [2024-04-05T01:55:05.465+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:55:05.466707565Z [2024-04-05T01:55:05.466+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:55:05.466727672Z 2024-04-05T01:55:05.470785836Z [2024-04-05T01:55:05.470+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T01:55:05.470842413Z [2024-04-05T01:55:05.470+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:55:05.547991445Z [2024-04-05T01:55:05.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status queued for try_number 1 2024-04-05T01:55:05.548064077Z [2024-04-05T01:55:05.547+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status success for try_number 1 2024-04-05T01:55:05.554692878Z [2024-04-05T01:55:05.554+0000] {scheduler_job.py:635} INFO - Setting external_id for to 47fdd5cd-1f70-4981-8adc-0c06bf138d67 2024-04-05T01:55:05.555034317Z [2024-04-05T01:55:05.554+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:50:00+00:00, map_index=-1, run_start_date=2024-04-05 01:55:04.598142+00:00, run_end_date=2024-04-05 01:55:05.137387+00:00, run_duration=0.539245, state=success, executor_state=success, try_number=1, max_tries=1, job_id=915, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:55:00.319771+00:00, queued_by_job_id=1, pid=13410 2024-04-05T01:55:07.322976131Z [2024-04-05T01:55:07.322+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:55:07.323367630Z [2024-04-05T01:55:07.323+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:54:00+00:00, run_id=scheduled__2024-04-05T01:54:00+00:00, run_start_date=2024-04-05 01:55:00.241468+00:00, run_end_date=2024-04-05 01:55:07.322915+00:00, run_duration=7.081447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:54:00+00:00, data_interval_end=2024-04-05 01:55:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:55:07.338962773Z [2024-04-05T01:55:07.338+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:55:00+00:00, run_after=2024-04-05T01:56:00+00:00 2024-04-05T01:55:07.436928164Z [2024-04-05T01:55:07.436+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:54:00+00:00 exited with status success for try_number 1 2024-04-05T01:55:07.454078588Z [2024-04-05T01:55:07.452+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:54:00+00:00, map_index=-1, run_start_date=2024-04-05 01:55:04.185535+00:00, run_end_date=2024-04-05 01:55:07.021266+00:00, run_duration=2.835731, state=success, executor_state=success, try_number=1, max_tries=1, job_id=914, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:55:00.319771+00:00, queued_by_job_id=1, pid=13399 2024-04-05T01:55:08.393864981Z [2024-04-05T01:55:08.393+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:55:08.394410517Z [2024-04-05T01:55:08.394+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:54:00+00:00, run_id=scheduled__2024-04-05T01:54:00+00:00, run_start_date=2024-04-05 01:55:00.238400+00:00, run_end_date=2024-04-05 01:55:08.393873+00:00, run_duration=8.155473, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:54:00+00:00, data_interval_end=2024-04-05 01:55:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:55:08.412086277Z [2024-04-05T01:55:08.411+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:55:00+00:00, run_after=2024-04-05T01:56:00+00:00 2024-04-05T01:55:08.463727996Z [2024-04-05T01:55:08.463+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:55:08.463762927Z 2024-04-05T01:55:08.464082954Z [2024-04-05T01:55:08.463+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:55:08.465344777Z [2024-04-05T01:55:08.464+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:55:08.465362853Z 2024-04-05T01:55:08.469449726Z [2024-04-05T01:55:08.469+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T01:55:08.469867593Z [2024-04-05T01:55:08.469+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T01:55:08.582545421Z [2024-04-05T01:55:08.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status queued for try_number 1 2024-04-05T01:55:08.583263773Z [2024-04-05T01:55:08.582+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:54:00+00:00 exited with status success for try_number 1 2024-04-05T01:55:08.583723575Z [2024-04-05T01:55:08.583+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status success for try_number 1 2024-04-05T01:55:08.614836384Z [2024-04-05T01:55:08.614+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:54:00+00:00, map_index=-1, run_start_date=2024-04-05 01:55:04.813682+00:00, run_end_date=2024-04-05 01:55:07.330368+00:00, run_duration=2.516686, state=success, executor_state=success, try_number=1, max_tries=1, job_id=916, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:55:00.319771+00:00, queued_by_job_id=1, pid=13416 2024-04-05T01:55:08.615277480Z [2024-04-05T01:55:08.614+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T01:50:00+00:00, map_index=-1, run_start_date=2024-04-05 01:55:07.640899+00:00, run_end_date=2024-04-05 01:55:08.077425+00:00, run_duration=0.436526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=917, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:55:05.467340+00:00, queued_by_job_id=1, pid=13434 2024-04-05T01:55:08.615721127Z [2024-04-05T01:55:08.615+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5cba7bdc-00c4-49f8-896e-e3a9fb43126b 2024-04-05T01:55:12.571736431Z [2024-04-05T01:55:12.571+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T01:55:12.571789513Z 2024-04-05T01:55:12.572189560Z [2024-04-05T01:55:12.571+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:55:12.573555901Z [2024-04-05T01:55:12.573+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:55:12.573588921Z 2024-04-05T01:55:12.584959133Z [2024-04-05T01:55:12.584+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:55:12.585347928Z [2024-04-05T01:55:12.584+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T01:55:12.727740607Z [2024-04-05T01:55:12.727+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status queued for try_number 1 2024-04-05T01:55:12.728386804Z [2024-04-05T01:55:12.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status success for try_number 1 2024-04-05T01:55:12.741818360Z [2024-04-05T01:55:12.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8bcda700-f90f-459e-a62f-21952eb08b01 2024-04-05T01:55:12.742219389Z [2024-04-05T01:55:12.741+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:50:00+00:00, map_index=0, run_start_date=2024-04-05 01:55:10.754148+00:00, run_end_date=2024-04-05 01:55:11.428526+00:00, run_duration=0.674378, state=success, executor_state=success, try_number=1, max_tries=1, job_id=918, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:55:08.466040+00:00, queued_by_job_id=1, pid=13452 2024-04-05T01:55:15.001976185Z [2024-04-05T01:55:15.001+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:55:15.002161102Z [2024-04-05T01:55:15.001+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:50:00+00:00, run_id=scheduled__2024-04-05T01:50:00+00:00, run_start_date=2024-04-05 01:55:00.231485+00:00, run_end_date=2024-04-05 01:55:15.001864+00:00, run_duration=14.770379, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:50:00+00:00, data_interval_end=2024-04-05 01:55:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T01:55:15.008760703Z [2024-04-05T01:55:15.008+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:55:00+00:00, run_after=2024-04-05T02:00:00+00:00 2024-04-05T01:55:15.664623253Z [2024-04-05T01:55:15.664+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:50:00+00:00 exited with status success for try_number 1 2024-04-05T01:55:15.678476564Z [2024-04-05T01:55:15.677+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:50:00+00:00, map_index=-1, run_start_date=2024-04-05 01:55:14.511532+00:00, run_end_date=2024-04-05 01:55:14.948648+00:00, run_duration=0.437116, state=success, executor_state=success, try_number=1, max_tries=1, job_id=919, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:55:12.574670+00:00, queued_by_job_id=1, pid=13463 2024-04-05T01:55:41.605860352Z [2024-04-05T01:55:41.605+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T01:56:00.191925321Z [2024-04-05T01:56:00.191+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:56:00+00:00, run_after=2024-04-05T01:57:00+00:00 2024-04-05T01:56:00.200945047Z [2024-04-05T01:56:00.200+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:56:00.221171725Z [2024-04-05T01:56:00.220+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:56:00+00:00, run_after=2024-04-05T01:57:00+00:00 2024-04-05T01:56:00.230260505Z [2024-04-05T01:56:00.229+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:56:00.328659425Z [2024-04-05T01:56:00.328+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:56:00.328682706Z 2024-04-05T01:56:00.328687032Z 2024-04-05T01:56:00.328690415Z 2024-04-05T01:56:00.328693621Z 2024-04-05T01:56:00.329165604Z [2024-04-05T01:56:00.328+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:56:00.329627943Z [2024-04-05T01:56:00.329+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:56:00.329859580Z [2024-04-05T01:56:00.329+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:56:00.330091228Z [2024-04-05T01:56:00.329+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:56:00.330887450Z [2024-04-05T01:56:00.330+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:56:00.330899935Z 2024-04-05T01:56:00.330903723Z 2024-04-05T01:56:00.330906971Z 2024-04-05T01:56:00.330910077Z 2024-04-05T01:56:00.334972652Z [2024-04-05T01:56:00.334+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:56:00.335275142Z [2024-04-05T01:56:00.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:56:00.335681691Z [2024-04-05T01:56:00.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:56:00.335963857Z [2024-04-05T01:56:00.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:56:00.336301775Z [2024-04-05T01:56:00.336+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:56:00.336553221Z [2024-04-05T01:56:00.336+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:56:00.337006369Z [2024-04-05T01:56:00.336+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:56:00.337340017Z [2024-04-05T01:56:00.337+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:56:00.833324796Z [2024-04-05T01:56:00.832+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:54:00+00:00 exited with status queued for try_number 1 2024-04-05T01:56:00.840269168Z [2024-04-05T01:56:00.839+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status queued for try_number 1 2024-04-05T01:56:00.840388925Z [2024-04-05T01:56:00.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status queued for try_number 1 2024-04-05T01:56:00.840539048Z [2024-04-05T01:56:00.840+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status queued for try_number 1 2024-04-05T01:56:00.866183558Z [2024-04-05T01:56:00.865+0000] {scheduler_job.py:635} INFO - Setting external_id for to f9a8bcc8-cf97-45fb-b384-650a4e2a504f 2024-04-05T01:56:00.870131213Z [2024-04-05T01:56:00.869+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69a132ff-b561-4af1-93ae-b5e5c61eaa15 2024-04-05T01:56:00.870485264Z [2024-04-05T01:56:00.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2ac7d715-9a85-4c80-ac47-5ef61f80ddb7 2024-04-05T01:56:00.872745650Z [2024-04-05T01:56:00.872+0000] {scheduler_job.py:635} INFO - Setting external_id for to dd0bf085-9326-48c5-ba09-bff4ad773957 2024-04-05T01:56:03.415708156Z [2024-04-05T01:56:03.415+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:56:03.416025876Z [2024-04-05T01:56:03.415+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:54:00+00:00, run_id=scheduled__2024-04-05T01:54:00+00:00, run_start_date=2024-04-05 01:56:00.242846+00:00, run_end_date=2024-04-05 01:56:03.415598+00:00, run_duration=3.172752, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:54:00+00:00, data_interval_end=2024-04-05 01:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:56:03.427483404Z [2024-04-05T01:56:03.427+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:56:00+00:00, run_after=2024-04-05T01:58:00+00:00 2024-04-05T01:56:03.454430146Z [2024-04-05T01:56:03.453+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:56:03.454721921Z [2024-04-05T01:56:03.454+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:55:00+00:00, run_id=scheduled__2024-04-05T01:55:00+00:00, run_start_date=2024-04-05 01:56:00.244363+00:00, run_end_date=2024-04-05 01:56:03.454278+00:00, run_duration=3.209915, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:55:00+00:00, data_interval_end=2024-04-05 01:56:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:56:03.470855100Z [2024-04-05T01:56:03.470+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:56:00+00:00, run_after=2024-04-05T01:57:00+00:00 2024-04-05T01:56:03.559084087Z [2024-04-05T01:56:03.558+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:54:00+00:00 exited with status success for try_number 1 2024-04-05T01:56:03.561706434Z [2024-04-05T01:56:03.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status success for try_number 1 2024-04-05T01:56:03.572161272Z [2024-04-05T01:56:03.571+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:55:00+00:00, map_index=-1, run_start_date=2024-04-05 01:56:02.642846+00:00, run_end_date=2024-04-05 01:56:03.211419+00:00, run_duration=0.568573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=921, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:56:00.332049+00:00, queued_by_job_id=1, pid=13480 2024-04-05T01:56:03.572522442Z [2024-04-05T01:56:03.572+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:54:00+00:00, map_index=-1, run_start_date=2024-04-05 01:56:01.459160+00:00, run_end_date=2024-04-05 01:56:02.257340+00:00, run_duration=0.79818, state=success, executor_state=success, try_number=1, max_tries=1, job_id=920, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:56:00.332049+00:00, queued_by_job_id=1, pid=13468 2024-04-05T01:56:05.719986933Z [2024-04-05T01:56:05.719+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:56:05.720466075Z [2024-04-05T01:56:05.720+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:55:00+00:00, run_id=scheduled__2024-04-05T01:55:00+00:00, run_start_date=2024-04-05 01:56:00.245636+00:00, run_end_date=2024-04-05 01:56:05.720028+00:00, run_duration=5.474392, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:55:00+00:00, data_interval_end=2024-04-05 01:56:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:56:05.731041318Z [2024-04-05T01:56:05.730+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:56:00+00:00, run_after=2024-04-05T01:57:00+00:00 2024-04-05T01:56:05.778497644Z [2024-04-05T01:56:05.778+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status success for try_number 1 2024-04-05T01:56:05.784815394Z [2024-04-05T01:56:05.784+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:55:00+00:00, map_index=-1, run_start_date=2024-04-05 01:56:03.600400+00:00, run_end_date=2024-04-05 01:56:05.513096+00:00, run_duration=1.912696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=922, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:56:00.332049+00:00, queued_by_job_id=1, pid=13497 2024-04-05T01:56:07.109283096Z [2024-04-05T01:56:07.108+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:56:07.109661598Z [2024-04-05T01:56:07.109+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:55:00+00:00, run_id=scheduled__2024-04-05T01:55:00+00:00, run_start_date=2024-04-05 01:56:00.247029+00:00, run_end_date=2024-04-05 01:56:07.109189+00:00, run_duration=6.86216, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:55:00+00:00, data_interval_end=2024-04-05 01:56:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:56:07.121595299Z [2024-04-05T01:56:07.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:56:00+00:00, run_after=2024-04-05T01:57:00+00:00 2024-04-05T01:56:07.153522653Z [2024-04-05T01:56:07.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status success for try_number 1 2024-04-05T01:56:07.160352386Z [2024-04-05T01:56:07.159+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:55:00+00:00, map_index=-1, run_start_date=2024-04-05 01:56:03.722867+00:00, run_end_date=2024-04-05 01:56:06.437477+00:00, run_duration=2.71461, state=success, executor_state=success, try_number=1, max_tries=1, job_id=923, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:56:00.332049+00:00, queued_by_job_id=1, pid=13498 2024-04-05T01:57:00.134275390Z [2024-04-05T01:57:00.133+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:57:00.151487303Z [2024-04-05T01:57:00.151+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:57:00+00:00, run_after=2024-04-05T01:58:00+00:00 2024-04-05T01:57:00.170662863Z [2024-04-05T01:57:00.170+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:57:00+00:00, run_after=2024-04-05T01:58:00+00:00 2024-04-05T01:57:00.275058525Z [2024-04-05T01:57:00.273+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:57:00.275133376Z 2024-04-05T01:57:00.275141447Z 2024-04-05T01:57:00.275148258Z 2024-04-05T01:57:00.276136065Z [2024-04-05T01:57:00.275+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:57:00.276733148Z [2024-04-05T01:57:00.276+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:57:00.277401127Z [2024-04-05T01:57:00.277+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:57:00.278757601Z [2024-04-05T01:57:00.278+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:57:00.278793956Z 2024-04-05T01:57:00.278801345Z 2024-04-05T01:57:00.278808034Z 2024-04-05T01:57:00.286360125Z [2024-04-05T01:57:00.285+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:57:00.286953109Z [2024-04-05T01:57:00.286+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:57:00.288327704Z [2024-04-05T01:57:00.288+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:57:00.288852046Z [2024-04-05T01:57:00.288+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:57:00.290013805Z [2024-04-05T01:57:00.289+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:57:00.290389226Z [2024-04-05T01:57:00.290+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:57:01.577799997Z [2024-04-05T01:57:01.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:56:00+00:00 exited with status queued for try_number 1 2024-04-05T01:57:01.578180756Z [2024-04-05T01:57:01.577+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:56:00+00:00 exited with status queued for try_number 1 2024-04-05T01:57:01.578358368Z [2024-04-05T01:57:01.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:56:00+00:00 exited with status queued for try_number 1 2024-04-05T01:57:01.591890094Z [2024-04-05T01:57:01.591+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3a44bca-058c-4511-9a9a-11aa13c60539 2024-04-05T01:57:01.592302616Z [2024-04-05T01:57:01.592+0000] {scheduler_job.py:635} INFO - Setting external_id for to 65121735-802f-45e7-b485-25f5c12fad39 2024-04-05T01:57:01.592579766Z [2024-04-05T01:57:01.592+0000] {scheduler_job.py:635} INFO - Setting external_id for to d36a9444-a869-44ef-a06f-7b4c3fcbec37 2024-04-05T01:57:04.185059441Z [2024-04-05T01:57:04.184+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:57:04.185638723Z [2024-04-05T01:57:04.185+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:56:00+00:00, run_id=scheduled__2024-04-05T01:56:00+00:00, run_start_date=2024-04-05 01:57:00.186905+00:00, run_end_date=2024-04-05 01:57:04.184868+00:00, run_duration=3.997963, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:56:00+00:00, data_interval_end=2024-04-05 01:57:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:57:04.204893749Z [2024-04-05T01:57:04.204+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:57:00+00:00, run_after=2024-04-05T01:58:00+00:00 2024-04-05T01:57:04.267984163Z [2024-04-05T01:57:04.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:56:00+00:00 exited with status success for try_number 1 2024-04-05T01:57:04.274358274Z [2024-04-05T01:57:04.273+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:56:00+00:00, map_index=-1, run_start_date=2024-04-05 01:57:02.524725+00:00, run_end_date=2024-04-05 01:57:03.120923+00:00, run_duration=0.596198, state=success, executor_state=success, try_number=1, max_tries=1, job_id=924, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:57:00.280861+00:00, queued_by_job_id=1, pid=13532 2024-04-05T01:57:05.335172142Z [2024-04-05T01:57:05.334+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:57:05.335600973Z [2024-04-05T01:57:05.335+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:56:00+00:00, run_id=scheduled__2024-04-05T01:56:00+00:00, run_start_date=2024-04-05 01:57:00.188693+00:00, run_end_date=2024-04-05 01:57:05.334923+00:00, run_duration=5.14623, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:56:00+00:00, data_interval_end=2024-04-05 01:57:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:57:05.349922656Z [2024-04-05T01:57:05.349+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:57:00+00:00, run_after=2024-04-05T01:58:00+00:00 2024-04-05T01:57:05.400957339Z [2024-04-05T01:57:05.400+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:56:00+00:00 exited with status success for try_number 1 2024-04-05T01:57:05.406846799Z [2024-04-05T01:57:05.406+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:56:00+00:00, map_index=-1, run_start_date=2024-04-05 01:57:03.238316+00:00, run_end_date=2024-04-05 01:57:04.865837+00:00, run_duration=1.627521, state=success, executor_state=success, try_number=1, max_tries=1, job_id=925, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:57:00.280861+00:00, queued_by_job_id=1, pid=13544 2024-04-05T01:57:06.443150320Z [2024-04-05T01:57:06.442+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:57:06.443458278Z [2024-04-05T01:57:06.443+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:56:00+00:00, run_id=scheduled__2024-04-05T01:56:00+00:00, run_start_date=2024-04-05 01:57:00.190065+00:00, run_end_date=2024-04-05 01:57:06.443035+00:00, run_duration=6.25297, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:56:00+00:00, data_interval_end=2024-04-05 01:57:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:57:06.455485224Z [2024-04-05T01:57:06.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:57:00+00:00, run_after=2024-04-05T01:58:00+00:00 2024-04-05T01:57:06.492039852Z [2024-04-05T01:57:06.491+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:56:00+00:00 exited with status success for try_number 1 2024-04-05T01:57:06.499690619Z [2024-04-05T01:57:06.498+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:56:00+00:00, map_index=-1, run_start_date=2024-04-05 01:57:03.675785+00:00, run_end_date=2024-04-05 01:57:06.099074+00:00, run_duration=2.423289, state=success, executor_state=success, try_number=1, max_tries=1, job_id=926, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:57:00.280861+00:00, queued_by_job_id=1, pid=13555 2024-04-05T01:58:01.033246155Z [2024-04-05T01:58:01.032+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:58:01.044150733Z [2024-04-05T01:58:01.043+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:58:01.067854603Z [2024-04-05T01:58:01.067+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:58:00+00:00, run_after=2024-04-05T01:59:00+00:00 2024-04-05T01:58:01.085225459Z [2024-04-05T01:58:01.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:58:00+00:00, run_after=2024-04-05T01:59:00+00:00 2024-04-05T01:58:01.325470226Z [2024-04-05T01:58:01.315+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T01:58:01.325505705Z 2024-04-05T01:58:01.325516789Z 2024-04-05T01:58:01.325522883Z 2024-04-05T01:58:01.325531605Z 2024-04-05T01:58:01.325540458Z [2024-04-05T01:58:01.316+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T01:58:01.325545561Z [2024-04-05T01:58:01.316+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:58:01.325551009Z [2024-04-05T01:58:01.316+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:58:01.325555958Z [2024-04-05T01:58:01.316+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:58:01.325560953Z [2024-04-05T01:58:01.317+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:58:01.325565912Z 2024-04-05T01:58:01.325570584Z 2024-04-05T01:58:01.325575962Z 2024-04-05T01:58:01.325580335Z 2024-04-05T01:58:01.335140062Z [2024-04-05T01:58:01.333+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:58:01.335167652Z [2024-04-05T01:58:01.333+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T01:58:01.335173236Z [2024-04-05T01:58:01.334+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:58:01.335189821Z [2024-04-05T01:58:01.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:58:01.335193066Z [2024-04-05T01:58:01.334+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:58:01.335196562Z [2024-04-05T01:58:01.334+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:58:01.335447184Z [2024-04-05T01:58:01.335+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:58:01.335653188Z [2024-04-05T01:58:01.335+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:58:02.020210524Z [2024-04-05T01:58:02.019+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:56:00+00:00 exited with status queued for try_number 1 2024-04-05T01:58:02.020592760Z [2024-04-05T01:58:02.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:57:00+00:00 exited with status queued for try_number 1 2024-04-05T01:58:02.020901451Z [2024-04-05T01:58:02.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:57:00+00:00 exited with status queued for try_number 1 2024-04-05T01:58:02.021185464Z [2024-04-05T01:58:02.020+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:57:00+00:00 exited with status queued for try_number 1 2024-04-05T01:58:02.047368022Z [2024-04-05T01:58:02.046+0000] {scheduler_job.py:635} INFO - Setting external_id for to 791044eb-59df-495d-b144-f801d8b625f6 2024-04-05T01:58:02.047874445Z [2024-04-05T01:58:02.047+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f5e1e4a-b014-46c7-a31a-6eaa97f89d90 2024-04-05T01:58:02.048239030Z [2024-04-05T01:58:02.047+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0a2d93b-aa09-413c-bac9-a6755c198d03 2024-04-05T01:58:02.048590191Z [2024-04-05T01:58:02.048+0000] {scheduler_job.py:635} INFO - Setting external_id for to 266386eb-0f09-4ec2-9fde-7939f4704983 2024-04-05T01:58:04.004348692Z [2024-04-05T01:58:04.003+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:58:04.004786091Z [2024-04-05T01:58:04.004+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:56:00+00:00, run_id=scheduled__2024-04-05T01:56:00+00:00, run_start_date=2024-04-05 01:58:01.104116+00:00, run_end_date=2024-04-05 01:58:04.004315+00:00, run_duration=2.900199, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:56:00+00:00, data_interval_end=2024-04-05 01:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T01:58:04.014892251Z [2024-04-05T01:58:04.014+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T01:58:00+00:00, run_after=2024-04-05T02:00:00+00:00 2024-04-05T01:58:04.028020172Z [2024-04-05T01:58:04.027+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:58:04.028416579Z [2024-04-05T01:58:04.028+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:57:00+00:00, run_id=scheduled__2024-04-05T01:57:00+00:00, run_start_date=2024-04-05 01:58:01.106166+00:00, run_end_date=2024-04-05 01:58:04.027998+00:00, run_duration=2.921832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:57:00+00:00, data_interval_end=2024-04-05 01:58:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:58:04.054634106Z [2024-04-05T01:58:04.054+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:58:00+00:00, run_after=2024-04-05T01:59:00+00:00 2024-04-05T01:58:04.104933656Z [2024-04-05T01:58:04.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:56:00+00:00 exited with status success for try_number 1 2024-04-05T01:58:04.107591027Z [2024-04-05T01:58:04.104+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:57:00+00:00 exited with status success for try_number 1 2024-04-05T01:58:04.115998567Z [2024-04-05T01:58:04.115+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:56:00+00:00, map_index=-1, run_start_date=2024-04-05 01:58:03.050697+00:00, run_end_date=2024-04-05 01:58:03.517733+00:00, run_duration=0.467036, state=success, executor_state=success, try_number=1, max_tries=1, job_id=927, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:58:01.329029+00:00, queued_by_job_id=1, pid=13583 2024-04-05T01:58:04.116348453Z [2024-04-05T01:58:04.116+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:57:00+00:00, map_index=-1, run_start_date=2024-04-05 01:58:03.170844+00:00, run_end_date=2024-04-05 01:58:03.837946+00:00, run_duration=0.667102, state=success, executor_state=success, try_number=1, max_tries=1, job_id=928, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:58:01.329029+00:00, queued_by_job_id=1, pid=13585 2024-04-05T01:58:06.271950233Z [2024-04-05T01:58:06.271+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:58:06.272333092Z [2024-04-05T01:58:06.272+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:57:00+00:00, run_id=scheduled__2024-04-05T01:57:00+00:00, run_start_date=2024-04-05 01:58:01.107801+00:00, run_end_date=2024-04-05 01:58:06.271842+00:00, run_duration=5.164041, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:57:00+00:00, data_interval_end=2024-04-05 01:58:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:58:06.284274831Z [2024-04-05T01:58:06.283+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:58:00+00:00, run_after=2024-04-05T01:59:00+00:00 2024-04-05T01:58:06.293212218Z [2024-04-05T01:58:06.292+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:58:06.293815245Z [2024-04-05T01:58:06.293+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:57:00+00:00, run_id=scheduled__2024-04-05T01:57:00+00:00, run_start_date=2024-04-05 01:58:01.109386+00:00, run_end_date=2024-04-05 01:58:06.293131+00:00, run_duration=5.183745, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:57:00+00:00, data_interval_end=2024-04-05 01:58:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:58:06.304181764Z [2024-04-05T01:58:06.303+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:58:00+00:00, run_after=2024-04-05T01:59:00+00:00 2024-04-05T01:58:06.366902820Z [2024-04-05T01:58:06.364+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:57:00+00:00 exited with status success for try_number 1 2024-04-05T01:58:06.366937185Z [2024-04-05T01:58:06.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:57:00+00:00 exited with status success for try_number 1 2024-04-05T01:58:06.376089171Z [2024-04-05T01:58:06.375+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:57:00+00:00, map_index=-1, run_start_date=2024-04-05 01:58:04.243253+00:00, run_end_date=2024-04-05 01:58:05.678117+00:00, run_duration=1.434864, state=success, executor_state=success, try_number=1, max_tries=1, job_id=930, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:58:01.329029+00:00, queued_by_job_id=1, pid=13608 2024-04-05T01:58:06.376443979Z [2024-04-05T01:58:06.376+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:57:00+00:00, map_index=-1, run_start_date=2024-04-05 01:58:04.219022+00:00, run_end_date=2024-04-05 01:58:05.937615+00:00, run_duration=1.718593, state=success, executor_state=success, try_number=1, max_tries=1, job_id=929, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:58:01.329029+00:00, queued_by_job_id=1, pid=13607 2024-04-05T01:59:00.975845036Z [2024-04-05T01:59:00.975+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T01:59:00.990460805Z [2024-04-05T01:59:00.990+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:59:00+00:00, run_after=2024-04-05T02:00:00+00:00 2024-04-05T01:59:01.006432796Z [2024-04-05T01:59:01.006+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:59:00+00:00, run_after=2024-04-05T02:00:00+00:00 2024-04-05T01:59:01.090052981Z [2024-04-05T01:59:01.089+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T01:59:01.090094436Z 2024-04-05T01:59:01.090104971Z 2024-04-05T01:59:01.090115093Z 2024-04-05T01:59:01.090901197Z [2024-04-05T01:59:01.090+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:59:01.091431071Z [2024-04-05T01:59:01.091+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T01:59:01.092216517Z [2024-04-05T01:59:01.091+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T01:59:01.094204880Z [2024-04-05T01:59:01.093+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T01:59:01.094229369Z 2024-04-05T01:59:01.094238287Z 2024-04-05T01:59:01.094246760Z 2024-04-05T01:59:01.101536068Z [2024-04-05T01:59:01.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:59:01.101996805Z [2024-04-05T01:59:01.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T01:59:01.102692566Z [2024-04-05T01:59:01.102+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:59:01.103049958Z [2024-04-05T01:59:01.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T01:59:01.103718152Z [2024-04-05T01:59:01.103+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T01:59:01.104114120Z [2024-04-05T01:59:01.103+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T01:59:01.469103474Z [2024-04-05T01:59:01.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:58:00+00:00 exited with status queued for try_number 1 2024-04-05T01:59:01.469272493Z [2024-04-05T01:59:01.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:58:00+00:00 exited with status queued for try_number 1 2024-04-05T01:59:01.469518804Z [2024-04-05T01:59:01.469+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:58:00+00:00 exited with status queued for try_number 1 2024-04-05T01:59:01.484340607Z [2024-04-05T01:59:01.483+0000] {scheduler_job.py:635} INFO - Setting external_id for to d7ccd8cf-1aca-4499-bd81-9ee8ea8d568f 2024-04-05T01:59:01.484818089Z [2024-04-05T01:59:01.484+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9598d2b9-c883-40f3-824c-3c8cae679f4f 2024-04-05T01:59:01.485427359Z [2024-04-05T01:59:01.485+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1214e0c7-a5ff-4be5-ba07-73505ca15615 2024-04-05T01:59:03.939930565Z [2024-04-05T01:59:03.939+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:59:03.940440369Z [2024-04-05T01:59:03.940+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:58:00+00:00, run_id=scheduled__2024-04-05T01:58:00+00:00, run_start_date=2024-04-05 01:59:01.026834+00:00, run_end_date=2024-04-05 01:59:03.939841+00:00, run_duration=2.913007, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:58:00+00:00, data_interval_end=2024-04-05 01:59:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T01:59:03.953993961Z [2024-04-05T01:59:03.953+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T01:59:00+00:00, run_after=2024-04-05T02:00:00+00:00 2024-04-05T01:59:04.028163306Z [2024-04-05T01:59:04.027+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:58:00+00:00 exited with status success for try_number 1 2024-04-05T01:59:04.041086093Z [2024-04-05T01:59:04.040+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:58:00+00:00, map_index=-1, run_start_date=2024-04-05 01:59:02.188259+00:00, run_end_date=2024-04-05 01:59:02.713875+00:00, run_duration=0.525616, state=success, executor_state=success, try_number=1, max_tries=1, job_id=931, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:59:01.096424+00:00, queued_by_job_id=1, pid=13640 2024-04-05T01:59:06.133037444Z [2024-04-05T01:59:06.132+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:59:06.133593785Z [2024-04-05T01:59:06.133+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:58:00+00:00, run_id=scheduled__2024-04-05T01:58:00+00:00, run_start_date=2024-04-05 01:59:01.028126+00:00, run_end_date=2024-04-05 01:59:06.133058+00:00, run_duration=5.104932, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:58:00+00:00, data_interval_end=2024-04-05 01:59:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T01:59:06.152338056Z [2024-04-05T01:59:06.151+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:59:00+00:00, run_after=2024-04-05T02:00:00+00:00 2024-04-05T01:59:07.256711542Z [2024-04-05T01:59:07.256+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T01:59:07.257097199Z [2024-04-05T01:59:07.256+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:58:00+00:00, run_id=scheduled__2024-04-05T01:58:00+00:00, run_start_date=2024-04-05 01:59:01.029398+00:00, run_end_date=2024-04-05 01:59:07.256601+00:00, run_duration=6.227203, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:58:00+00:00, data_interval_end=2024-04-05 01:59:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T01:59:07.267245564Z [2024-04-05T01:59:07.266+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T01:59:00+00:00, run_after=2024-04-05T02:00:00+00:00 2024-04-05T01:59:07.307552946Z [2024-04-05T01:59:07.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:58:00+00:00 exited with status success for try_number 1 2024-04-05T01:59:07.307774378Z [2024-04-05T01:59:07.307+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:58:00+00:00 exited with status success for try_number 1 2024-04-05T01:59:07.314653479Z [2024-04-05T01:59:07.314+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:58:00+00:00, map_index=-1, run_start_date=2024-04-05 01:59:03.829282+00:00, run_end_date=2024-04-05 01:59:06.079870+00:00, run_duration=2.250588, state=success, executor_state=success, try_number=1, max_tries=1, job_id=933, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:59:01.096424+00:00, queued_by_job_id=1, pid=13659 2024-04-05T01:59:07.314902496Z [2024-04-05T01:59:07.314+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:58:00+00:00, map_index=-1, run_start_date=2024-04-05 01:59:03.733220+00:00, run_end_date=2024-04-05 01:59:06.895064+00:00, run_duration=3.161844, state=success, executor_state=success, try_number=1, max_tries=1, job_id=932, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 01:59:01.096424+00:00, queued_by_job_id=1, pid=13658 2024-04-05T02:00:00.814300004Z [2024-04-05T02:00:00.813+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:00:00+00:00, run_after=2024-04-05T02:01:00+00:00 2024-04-05T02:00:00.842278514Z [2024-04-05T02:00:00.841+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:00:00+00:00, run_after=2024-04-05T02:01:00+00:00 2024-04-05T02:00:00.853477645Z [2024-04-05T02:00:00.853+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:00:00.876532088Z [2024-04-05T02:00:00.876+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:00:00+00:00, run_after=2024-04-05T02:05:00+00:00 2024-04-05T02:00:00.888153295Z [2024-04-05T02:00:00.887+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:00:01.068501531Z [2024-04-05T02:00:01.067+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T02:00:01.068537066Z 2024-04-05T02:00:01.068543035Z 2024-04-05T02:00:01.068549194Z 2024-04-05T02:00:01.068553543Z 2024-04-05T02:00:01.068558137Z 2024-04-05T02:00:01.068943575Z [2024-04-05T02:00:01.068+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:00:01.069241410Z [2024-04-05T02:00:01.068+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:00:01.069763356Z [2024-04-05T02:00:01.069+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:00:01.070069898Z [2024-04-05T02:00:01.069+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:00:01.070355963Z [2024-04-05T02:00:01.070+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:00:01.071628541Z [2024-04-05T02:00:01.071+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:00:01.071645789Z 2024-04-05T02:00:01.071651788Z 2024-04-05T02:00:01.071676718Z 2024-04-05T02:00:01.071681713Z 2024-04-05T02:00:01.071687041Z 2024-04-05T02:00:01.078419150Z [2024-04-05T02:00:01.077+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:00:01.078717932Z [2024-04-05T02:00:01.078+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:00:01.079171224Z [2024-04-05T02:00:01.078+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T01:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:00:01.079429152Z [2024-04-05T02:00:01.079+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:00:01.079874710Z [2024-04-05T02:00:01.079+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:00:01.080134063Z [2024-04-05T02:00:01.079+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:00:01.080529416Z [2024-04-05T02:00:01.080+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:00:01.080722856Z [2024-04-05T02:00:01.080+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:00:01.080965459Z [2024-04-05T02:00:01.080+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T01:59:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:00:01.081077429Z [2024-04-05T02:00:01.080+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:00:02.176182443Z [2024-04-05T02:00:02.175+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status queued for try_number 1 2024-04-05T02:00:02.176377520Z [2024-04-05T02:00:02.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:58:00+00:00 exited with status queued for try_number 1 2024-04-05T02:00:02.176560729Z [2024-04-05T02:00:02.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:59:00+00:00 exited with status queued for try_number 1 2024-04-05T02:00:02.176766947Z [2024-04-05T02:00:02.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:59:00+00:00 exited with status queued for try_number 1 2024-04-05T02:00:02.176916925Z [2024-04-05T02:00:02.176+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:59:00+00:00 exited with status queued for try_number 1 2024-04-05T02:00:02.196759114Z [2024-04-05T02:00:02.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5398bc7a-3c5a-4d05-a57c-a57225d00632 2024-04-05T02:00:02.196924756Z [2024-04-05T02:00:02.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2f9817ad-f34f-41fe-bdd7-dadf93c1a739 2024-04-05T02:00:02.197160944Z [2024-04-05T02:00:02.196+0000] {scheduler_job.py:635} INFO - Setting external_id for to 54a27fc6-d33a-4d48-8a15-56d8c33ab7ec 2024-04-05T02:00:02.197395359Z [2024-04-05T02:00:02.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to a0d461d5-ab81-40ac-8e88-24ad5aaca871 2024-04-05T02:00:02.197721433Z [2024-04-05T02:00:02.197+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7e2cf8b7-e7ef-4ae0-a2d3-813e7147afdd 2024-04-05T02:00:04.871945772Z [2024-04-05T02:00:04.871+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:00:04.872218526Z [2024-04-05T02:00:04.871+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 01:58:00+00:00, run_id=scheduled__2024-04-05T01:58:00+00:00, run_start_date=2024-04-05 02:00:00.914134+00:00, run_end_date=2024-04-05 02:00:04.871810+00:00, run_duration=3.957676, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:58:00+00:00, data_interval_end=2024-04-05 02:00:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:00:04.881585758Z [2024-04-05T02:00:04.881+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:00:00+00:00, run_after=2024-04-05T02:02:00+00:00 2024-04-05T02:00:04.895892026Z [2024-04-05T02:00:04.895+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:00:04.896130945Z [2024-04-05T02:00:04.895+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 01:59:00+00:00, run_id=scheduled__2024-04-05T01:59:00+00:00, run_start_date=2024-04-05 02:00:00.916012+00:00, run_end_date=2024-04-05 02:00:04.895793+00:00, run_duration=3.979781, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:59:00+00:00, data_interval_end=2024-04-05 02:00:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:00:04.912546656Z [2024-04-05T02:00:04.912+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:00:00+00:00, run_after=2024-04-05T02:01:00+00:00 2024-04-05T02:00:05.025277823Z [2024-04-05T02:00:05.022+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T01:58:00+00:00 exited with status success for try_number 1 2024-04-05T02:00:05.025368325Z [2024-04-05T02:00:05.025+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:59:00+00:00 exited with status success for try_number 1 2024-04-05T02:00:05.034987507Z [2024-04-05T02:00:05.034+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:59:00+00:00, map_index=-1, run_start_date=2024-04-05 02:00:03.337816+00:00, run_end_date=2024-04-05 02:00:04.185071+00:00, run_duration=0.847255, state=success, executor_state=success, try_number=1, max_tries=1, job_id=935, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:00:01.073419+00:00, queued_by_job_id=1, pid=13695 2024-04-05T02:00:05.035081979Z [2024-04-05T02:00:05.034+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T01:58:00+00:00, map_index=-1, run_start_date=2024-04-05 02:00:02.962135+00:00, run_end_date=2024-04-05 02:00:03.790143+00:00, run_duration=0.828008, state=success, executor_state=success, try_number=1, max_tries=1, job_id=934, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:00:01.073419+00:00, queued_by_job_id=1, pid=13694 2024-04-05T02:00:06.171836916Z [2024-04-05T02:00:06.171+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:00:06.171865034Z 2024-04-05T02:00:06.172041042Z [2024-04-05T02:00:06.171+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:00:06.173085949Z [2024-04-05T02:00:06.172+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:00:06.173098435Z 2024-04-05T02:00:06.178877777Z [2024-04-05T02:00:06.177+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:00:06.178905022Z [2024-04-05T02:00:06.177+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:00:06.256738363Z [2024-04-05T02:00:06.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status queued for try_number 1 2024-04-05T02:00:06.257013678Z [2024-04-05T02:00:06.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status success for try_number 1 2024-04-05T02:00:06.264638215Z [2024-04-05T02:00:06.264+0000] {scheduler_job.py:635} INFO - Setting external_id for to e0d7de8f-72b8-4fb3-9d26-c77d9b749c81 2024-04-05T02:00:06.265085010Z [2024-04-05T02:00:06.264+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T01:55:00+00:00, map_index=-1, run_start_date=2024-04-05 02:00:05.172384+00:00, run_end_date=2024-04-05 02:00:05.636642+00:00, run_duration=0.464258, state=success, executor_state=success, try_number=1, max_tries=1, job_id=937, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:00:01.073419+00:00, queued_by_job_id=1, pid=13725 2024-04-05T02:00:06.351806064Z [2024-04-05T02:00:06.349+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:00:06.351835657Z [2024-04-05T02:00:06.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:59:00+00:00, run_id=scheduled__2024-04-05T01:59:00+00:00, run_start_date=2024-04-05 02:00:00.917920+00:00, run_end_date=2024-04-05 02:00:06.349932+00:00, run_duration=5.432012, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:59:00+00:00, data_interval_end=2024-04-05 02:00:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:00:06.373624979Z [2024-04-05T02:00:06.370+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:00:00+00:00, run_after=2024-04-05T02:01:00+00:00 2024-04-05T02:00:07.349800877Z [2024-04-05T02:00:07.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:59:00+00:00 exited with status success for try_number 1 2024-04-05T02:00:07.360544809Z [2024-04-05T02:00:07.360+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:59:00+00:00, map_index=-1, run_start_date=2024-04-05 02:00:04.812262+00:00, run_end_date=2024-04-05 02:00:06.316457+00:00, run_duration=1.504195, state=success, executor_state=success, try_number=1, max_tries=1, job_id=936, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:00:01.073419+00:00, queued_by_job_id=1, pid=13714 2024-04-05T02:00:07.713226309Z [2024-04-05T02:00:07.712+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:00:07.713843074Z [2024-04-05T02:00:07.713+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:59:00+00:00, run_id=scheduled__2024-04-05T01:59:00+00:00, run_start_date=2024-04-05 02:00:00.919887+00:00, run_end_date=2024-04-05 02:00:07.713125+00:00, run_duration=6.793238, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:59:00+00:00, data_interval_end=2024-04-05 02:00:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:00:07.730559382Z [2024-04-05T02:00:07.730+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:00:00+00:00, run_after=2024-04-05T02:01:00+00:00 2024-04-05T02:00:07.797331474Z [2024-04-05T02:00:07.796+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T01:59:00+00:00 exited with status success for try_number 1 2024-04-05T02:00:07.806500766Z [2024-04-05T02:00:07.805+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T01:59:00+00:00, map_index=-1, run_start_date=2024-04-05 02:00:05.537844+00:00, run_end_date=2024-04-05 02:00:07.279351+00:00, run_duration=1.741507, state=success, executor_state=success, try_number=1, max_tries=1, job_id=938, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:00:01.073419+00:00, queued_by_job_id=1, pid=13731 2024-04-05T02:00:08.899530166Z [2024-04-05T02:00:08.899+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:00:08.899602782Z 2024-04-05T02:00:08.899806525Z [2024-04-05T02:00:08.899+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:00:08.900537101Z [2024-04-05T02:00:08.900+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:00:08.900555535Z 2024-04-05T02:00:08.903652084Z [2024-04-05T02:00:08.903+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T01:55:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:00:08.903841738Z [2024-04-05T02:00:08.903+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:00:08.964682099Z [2024-04-05T02:00:08.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status queued for try_number 1 2024-04-05T02:00:08.964893654Z [2024-04-05T02:00:08.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status success for try_number 1 2024-04-05T02:00:08.971655135Z [2024-04-05T02:00:08.971+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68291066-645d-4312-a8d4-4a835ed4321a 2024-04-05T02:00:08.972007956Z [2024-04-05T02:00:08.971+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T01:55:00+00:00, map_index=-1, run_start_date=2024-04-05 02:00:08.196927+00:00, run_end_date=2024-04-05 02:00:08.587192+00:00, run_duration=0.390265, state=success, executor_state=success, try_number=1, max_tries=1, job_id=939, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:00:06.173711+00:00, queued_by_job_id=1, pid=13749 2024-04-05T02:00:12.216263128Z [2024-04-05T02:00:12.215+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:00:12.216303112Z 2024-04-05T02:00:12.216729624Z [2024-04-05T02:00:12.216+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:00:12.217539684Z [2024-04-05T02:00:12.217+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:00:12.217558728Z 2024-04-05T02:00:12.221820058Z [2024-04-05T02:00:12.221+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T01:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:00:12.222167516Z [2024-04-05T02:00:12.221+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:00:12.290406342Z [2024-04-05T02:00:12.289+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status queued for try_number 1 2024-04-05T02:00:12.291038044Z [2024-04-05T02:00:12.290+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status success for try_number 1 2024-04-05T02:00:12.300799670Z [2024-04-05T02:00:12.300+0000] {scheduler_job.py:635} INFO - Setting external_id for to c9efffbb-b29c-4bbb-adc3-62ec39242b26 2024-04-05T02:00:12.301097674Z [2024-04-05T02:00:12.300+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T01:55:00+00:00, map_index=0, run_start_date=2024-04-05 02:00:10.645010+00:00, run_end_date=2024-04-05 02:00:12.112279+00:00, run_duration=1.467269, state=success, executor_state=success, try_number=1, max_tries=1, job_id=940, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:00:08.901019+00:00, queued_by_job_id=1, pid=13768 2024-04-05T02:00:14.558467657Z [2024-04-05T02:00:14.557+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:00:14.558666659Z [2024-04-05T02:00:14.558+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 01:55:00+00:00, run_id=scheduled__2024-04-05T01:55:00+00:00, run_start_date=2024-04-05 02:00:00.912083+00:00, run_end_date=2024-04-05 02:00:14.558261+00:00, run_duration=13.646178, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 01:55:00+00:00, data_interval_end=2024-04-05 02:00:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T02:00:14.565941041Z [2024-04-05T02:00:14.565+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:00:00+00:00, run_after=2024-04-05T02:05:00+00:00 2024-04-05T02:00:14.615696799Z [2024-04-05T02:00:14.615+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T01:55:00+00:00 exited with status success for try_number 1 2024-04-05T02:00:14.621356244Z [2024-04-05T02:00:14.620+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T01:55:00+00:00, map_index=-1, run_start_date=2024-04-05 02:00:13.988240+00:00, run_end_date=2024-04-05 02:00:14.374009+00:00, run_duration=0.385769, state=success, executor_state=success, try_number=1, max_tries=1, job_id=941, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:00:12.218216+00:00, queued_by_job_id=1, pid=13784 2024-04-05T02:00:41.675481103Z [2024-04-05T02:00:41.674+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:01:00.206377087Z [2024-04-05T02:01:00.206+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:01:00+00:00, run_after=2024-04-05T02:02:00+00:00 2024-04-05T02:01:00.227580811Z [2024-04-05T02:01:00.227+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:01:00.254437792Z [2024-04-05T02:01:00.254+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:01:00+00:00, run_after=2024-04-05T02:02:00+00:00 2024-04-05T02:01:00.347179767Z [2024-04-05T02:01:00.346+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:01:00.347204521Z 2024-04-05T02:01:00.347208193Z 2024-04-05T02:01:00.347211770Z 2024-04-05T02:01:00.347529994Z [2024-04-05T02:01:00.347+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:01:00.347804007Z [2024-04-05T02:01:00.347+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:01:00.348046319Z [2024-04-05T02:01:00.347+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:01:00.348755905Z [2024-04-05T02:01:00.348+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:01:00.348766940Z 2024-04-05T02:01:00.348770784Z 2024-04-05T02:01:00.348806408Z 2024-04-05T02:01:00.352449017Z [2024-04-05T02:01:00.351+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:01:00.352900022Z [2024-04-05T02:01:00.352+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:01:00.353470962Z [2024-04-05T02:01:00.353+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:01:00.353829497Z [2024-04-05T02:01:00.353+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:01:00.354320083Z [2024-04-05T02:01:00.354+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:01:00.354700758Z [2024-04-05T02:01:00.354+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:01:00.738772934Z [2024-04-05T02:01:00.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status queued for try_number 1 2024-04-05T02:01:00.738851611Z [2024-04-05T02:01:00.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status queued for try_number 1 2024-04-05T02:01:00.738856569Z [2024-04-05T02:01:00.738+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status queued for try_number 1 2024-04-05T02:01:00.749371170Z [2024-04-05T02:01:00.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3577f6d-6f45-4111-a9fe-c07afe75beef 2024-04-05T02:01:00.749443584Z [2024-04-05T02:01:00.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3ea50905-b1e0-4208-9ea1-3886bfce04a5 2024-04-05T02:01:00.749491456Z [2024-04-05T02:01:00.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8cb5dd50-02aa-4b31-9f62-afab288c4551 2024-04-05T02:01:03.005643237Z [2024-04-05T02:01:03.005+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:01:03.006327386Z [2024-04-05T02:01:03.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:00:00+00:00, run_id=scheduled__2024-04-05T02:00:00+00:00, run_start_date=2024-04-05 02:01:00.281987+00:00, run_end_date=2024-04-05 02:01:03.005692+00:00, run_duration=2.723705, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:00:00+00:00, data_interval_end=2024-04-05 02:01:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:01:03.024772776Z [2024-04-05T02:01:03.024+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:01:00+00:00, run_after=2024-04-05T02:02:00+00:00 2024-04-05T02:01:03.163833636Z [2024-04-05T02:01:03.163+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status success for try_number 1 2024-04-05T02:01:03.181325596Z [2024-04-05T02:01:03.180+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:00:00+00:00, map_index=-1, run_start_date=2024-04-05 02:01:01.454104+00:00, run_end_date=2024-04-05 02:01:02.407307+00:00, run_duration=0.953203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=942, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:01:00.349581+00:00, queued_by_job_id=1, pid=13793 2024-04-05T02:01:05.333074822Z [2024-04-05T02:01:05.332+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:01:05.333253839Z [2024-04-05T02:01:05.333+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:00:00+00:00, run_id=scheduled__2024-04-05T02:00:00+00:00, run_start_date=2024-04-05 02:01:00.284481+00:00, run_end_date=2024-04-05 02:01:05.332968+00:00, run_duration=5.048487, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:00:00+00:00, data_interval_end=2024-04-05 02:01:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:01:05.345109002Z [2024-04-05T02:01:05.344+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:01:00+00:00, run_after=2024-04-05T02:02:00+00:00 2024-04-05T02:01:05.387690327Z [2024-04-05T02:01:05.387+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status success for try_number 1 2024-04-05T02:01:05.393379034Z [2024-04-05T02:01:05.392+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:00:00+00:00, map_index=-1, run_start_date=2024-04-05 02:01:03.942758+00:00, run_end_date=2024-04-05 02:01:05.207475+00:00, run_duration=1.264717, state=success, executor_state=success, try_number=1, max_tries=1, job_id=944, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:01:00.349581+00:00, queued_by_job_id=1, pid=13817 2024-04-05T02:01:06.442741784Z [2024-04-05T02:01:06.442+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:01:06.443350887Z [2024-04-05T02:01:06.442+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:00:00+00:00, run_id=scheduled__2024-04-05T02:00:00+00:00, run_start_date=2024-04-05 02:01:00.286662+00:00, run_end_date=2024-04-05 02:01:06.442628+00:00, run_duration=6.155966, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:00:00+00:00, data_interval_end=2024-04-05 02:01:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:01:06.462920286Z [2024-04-05T02:01:06.462+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:01:00+00:00, run_after=2024-04-05T02:02:00+00:00 2024-04-05T02:01:06.499406011Z [2024-04-05T02:01:06.498+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status success for try_number 1 2024-04-05T02:01:06.509849800Z [2024-04-05T02:01:06.509+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:00:00+00:00, map_index=-1, run_start_date=2024-04-05 02:01:03.577786+00:00, run_end_date=2024-04-05 02:01:05.337697+00:00, run_duration=1.759911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=943, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:01:00.349581+00:00, queued_by_job_id=1, pid=13806 2024-04-05T02:02:01.034000862Z [2024-04-05T02:02:01.033+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:02:00+00:00, run_after=2024-04-05T02:03:00+00:00 2024-04-05T02:02:01.076243750Z [2024-04-05T02:02:01.075+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:02:00+00:00, run_after=2024-04-05T02:03:00+00:00 2024-04-05T02:02:01.094918757Z [2024-04-05T02:02:01.094+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:02:01.121617620Z [2024-04-05T02:02:01.121+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:02:01.314676158Z [2024-04-05T02:02:01.314+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:02:01.314719625Z 2024-04-05T02:02:01.314726836Z 2024-04-05T02:02:01.314731938Z 2024-04-05T02:02:01.314737245Z 2024-04-05T02:02:01.315183894Z [2024-04-05T02:02:01.314+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:02:01.315505373Z [2024-04-05T02:02:01.315+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:02:01.315829600Z [2024-04-05T02:02:01.315+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:02:01.316034663Z [2024-04-05T02:02:01.315+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:02:01.316980865Z [2024-04-05T02:02:01.316+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:02:01.316993363Z 2024-04-05T02:02:01.316997332Z 2024-04-05T02:02:01.317001017Z 2024-04-05T02:02:01.317004375Z 2024-04-05T02:02:01.321501265Z [2024-04-05T02:02:01.320+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:02:01.321523827Z [2024-04-05T02:02:01.321+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:02:01.321530448Z [2024-04-05T02:02:01.321+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:02:01.322776544Z [2024-04-05T02:02:01.321+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:02:01.323693157Z [2024-04-05T02:02:01.323+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:02:01.323963618Z [2024-04-05T02:02:01.323+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:02:01.324354929Z [2024-04-05T02:02:01.324+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:01:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:02:01.324458493Z [2024-04-05T02:02:01.324+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:02:01.782136807Z [2024-04-05T02:02:01.775+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status queued for try_number 1 2024-04-05T02:02:01.782169418Z [2024-04-05T02:02:01.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:01:00+00:00 exited with status queued for try_number 1 2024-04-05T02:02:01.782173964Z [2024-04-05T02:02:01.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:01:00+00:00 exited with status queued for try_number 1 2024-04-05T02:02:01.782177894Z [2024-04-05T02:02:01.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:01:00+00:00 exited with status queued for try_number 1 2024-04-05T02:02:01.802667272Z [2024-04-05T02:02:01.801+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5c6fd68-ea2f-49bd-9705-b72f3eea2e21 2024-04-05T02:02:01.802709697Z [2024-04-05T02:02:01.801+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5c3e2799-9c2e-41fc-bb50-99e6a57892a6 2024-04-05T02:02:01.802716411Z [2024-04-05T02:02:01.802+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5f7aa439-34f5-4129-98c3-cb3d81e11257 2024-04-05T02:02:01.802722036Z [2024-04-05T02:02:01.802+0000] {scheduler_job.py:635} INFO - Setting external_id for to d00a0f62-9864-4cb7-a07d-0c54124f5901 2024-04-05T02:02:05.213716715Z [2024-04-05T02:02:05.212+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:02:05.214199092Z [2024-04-05T02:02:05.213+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:00:00+00:00, run_id=scheduled__2024-04-05T02:00:00+00:00, run_start_date=2024-04-05 02:02:01.160245+00:00, run_end_date=2024-04-05 02:02:05.213598+00:00, run_duration=4.053353, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:00:00+00:00, data_interval_end=2024-04-05 02:02:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:02:05.224718297Z [2024-04-05T02:02:05.224+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:02:00+00:00, run_after=2024-04-05T02:04:00+00:00 2024-04-05T02:02:05.237877390Z [2024-04-05T02:02:05.237+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:02:05.238096941Z [2024-04-05T02:02:05.237+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:01:00+00:00, run_id=scheduled__2024-04-05T02:01:00+00:00, run_start_date=2024-04-05 02:02:01.180232+00:00, run_end_date=2024-04-05 02:02:05.237772+00:00, run_duration=4.05754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:01:00+00:00, data_interval_end=2024-04-05 02:02:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:02:05.248944643Z [2024-04-05T02:02:05.248+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:02:00+00:00, run_after=2024-04-05T02:03:00+00:00 2024-04-05T02:02:05.301124494Z [2024-04-05T02:02:05.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status success for try_number 1 2024-04-05T02:02:05.301153761Z [2024-04-05T02:02:05.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:01:00+00:00 exited with status success for try_number 1 2024-04-05T02:02:05.310158217Z [2024-04-05T02:02:05.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:01:00+00:00, map_index=-1, run_start_date=2024-04-05 02:02:02.916011+00:00, run_end_date=2024-04-05 02:02:04.004720+00:00, run_duration=1.088709, state=success, executor_state=success, try_number=1, max_tries=1, job_id=945, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:02:01.318023+00:00, queued_by_job_id=1, pid=13846 2024-04-05T02:02:05.310262470Z [2024-04-05T02:02:05.310+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:00:00+00:00, map_index=-1, run_start_date=2024-04-05 02:02:03.036878+00:00, run_end_date=2024-04-05 02:02:03.991516+00:00, run_duration=0.954638, state=success, executor_state=success, try_number=1, max_tries=1, job_id=946, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:02:01.318023+00:00, queued_by_job_id=1, pid=13847 2024-04-05T02:02:07.453028690Z [2024-04-05T02:02:07.452+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:02:07.453439727Z [2024-04-05T02:02:07.453+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:01:00+00:00, run_id=scheduled__2024-04-05T02:01:00+00:00, run_start_date=2024-04-05 02:02:01.184148+00:00, run_end_date=2024-04-05 02:02:07.453020+00:00, run_duration=6.268872, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:01:00+00:00, data_interval_end=2024-04-05 02:02:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:02:07.464442849Z [2024-04-05T02:02:07.464+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:02:00+00:00, run_after=2024-04-05T02:03:00+00:00 2024-04-05T02:02:07.472778071Z [2024-04-05T02:02:07.472+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:02:07.473172267Z [2024-04-05T02:02:07.472+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:01:00+00:00, run_id=scheduled__2024-04-05T02:01:00+00:00, run_start_date=2024-04-05 02:02:01.192196+00:00, run_end_date=2024-04-05 02:02:07.472774+00:00, run_duration=6.280578, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:01:00+00:00, data_interval_end=2024-04-05 02:02:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:02:07.483078197Z [2024-04-05T02:02:07.482+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:02:00+00:00, run_after=2024-04-05T02:03:00+00:00 2024-04-05T02:02:07.518087466Z [2024-04-05T02:02:07.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:01:00+00:00 exited with status success for try_number 1 2024-04-05T02:02:07.518243352Z [2024-04-05T02:02:07.518+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:01:00+00:00 exited with status success for try_number 1 2024-04-05T02:02:07.525631274Z [2024-04-05T02:02:07.525+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:01:00+00:00, map_index=-1, run_start_date=2024-04-05 02:02:04.639462+00:00, run_end_date=2024-04-05 02:02:06.339774+00:00, run_duration=1.700312, state=success, executor_state=success, try_number=1, max_tries=1, job_id=948, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:02:01.318023+00:00, queued_by_job_id=1, pid=13870 2024-04-05T02:02:07.525938876Z [2024-04-05T02:02:07.525+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:01:00+00:00, map_index=-1, run_start_date=2024-04-05 02:02:04.291195+00:00, run_end_date=2024-04-05 02:02:06.584725+00:00, run_duration=2.29353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=947, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:02:01.318023+00:00, queued_by_job_id=1, pid=13864 2024-04-05T02:03:00.896579515Z [2024-04-05T02:03:00.896+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:03:00.921071949Z [2024-04-05T02:03:00.920+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:03:00+00:00, run_after=2024-04-05T02:04:00+00:00 2024-04-05T02:03:00.949545096Z [2024-04-05T02:03:00.949+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:03:00+00:00, run_after=2024-04-05T02:04:00+00:00 2024-04-05T02:03:01.072204478Z [2024-04-05T02:03:01.071+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:03:01.072231573Z 2024-04-05T02:03:01.072235848Z 2024-04-05T02:03:01.072239631Z 2024-04-05T02:03:01.072639812Z [2024-04-05T02:03:01.072+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:03:01.072974626Z [2024-04-05T02:03:01.072+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:03:01.073362707Z [2024-04-05T02:03:01.073+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:03:01.074191705Z [2024-04-05T02:03:01.073+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:03:01.074205038Z 2024-04-05T02:03:01.074209238Z 2024-04-05T02:03:01.074212801Z 2024-04-05T02:03:01.083415869Z [2024-04-05T02:03:01.082+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:03:01.083770920Z [2024-04-05T02:03:01.083+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:03:01.084181986Z [2024-04-05T02:03:01.083+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:03:01.084468290Z [2024-04-05T02:03:01.084+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:03:01.084870665Z [2024-04-05T02:03:01.084+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:03:01.085097143Z [2024-04-05T02:03:01.084+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:03:01.628873735Z [2024-04-05T02:03:01.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:02:00+00:00 exited with status queued for try_number 1 2024-04-05T02:03:01.628907115Z [2024-04-05T02:03:01.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:02:00+00:00 exited with status queued for try_number 1 2024-04-05T02:03:01.628970694Z [2024-04-05T02:03:01.628+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:02:00+00:00 exited with status queued for try_number 1 2024-04-05T02:03:01.653140687Z [2024-04-05T02:03:01.652+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76106a41-a77a-4646-aaa5-3e4b67499477 2024-04-05T02:03:01.653190060Z [2024-04-05T02:03:01.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to a46b884e-2c3d-47cb-b01d-42ad6e01030e 2024-04-05T02:03:01.653325619Z [2024-04-05T02:03:01.653+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7bd9342c-4bc3-47fb-b366-30d7ae1eb007 2024-04-05T02:03:04.289633507Z [2024-04-05T02:03:04.289+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:03:04.290060096Z [2024-04-05T02:03:04.289+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:02:00+00:00, run_id=scheduled__2024-04-05T02:02:00+00:00, run_start_date=2024-04-05 02:03:00.963953+00:00, run_end_date=2024-04-05 02:03:04.289507+00:00, run_duration=3.325554, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:02:00+00:00, data_interval_end=2024-04-05 02:03:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:03:04.308905583Z [2024-04-05T02:03:04.308+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:03:00+00:00, run_after=2024-04-05T02:04:00+00:00 2024-04-05T02:03:04.377171670Z [2024-04-05T02:03:04.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:02:00+00:00 exited with status success for try_number 1 2024-04-05T02:03:04.385478525Z [2024-04-05T02:03:04.384+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:02:00+00:00, map_index=-1, run_start_date=2024-04-05 02:03:02.956754+00:00, run_end_date=2024-04-05 02:03:03.568082+00:00, run_duration=0.611328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=949, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:03:01.078690+00:00, queued_by_job_id=1, pid=13904 2024-04-05T02:03:06.060807990Z [2024-04-05T02:03:06.059+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:03:06.061144245Z [2024-04-05T02:03:06.060+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:02:00+00:00, run_id=scheduled__2024-04-05T02:02:00+00:00, run_start_date=2024-04-05 02:03:00.965565+00:00, run_end_date=2024-04-05 02:03:06.060819+00:00, run_duration=5.095254, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:02:00+00:00, data_interval_end=2024-04-05 02:03:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:03:06.074937980Z [2024-04-05T02:03:06.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:03:00+00:00, run_after=2024-04-05T02:04:00+00:00 2024-04-05T02:03:06.132022754Z [2024-04-05T02:03:06.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:02:00+00:00 exited with status success for try_number 1 2024-04-05T02:03:06.138016772Z [2024-04-05T02:03:06.137+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:02:00+00:00, map_index=-1, run_start_date=2024-04-05 02:03:03.826935+00:00, run_end_date=2024-04-05 02:03:05.920949+00:00, run_duration=2.094014, state=success, executor_state=success, try_number=1, max_tries=1, job_id=950, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:03:01.078690+00:00, queued_by_job_id=1, pid=13920 2024-04-05T02:03:08.267168070Z [2024-04-05T02:03:08.266+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:03:08.267480988Z [2024-04-05T02:03:08.267+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:02:00+00:00, run_id=scheduled__2024-04-05T02:02:00+00:00, run_start_date=2024-04-05 02:03:00.967146+00:00, run_end_date=2024-04-05 02:03:08.267063+00:00, run_duration=7.299917, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:02:00+00:00, data_interval_end=2024-04-05 02:03:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:03:08.280720735Z [2024-04-05T02:03:08.280+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:03:00+00:00, run_after=2024-04-05T02:04:00+00:00 2024-04-05T02:03:08.318519756Z [2024-04-05T02:03:08.318+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:02:00+00:00 exited with status success for try_number 1 2024-04-05T02:03:08.325003744Z [2024-04-05T02:03:08.324+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:02:00+00:00, map_index=-1, run_start_date=2024-04-05 02:03:03.938475+00:00, run_end_date=2024-04-05 02:03:07.575812+00:00, run_duration=3.637337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=951, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:03:01.078690+00:00, queued_by_job_id=1, pid=13921 2024-04-05T02:04:00.307714310Z [2024-04-05T02:04:00.307+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:04:00+00:00, run_after=2024-04-05T02:05:00+00:00 2024-04-05T02:04:00.321324357Z [2024-04-05T02:04:00.320+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:04:00+00:00, run_after=2024-04-05T02:05:00+00:00 2024-04-05T02:04:00.329414508Z [2024-04-05T02:04:00.329+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:04:00.339337282Z [2024-04-05T02:04:00.339+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:04:00.477787227Z [2024-04-05T02:04:00.477+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:04:00.477817644Z 2024-04-05T02:04:00.477822035Z 2024-04-05T02:04:00.477846131Z 2024-04-05T02:04:00.477849323Z 2024-04-05T02:04:00.478104759Z [2024-04-05T02:04:00.477+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:04:00.478334483Z [2024-04-05T02:04:00.478+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:04:00.478509694Z [2024-04-05T02:04:00.478+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:04:00.478690851Z [2024-04-05T02:04:00.478+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:04:00.479436077Z [2024-04-05T02:04:00.479+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:04:00.479448155Z 2024-04-05T02:04:00.479451898Z 2024-04-05T02:04:00.479455103Z 2024-04-05T02:04:00.479458330Z 2024-04-05T02:04:00.483321222Z [2024-04-05T02:04:00.483+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:02:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:04:00.483587855Z [2024-04-05T02:04:00.483+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:04:00.483930885Z [2024-04-05T02:04:00.483+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:04:00.484127273Z [2024-04-05T02:04:00.483+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:04:00.484404871Z [2024-04-05T02:04:00.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:04:00.484673605Z [2024-04-05T02:04:00.484+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:04:00.485002872Z [2024-04-05T02:04:00.484+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:03:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:04:00.485217320Z [2024-04-05T02:04:00.485+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:04:01.173098355Z [2024-04-05T02:04:01.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:02:00+00:00 exited with status queued for try_number 1 2024-04-05T02:04:01.173132106Z [2024-04-05T02:04:01.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:03:00+00:00 exited with status queued for try_number 1 2024-04-05T02:04:01.173136372Z [2024-04-05T02:04:01.168+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:03:00+00:00 exited with status queued for try_number 1 2024-04-05T02:04:01.173140057Z [2024-04-05T02:04:01.169+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:03:00+00:00 exited with status queued for try_number 1 2024-04-05T02:04:01.224140690Z [2024-04-05T02:04:01.220+0000] {scheduler_job.py:635} INFO - Setting external_id for to acc32df5-e2b8-420c-9ff9-8bc3c7c74157 2024-04-05T02:04:01.224162641Z [2024-04-05T02:04:01.221+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4d958005-75d5-43ef-8835-86d3bbc1d72b 2024-04-05T02:04:01.224166598Z [2024-04-05T02:04:01.221+0000] {scheduler_job.py:635} INFO - Setting external_id for to 99144d1d-818a-489f-891f-e23845502731 2024-04-05T02:04:01.224170229Z [2024-04-05T02:04:01.221+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2a45fd10-60a4-41a8-9723-2819307022c8 2024-04-05T02:04:03.962881695Z [2024-04-05T02:04:03.962+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:04:03.963537297Z [2024-04-05T02:04:03.963+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:02:00+00:00, run_id=scheduled__2024-04-05T02:02:00+00:00, run_start_date=2024-04-05 02:04:00.377445+00:00, run_end_date=2024-04-05 02:04:03.963002+00:00, run_duration=3.585557, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:02:00+00:00, data_interval_end=2024-04-05 02:04:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:04:03.981025546Z [2024-04-05T02:04:03.980+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:04:00+00:00, run_after=2024-04-05T02:06:00+00:00 2024-04-05T02:04:03.997628296Z [2024-04-05T02:04:03.997+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:04:03.998245308Z [2024-04-05T02:04:03.997+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:03:00+00:00, run_id=scheduled__2024-04-05T02:03:00+00:00, run_start_date=2024-04-05 02:04:00.379532+00:00, run_end_date=2024-04-05 02:04:03.997575+00:00, run_duration=3.618043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:03:00+00:00, data_interval_end=2024-04-05 02:04:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:04:04.043640234Z [2024-04-05T02:04:04.043+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:04:00+00:00, run_after=2024-04-05T02:05:00+00:00 2024-04-05T02:04:04.153514113Z [2024-04-05T02:04:04.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:02:00+00:00 exited with status success for try_number 1 2024-04-05T02:04:04.154779738Z [2024-04-05T02:04:04.153+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:03:00+00:00 exited with status success for try_number 1 2024-04-05T02:04:04.170943513Z [2024-04-05T02:04:04.170+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:03:00+00:00, map_index=-1, run_start_date=2024-04-05 02:04:02.276552+00:00, run_end_date=2024-04-05 02:04:02.847328+00:00, run_duration=0.570776, state=success, executor_state=success, try_number=1, max_tries=1, job_id=952, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:04:00.480467+00:00, queued_by_job_id=1, pid=13954 2024-04-05T02:04:04.173192061Z [2024-04-05T02:04:04.172+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:02:00+00:00, map_index=-1, run_start_date=2024-04-05 02:04:02.390201+00:00, run_end_date=2024-04-05 02:04:03.052066+00:00, run_duration=0.661865, state=success, executor_state=success, try_number=1, max_tries=1, job_id=953, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:04:00.480467+00:00, queued_by_job_id=1, pid=13955 2024-04-05T02:04:06.330565831Z [2024-04-05T02:04:06.330+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:04:06.330849733Z [2024-04-05T02:04:06.330+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:03:00+00:00, run_id=scheduled__2024-04-05T02:03:00+00:00, run_start_date=2024-04-05 02:04:00.382847+00:00, run_end_date=2024-04-05 02:04:06.330438+00:00, run_duration=5.947591, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:03:00+00:00, data_interval_end=2024-04-05 02:04:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:04:06.340545653Z [2024-04-05T02:04:06.340+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:04:00+00:00, run_after=2024-04-05T02:05:00+00:00 2024-04-05T02:04:06.391110608Z [2024-04-05T02:04:06.390+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:03:00+00:00 exited with status success for try_number 1 2024-04-05T02:04:06.403138779Z [2024-04-05T02:04:06.402+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:03:00+00:00, map_index=-1, run_start_date=2024-04-05 02:04:03.665845+00:00, run_end_date=2024-04-05 02:04:05.480957+00:00, run_duration=1.815112, state=success, executor_state=success, try_number=1, max_tries=1, job_id=954, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:04:00.480467+00:00, queued_by_job_id=1, pid=13978 2024-04-05T02:04:07.481086557Z [2024-04-05T02:04:07.480+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:04:07.481473180Z [2024-04-05T02:04:07.481+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:03:00+00:00, run_id=scheduled__2024-04-05T02:03:00+00:00, run_start_date=2024-04-05 02:04:00.385132+00:00, run_end_date=2024-04-05 02:04:07.480944+00:00, run_duration=7.095812, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:03:00+00:00, data_interval_end=2024-04-05 02:04:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:04:07.496200741Z [2024-04-05T02:04:07.495+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:04:00+00:00, run_after=2024-04-05T02:05:00+00:00 2024-04-05T02:04:07.542511832Z [2024-04-05T02:04:07.542+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:03:00+00:00 exited with status success for try_number 1 2024-04-05T02:04:07.548472930Z [2024-04-05T02:04:07.548+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:03:00+00:00, map_index=-1, run_start_date=2024-04-05 02:04:03.868921+00:00, run_end_date=2024-04-05 02:04:06.428540+00:00, run_duration=2.559619, state=success, executor_state=success, try_number=1, max_tries=1, job_id=955, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:04:00.480467+00:00, queued_by_job_id=1, pid=13979 2024-04-05T02:05:00.648923072Z [2024-04-05T02:05:00.648+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:05:00+00:00, run_after=2024-04-05T02:06:00+00:00 2024-04-05T02:05:00.662022618Z [2024-04-05T02:05:00.661+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:05:00.674876765Z [2024-04-05T02:05:00.674+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:05:00+00:00, run_after=2024-04-05T02:06:00+00:00 2024-04-05T02:05:00.688646114Z [2024-04-05T02:05:00.688+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:05:00+00:00, run_after=2024-04-05T02:10:00+00:00 2024-04-05T02:05:00.772921650Z [2024-04-05T02:05:00.772+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:05:00.772956402Z 2024-04-05T02:05:00.772984621Z 2024-04-05T02:05:00.772990556Z 2024-04-05T02:05:00.772996360Z 2024-04-05T02:05:00.773002279Z [2024-04-05T02:05:00.772+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:05:00.773019509Z [2024-04-05T02:05:00.772+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:05:00.773130806Z [2024-04-05T02:05:00.772+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:05:00.773216430Z [2024-04-05T02:05:00.773+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:05:00.773772661Z [2024-04-05T02:05:00.773+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:05:00.773785633Z 2024-04-05T02:05:00.773791856Z 2024-04-05T02:05:00.773797633Z 2024-04-05T02:05:00.773815570Z 2024-04-05T02:05:00.777442323Z [2024-04-05T02:05:00.777+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:05:00.777485712Z [2024-04-05T02:05:00.777+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:05:00.777734018Z [2024-04-05T02:05:00.777+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:05:00.777783242Z [2024-04-05T02:05:00.777+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:05:00.777969939Z [2024-04-05T02:05:00.777+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:05:00.777989621Z [2024-04-05T02:05:00.777+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:05:00.778195963Z [2024-04-05T02:05:00.778+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:05:00.778215152Z [2024-04-05T02:05:00.778+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:05:01.489450333Z [2024-04-05T02:05:01.488+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status queued for try_number 1 2024-04-05T02:05:01.489543683Z [2024-04-05T02:05:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:04:00+00:00 exited with status queued for try_number 1 2024-04-05T02:05:01.489705647Z [2024-04-05T02:05:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:04:00+00:00 exited with status queued for try_number 1 2024-04-05T02:05:01.489865806Z [2024-04-05T02:05:01.489+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:04:00+00:00 exited with status queued for try_number 1 2024-04-05T02:05:01.504732695Z [2024-04-05T02:05:01.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6354278a-7ea3-4b0f-87fa-5bfa2e947a31 2024-04-05T02:05:01.504953589Z [2024-04-05T02:05:01.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to 710b055c-cb16-4a63-b068-da585bc42991 2024-04-05T02:05:01.505164961Z [2024-04-05T02:05:01.504+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac3d0df9-fa6e-4c26-b1c8-b766e21f1414 2024-04-05T02:05:01.505391716Z [2024-04-05T02:05:01.505+0000] {scheduler_job.py:635} INFO - Setting external_id for to c2841d69-94af-4a9d-8285-3a2a7270dbb2 2024-04-05T02:05:03.364567869Z [2024-04-05T02:05:03.363+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:05:03.365230137Z [2024-04-05T02:05:03.364+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:04:00+00:00, run_id=scheduled__2024-04-05T02:04:00+00:00, run_start_date=2024-04-05 02:05:00.701001+00:00, run_end_date=2024-04-05 02:05:03.364617+00:00, run_duration=2.663616, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:04:00+00:00, data_interval_end=2024-04-05 02:05:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:05:03.387527375Z [2024-04-05T02:05:03.387+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:05:00+00:00, run_after=2024-04-05T02:06:00+00:00 2024-04-05T02:05:04.645230086Z [2024-04-05T02:05:04.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:04:00+00:00 exited with status success for try_number 1 2024-04-05T02:05:04.652084048Z [2024-04-05T02:05:04.651+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:04:00+00:00, map_index=-1, run_start_date=2024-04-05 02:05:02.590907+00:00, run_end_date=2024-04-05 02:05:03.233408+00:00, run_duration=0.642501, state=success, executor_state=success, try_number=1, max_tries=1, job_id=956, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:05:00.774600+00:00, queued_by_job_id=1, pid=14012 2024-04-05T02:05:05.729099867Z [2024-04-05T02:05:05.728+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:05:05.729551239Z [2024-04-05T02:05:05.729+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:04:00+00:00, run_id=scheduled__2024-04-05T02:04:00+00:00, run_start_date=2024-04-05 02:05:00.702393+00:00, run_end_date=2024-04-05 02:05:05.729171+00:00, run_duration=5.026778, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:04:00+00:00, data_interval_end=2024-04-05 02:05:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:05:05.740830834Z [2024-04-05T02:05:05.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:05:00+00:00, run_after=2024-04-05T02:06:00+00:00 2024-04-05T02:05:05.789837533Z [2024-04-05T02:05:05.789+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:05:05.789873584Z 2024-04-05T02:05:05.789888404Z [2024-04-05T02:05:05.789+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:05:05.790466103Z [2024-04-05T02:05:05.790+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:05:05.790478444Z 2024-04-05T02:05:05.793819036Z [2024-04-05T02:05:05.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:05:05.793874882Z [2024-04-05T02:05:05.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:05:05.871514205Z [2024-04-05T02:05:05.870+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status queued for try_number 1 2024-04-05T02:05:05.875346349Z [2024-04-05T02:05:05.871+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status success for try_number 1 2024-04-05T02:05:05.875486398Z [2024-04-05T02:05:05.875+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:04:00+00:00 exited with status success for try_number 1 2024-04-05T02:05:05.886041400Z [2024-04-05T02:05:05.884+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4e50a713-b54f-4e34-b043-216e29a9fb3f 2024-04-05T02:05:05.886777811Z [2024-04-05T02:05:05.886+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:00:00+00:00, map_index=-1, run_start_date=2024-04-05 02:05:04.249721+00:00, run_end_date=2024-04-05 02:05:04.695865+00:00, run_duration=0.446144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=959, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:05:00.774600+00:00, queued_by_job_id=1, pid=14038 2024-04-05T02:05:05.886965170Z [2024-04-05T02:05:05.886+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:04:00+00:00, map_index=-1, run_start_date=2024-04-05 02:05:04.005574+00:00, run_end_date=2024-04-05 02:05:05.330118+00:00, run_duration=1.324544, state=success, executor_state=success, try_number=1, max_tries=1, job_id=957, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:05:00.774600+00:00, queued_by_job_id=1, pid=14036 2024-04-05T02:05:07.050087437Z [2024-04-05T02:05:07.049+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:05:07.050724292Z [2024-04-05T02:05:07.050+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:04:00+00:00, run_id=scheduled__2024-04-05T02:04:00+00:00, run_start_date=2024-04-05 02:05:00.703605+00:00, run_end_date=2024-04-05 02:05:07.049928+00:00, run_duration=6.346323, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:04:00+00:00, data_interval_end=2024-04-05 02:05:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:05:07.075304146Z [2024-04-05T02:05:07.074+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:05:00+00:00, run_after=2024-04-05T02:06:00+00:00 2024-04-05T02:05:07.149608753Z [2024-04-05T02:05:07.149+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:04:00+00:00 exited with status success for try_number 1 2024-04-05T02:05:07.157492328Z [2024-04-05T02:05:07.157+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:04:00+00:00, map_index=-1, run_start_date=2024-04-05 02:05:04.185349+00:00, run_end_date=2024-04-05 02:05:06.060334+00:00, run_duration=1.874985, state=success, executor_state=success, try_number=1, max_tries=1, job_id=958, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:05:00.774600+00:00, queued_by_job_id=1, pid=14037 2024-04-05T02:05:08.488671125Z [2024-04-05T02:05:08.488+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:05:08.488707098Z 2024-04-05T02:05:08.488969909Z [2024-04-05T02:05:08.488+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:05:08.489910807Z [2024-04-05T02:05:08.489+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:05:08.489922173Z 2024-04-05T02:05:08.493477642Z [2024-04-05T02:05:08.493+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:00:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:05:08.493780719Z [2024-04-05T02:05:08.493+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:05:08.561092807Z [2024-04-05T02:05:08.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status queued for try_number 1 2024-04-05T02:05:08.561368734Z [2024-04-05T02:05:08.560+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status success for try_number 1 2024-04-05T02:05:08.572064177Z [2024-04-05T02:05:08.571+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9f751efe-dc44-43a4-b24a-10b1ae0725f5 2024-04-05T02:05:08.572677362Z [2024-04-05T02:05:08.572+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T02:00:00+00:00, map_index=-1, run_start_date=2024-04-05 02:05:07.787472+00:00, run_end_date=2024-04-05 02:05:08.218824+00:00, run_duration=0.431352, state=success, executor_state=success, try_number=1, max_tries=1, job_id=960, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:05:05.790901+00:00, queued_by_job_id=1, pid=14061 2024-04-05T02:05:12.269317347Z [2024-04-05T02:05:12.268+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:05:12.269424025Z 2024-04-05T02:05:12.269625807Z [2024-04-05T02:05:12.269+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:05:12.270373885Z [2024-04-05T02:05:12.270+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:05:12.270416946Z 2024-04-05T02:05:12.273711276Z [2024-04-05T02:05:12.273+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:05:12.273959003Z [2024-04-05T02:05:12.273+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:05:12.337437575Z [2024-04-05T02:05:12.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status queued for try_number 1 2024-04-05T02:05:12.337754964Z [2024-04-05T02:05:12.337+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status success for try_number 1 2024-04-05T02:05:12.344996195Z [2024-04-05T02:05:12.344+0000] {scheduler_job.py:635} INFO - Setting external_id for to 099c2b5f-5f85-4a85-8a73-203c9dafbc76 2024-04-05T02:05:12.345288559Z [2024-04-05T02:05:12.345+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:00:00+00:00, map_index=0, run_start_date=2024-04-05 02:05:10.474586+00:00, run_end_date=2024-04-05 02:05:11.870193+00:00, run_duration=1.395607, state=success, executor_state=success, try_number=1, max_tries=1, job_id=961, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:05:08.490519+00:00, queued_by_job_id=1, pid=14079 2024-04-05T02:05:14.580370637Z [2024-04-05T02:05:14.579+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:05:14.580955001Z [2024-04-05T02:05:14.580+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:00:00+00:00, run_id=scheduled__2024-04-05T02:00:00+00:00, run_start_date=2024-04-05 02:05:00.699659+00:00, run_end_date=2024-04-05 02:05:14.580267+00:00, run_duration=13.880608, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:00:00+00:00, data_interval_end=2024-04-05 02:05:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T02:05:14.590097074Z [2024-04-05T02:05:14.589+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:05:00+00:00, run_after=2024-04-05T02:10:00+00:00 2024-04-05T02:05:15.702295692Z [2024-04-05T02:05:15.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:00:00+00:00 exited with status success for try_number 1 2024-04-05T02:05:15.710364833Z [2024-04-05T02:05:15.709+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:00:00+00:00, map_index=-1, run_start_date=2024-04-05 02:05:14.179287+00:00, run_end_date=2024-04-05 02:05:14.552497+00:00, run_duration=0.37321, state=success, executor_state=success, try_number=1, max_tries=1, job_id=962, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:05:12.270990+00:00, queued_by_job_id=1, pid=14095 2024-04-05T02:05:41.742050800Z [2024-04-05T02:05:41.741+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:06:01.093616585Z [2024-04-05T02:06:01.093+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:06:00+00:00, run_after=2024-04-05T02:07:00+00:00 2024-04-05T02:06:01.106211595Z [2024-04-05T02:06:01.105+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:06:01.119718378Z [2024-04-05T02:06:01.119+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:06:01.142889768Z [2024-04-05T02:06:01.142+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:06:00+00:00, run_after=2024-04-05T02:07:00+00:00 2024-04-05T02:06:01.301288918Z [2024-04-05T02:06:01.300+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:06:01.301319284Z 2024-04-05T02:06:01.301324303Z 2024-04-05T02:06:01.301327805Z 2024-04-05T02:06:01.301331237Z 2024-04-05T02:06:01.301388352Z [2024-04-05T02:06:01.301+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:06:01.301397105Z [2024-04-05T02:06:01.301+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:06:01.301487184Z [2024-04-05T02:06:01.301+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:06:01.301571874Z [2024-04-05T02:06:01.301+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:06:01.302159213Z [2024-04-05T02:06:01.301+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:06:01.302169584Z 2024-04-05T02:06:01.302173596Z 2024-04-05T02:06:01.302177946Z 2024-04-05T02:06:01.302181538Z 2024-04-05T02:06:01.324614950Z [2024-04-05T02:06:01.324+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:04:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:06:01.324690982Z [2024-04-05T02:06:01.324+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:06:01.324904314Z [2024-04-05T02:06:01.324+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:06:01.324986083Z [2024-04-05T02:06:01.324+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:06:01.325178228Z [2024-04-05T02:06:01.325+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:06:01.325250446Z [2024-04-05T02:06:01.325+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:06:01.325430734Z [2024-04-05T02:06:01.325+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:06:01.325504995Z [2024-04-05T02:06:01.325+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:06:01.735135207Z [2024-04-05T02:06:01.734+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:04:00+00:00 exited with status queued for try_number 1 2024-04-05T02:06:01.735188604Z [2024-04-05T02:06:01.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status queued for try_number 1 2024-04-05T02:06:01.735240718Z [2024-04-05T02:06:01.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status queued for try_number 1 2024-04-05T02:06:01.735340587Z [2024-04-05T02:06:01.735+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status queued for try_number 1 2024-04-05T02:06:01.749277217Z [2024-04-05T02:06:01.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to 142262b9-e67f-4672-b589-3eeaf52b571c 2024-04-05T02:06:01.749310981Z [2024-04-05T02:06:01.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0ab52242-7695-4f11-b2a9-928d99a18eda 2024-04-05T02:06:01.749451663Z [2024-04-05T02:06:01.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f526185-65c3-4c84-83b4-8caa7cc3e2fe 2024-04-05T02:06:01.749544443Z [2024-04-05T02:06:01.749+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4666da36-1699-40fd-9dc8-e584514f0811 2024-04-05T02:06:03.230081174Z [2024-04-05T02:06:03.229+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:06:03.230670947Z [2024-04-05T02:06:03.230+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:05:00+00:00, run_id=scheduled__2024-04-05T02:05:00+00:00, run_start_date=2024-04-05 02:06:01.167653+00:00, run_end_date=2024-04-05 02:06:03.230244+00:00, run_duration=2.062591, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:05:00+00:00, data_interval_end=2024-04-05 02:06:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:06:03.255558747Z [2024-04-05T02:06:03.255+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:06:00+00:00, run_after=2024-04-05T02:07:00+00:00 2024-04-05T02:06:03.336754303Z [2024-04-05T02:06:03.336+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status success for try_number 1 2024-04-05T02:06:03.349659834Z [2024-04-05T02:06:03.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:05:00+00:00, map_index=-1, run_start_date=2024-04-05 02:06:02.518715+00:00, run_end_date=2024-04-05 02:06:02.982761+00:00, run_duration=0.464046, state=success, executor_state=success, try_number=1, max_tries=1, job_id=963, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:06:01.303062+00:00, queued_by_job_id=1, pid=14105 2024-04-05T02:06:04.414829551Z [2024-04-05T02:06:04.414+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:06:04.415074207Z [2024-04-05T02:06:04.414+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:04:00+00:00, run_id=scheduled__2024-04-05T02:04:00+00:00, run_start_date=2024-04-05 02:06:01.164660+00:00, run_end_date=2024-04-05 02:06:04.414723+00:00, run_duration=3.250063, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:04:00+00:00, data_interval_end=2024-04-05 02:06:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:06:04.423837967Z [2024-04-05T02:06:04.423+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:06:00+00:00, run_after=2024-04-05T02:08:00+00:00 2024-04-05T02:06:04.481040058Z [2024-04-05T02:06:04.480+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:04:00+00:00 exited with status success for try_number 1 2024-04-05T02:06:04.490945623Z [2024-04-05T02:06:04.490+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:04:00+00:00, map_index=-1, run_start_date=2024-04-05 02:06:02.811767+00:00, run_end_date=2024-04-05 02:06:03.260574+00:00, run_duration=0.448807, state=success, executor_state=success, try_number=1, max_tries=1, job_id=964, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:06:01.303062+00:00, queued_by_job_id=1, pid=14106 2024-04-05T02:06:06.641535791Z [2024-04-05T02:06:06.641+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:06:06.641954614Z [2024-04-05T02:06:06.641+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:05:00+00:00, run_id=scheduled__2024-04-05T02:05:00+00:00, run_start_date=2024-04-05 02:06:01.170206+00:00, run_end_date=2024-04-05 02:06:06.641362+00:00, run_duration=5.471156, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:05:00+00:00, data_interval_end=2024-04-05 02:06:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:06:06.650806384Z [2024-04-05T02:06:06.650+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:06:00+00:00, run_after=2024-04-05T02:07:00+00:00 2024-04-05T02:06:06.658881164Z [2024-04-05T02:06:06.658+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:06:06.659041038Z [2024-04-05T02:06:06.658+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:05:00+00:00, run_id=scheduled__2024-04-05T02:05:00+00:00, run_start_date=2024-04-05 02:06:01.177621+00:00, run_end_date=2024-04-05 02:06:06.658776+00:00, run_duration=5.481155, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:05:00+00:00, data_interval_end=2024-04-05 02:06:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:06:06.668939111Z [2024-04-05T02:06:06.668+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:06:00+00:00, run_after=2024-04-05T02:07:00+00:00 2024-04-05T02:06:06.702002477Z [2024-04-05T02:06:06.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status success for try_number 1 2024-04-05T02:06:06.702033022Z [2024-04-05T02:06:06.701+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status success for try_number 1 2024-04-05T02:06:06.708876805Z [2024-04-05T02:06:06.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:05:00+00:00, map_index=-1, run_start_date=2024-04-05 02:06:03.990006+00:00, run_end_date=2024-04-05 02:06:05.972297+00:00, run_duration=1.982291, state=success, executor_state=success, try_number=1, max_tries=1, job_id=966, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:06:01.303062+00:00, queued_by_job_id=1, pid=14130 2024-04-05T02:06:06.708988336Z [2024-04-05T02:06:06.708+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:05:00+00:00, map_index=-1, run_start_date=2024-04-05 02:06:03.728038+00:00, run_end_date=2024-04-05 02:06:05.596045+00:00, run_duration=1.868007, state=success, executor_state=success, try_number=1, max_tries=1, job_id=965, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:06:01.303062+00:00, queued_by_job_id=1, pid=14124 2024-04-05T02:07:00.127015735Z [2024-04-05T02:07:00.126+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:07:00.141079943Z [2024-04-05T02:07:00.140+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:07:00+00:00, run_after=2024-04-05T02:08:00+00:00 2024-04-05T02:07:00.154045473Z [2024-04-05T02:07:00.153+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:07:00+00:00, run_after=2024-04-05T02:08:00+00:00 2024-04-05T02:07:00.227082289Z [2024-04-05T02:07:00.226+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:07:00.227106614Z 2024-04-05T02:07:00.227110293Z 2024-04-05T02:07:00.227113497Z 2024-04-05T02:07:00.227116612Z [2024-04-05T02:07:00.226+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:07:00.227166619Z [2024-04-05T02:07:00.227+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:07:00.227240295Z [2024-04-05T02:07:00.227+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:07:00.228068281Z [2024-04-05T02:07:00.227+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:07:00.228079680Z 2024-04-05T02:07:00.228083138Z 2024-04-05T02:07:00.228086252Z 2024-04-05T02:07:00.232193939Z [2024-04-05T02:07:00.231+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:07:00.232291719Z [2024-04-05T02:07:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:07:00.232707220Z [2024-04-05T02:07:00.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:07:00.232819364Z [2024-04-05T02:07:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:07:00.233018042Z [2024-04-05T02:07:00.232+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:07:00.233091315Z [2024-04-05T02:07:00.232+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:07:00.605836950Z [2024-04-05T02:07:00.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:06:00+00:00 exited with status queued for try_number 1 2024-04-05T02:07:00.605861808Z [2024-04-05T02:07:00.605+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:06:00+00:00 exited with status queued for try_number 1 2024-04-05T02:07:00.612012598Z [2024-04-05T02:07:00.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:06:00+00:00 exited with status queued for try_number 1 2024-04-05T02:07:00.621753602Z [2024-04-05T02:07:00.621+0000] {scheduler_job.py:635} INFO - Setting external_id for to a05ad28c-d1cf-452f-81db-68f3939dd124 2024-04-05T02:07:00.621855723Z [2024-04-05T02:07:00.621+0000] {scheduler_job.py:635} INFO - Setting external_id for to b2091635-836b-47fa-a393-7a462c682ce2 2024-04-05T02:07:00.622048944Z [2024-04-05T02:07:00.621+0000] {scheduler_job.py:635} INFO - Setting external_id for to 180d9e6a-679c-4f09-b9d1-482b9eb53095 2024-04-05T02:07:03.143736550Z [2024-04-05T02:07:03.143+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:07:03.144313345Z [2024-04-05T02:07:03.143+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:06:00+00:00, run_id=scheduled__2024-04-05T02:06:00+00:00, run_start_date=2024-04-05 02:07:00.166039+00:00, run_end_date=2024-04-05 02:07:03.143680+00:00, run_duration=2.977641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:06:00+00:00, data_interval_end=2024-04-05 02:07:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:07:03.170629936Z [2024-04-05T02:07:03.170+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:07:00+00:00, run_after=2024-04-05T02:08:00+00:00 2024-04-05T02:07:03.317607657Z [2024-04-05T02:07:03.317+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:06:00+00:00 exited with status success for try_number 1 2024-04-05T02:07:03.335649883Z [2024-04-05T02:07:03.334+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:06:00+00:00, map_index=-1, run_start_date=2024-04-05 02:07:01.405882+00:00, run_end_date=2024-04-05 02:07:02.131774+00:00, run_duration=0.725892, state=success, executor_state=success, try_number=1, max_tries=1, job_id=967, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:07:00.228735+00:00, queued_by_job_id=1, pid=14162 2024-04-05T02:07:05.277629290Z [2024-04-05T02:07:05.277+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:07:05.278051043Z [2024-04-05T02:07:05.277+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:06:00+00:00, run_id=scheduled__2024-04-05T02:06:00+00:00, run_start_date=2024-04-05 02:07:00.167263+00:00, run_end_date=2024-04-05 02:07:05.277544+00:00, run_duration=5.110281, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:06:00+00:00, data_interval_end=2024-04-05 02:07:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:07:05.288616009Z [2024-04-05T02:07:05.288+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:07:00+00:00, run_after=2024-04-05T02:08:00+00:00 2024-04-05T02:07:05.343088409Z [2024-04-05T02:07:05.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:06:00+00:00 exited with status success for try_number 1 2024-04-05T02:07:05.353044028Z [2024-04-05T02:07:05.352+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:06:00+00:00, map_index=-1, run_start_date=2024-04-05 02:07:02.930464+00:00, run_end_date=2024-04-05 02:07:04.527454+00:00, run_duration=1.59699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=968, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:07:00.228735+00:00, queued_by_job_id=1, pid=14175 2024-04-05T02:07:06.436758869Z [2024-04-05T02:07:06.436+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:07:06.437584696Z [2024-04-05T02:07:06.436+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:06:00+00:00, run_id=scheduled__2024-04-05T02:06:00+00:00, run_start_date=2024-04-05 02:07:00.168370+00:00, run_end_date=2024-04-05 02:07:06.436663+00:00, run_duration=6.268293, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:06:00+00:00, data_interval_end=2024-04-05 02:07:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:07:06.451049157Z [2024-04-05T02:07:06.450+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:07:00+00:00, run_after=2024-04-05T02:08:00+00:00 2024-04-05T02:07:06.487035421Z [2024-04-05T02:07:06.486+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:06:00+00:00 exited with status success for try_number 1 2024-04-05T02:07:06.493124792Z [2024-04-05T02:07:06.492+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:06:00+00:00, map_index=-1, run_start_date=2024-04-05 02:07:03.690231+00:00, run_end_date=2024-04-05 02:07:05.458528+00:00, run_duration=1.768297, state=success, executor_state=success, try_number=1, max_tries=1, job_id=969, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:07:00.228735+00:00, queued_by_job_id=1, pid=14186 2024-04-05T02:08:00.977679042Z [2024-04-05T02:08:00.977+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:08:00+00:00, run_after=2024-04-05T02:09:00+00:00 2024-04-05T02:08:01.013983960Z [2024-04-05T02:08:01.013+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:08:00+00:00, run_after=2024-04-05T02:09:00+00:00 2024-04-05T02:08:01.026140656Z [2024-04-05T02:08:01.025+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:08:01.039638485Z [2024-04-05T02:08:01.039+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:08:01.176155902Z [2024-04-05T02:08:01.173+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:08:01.176189837Z 2024-04-05T02:08:01.176194735Z 2024-04-05T02:08:01.176198784Z 2024-04-05T02:08:01.176202433Z 2024-04-05T02:08:01.176206569Z [2024-04-05T02:08:01.173+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:08:01.176209987Z [2024-04-05T02:08:01.173+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:08:01.176213190Z [2024-04-05T02:08:01.173+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:08:01.176216311Z [2024-04-05T02:08:01.173+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:08:01.176219525Z [2024-04-05T02:08:01.174+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:08:01.176223143Z 2024-04-05T02:08:01.176226272Z 2024-04-05T02:08:01.176229264Z 2024-04-05T02:08:01.176248074Z 2024-04-05T02:08:01.187149969Z [2024-04-05T02:08:01.185+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:06:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:08:01.187185722Z [2024-04-05T02:08:01.185+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:08:01.187192257Z [2024-04-05T02:08:01.185+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:08:01.187210058Z [2024-04-05T02:08:01.185+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:08:01.187214112Z [2024-04-05T02:08:01.186+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:08:01.187217864Z [2024-04-05T02:08:01.186+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:08:01.187221205Z [2024-04-05T02:08:01.186+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:07:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:08:01.187224464Z [2024-04-05T02:08:01.186+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:08:01.856656648Z [2024-04-05T02:08:01.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:06:00+00:00 exited with status queued for try_number 1 2024-04-05T02:08:01.857323651Z [2024-04-05T02:08:01.855+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:07:00+00:00 exited with status queued for try_number 1 2024-04-05T02:08:01.857586129Z [2024-04-05T02:08:01.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:07:00+00:00 exited with status queued for try_number 1 2024-04-05T02:08:01.857785176Z [2024-04-05T02:08:01.857+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:07:00+00:00 exited with status queued for try_number 1 2024-04-05T02:08:01.887688886Z [2024-04-05T02:08:01.884+0000] {scheduler_job.py:635} INFO - Setting external_id for to 40e3ed4c-77ab-4d61-835b-9c86ad5a67a9 2024-04-05T02:08:01.887725772Z [2024-04-05T02:08:01.884+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3671f586-3297-413f-8218-2179ce32911f 2024-04-05T02:08:01.887729397Z [2024-04-05T02:08:01.885+0000] {scheduler_job.py:635} INFO - Setting external_id for to d52cdc5e-3127-453f-bfc0-0bfcbf37cbab 2024-04-05T02:08:01.887733424Z [2024-04-05T02:08:01.885+0000] {scheduler_job.py:635} INFO - Setting external_id for to d20a0953-31c0-41bc-944d-74c48d57b6dc 2024-04-05T02:08:03.264750123Z [2024-04-05T02:08:03.264+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:08:03.265112734Z [2024-04-05T02:08:03.264+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:07:00+00:00, run_id=scheduled__2024-04-05T02:07:00+00:00, run_start_date=2024-04-05 02:08:01.057061+00:00, run_end_date=2024-04-05 02:08:03.264702+00:00, run_duration=2.207641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:07:00+00:00, data_interval_end=2024-04-05 02:08:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:08:03.278792202Z [2024-04-05T02:08:03.277+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:08:00+00:00, run_after=2024-04-05T02:09:00+00:00 2024-04-05T02:08:03.359640322Z [2024-04-05T02:08:03.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:07:00+00:00 exited with status success for try_number 1 2024-04-05T02:08:03.379337101Z [2024-04-05T02:08:03.377+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:07:00+00:00, map_index=-1, run_start_date=2024-04-05 02:08:02.456197+00:00, run_end_date=2024-04-05 02:08:03.023913+00:00, run_duration=0.567716, state=success, executor_state=success, try_number=1, max_tries=1, job_id=970, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:08:01.180188+00:00, queued_by_job_id=1, pid=14214 2024-04-05T02:08:04.441924777Z [2024-04-05T02:08:04.440+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:08:04.442271890Z [2024-04-05T02:08:04.441+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:06:00+00:00, run_id=scheduled__2024-04-05T02:06:00+00:00, run_start_date=2024-04-05 02:08:01.054671+00:00, run_end_date=2024-04-05 02:08:04.441750+00:00, run_duration=3.387079, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:06:00+00:00, data_interval_end=2024-04-05 02:08:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:08:04.459097456Z [2024-04-05T02:08:04.458+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:08:00+00:00, run_after=2024-04-05T02:10:00+00:00 2024-04-05T02:08:04.533151504Z [2024-04-05T02:08:04.532+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:06:00+00:00 exited with status success for try_number 1 2024-04-05T02:08:04.538470700Z [2024-04-05T02:08:04.538+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:06:00+00:00, map_index=-1, run_start_date=2024-04-05 02:08:03.071672+00:00, run_end_date=2024-04-05 02:08:03.514493+00:00, run_duration=0.442821, state=success, executor_state=success, try_number=1, max_tries=1, job_id=971, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:08:01.180188+00:00, queued_by_job_id=1, pid=14221 2024-04-05T02:08:07.243479328Z [2024-04-05T02:08:07.243+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:08:07.243874110Z [2024-04-05T02:08:07.243+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:07:00+00:00, run_id=scheduled__2024-04-05T02:07:00+00:00, run_start_date=2024-04-05 02:08:01.060153+00:00, run_end_date=2024-04-05 02:08:07.243369+00:00, run_duration=6.183216, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:07:00+00:00, data_interval_end=2024-04-05 02:08:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:08:07.261317951Z [2024-04-05T02:08:07.260+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:08:00+00:00, run_after=2024-04-05T02:09:00+00:00 2024-04-05T02:08:07.275415553Z [2024-04-05T02:08:07.274+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:08:07.275720451Z [2024-04-05T02:08:07.275+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:07:00+00:00, run_id=scheduled__2024-04-05T02:07:00+00:00, run_start_date=2024-04-05 02:08:01.062709+00:00, run_end_date=2024-04-05 02:08:07.275342+00:00, run_duration=6.212633, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:07:00+00:00, data_interval_end=2024-04-05 02:08:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:08:07.288866928Z [2024-04-05T02:08:07.288+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:08:00+00:00, run_after=2024-04-05T02:09:00+00:00 2024-04-05T02:08:07.326069220Z [2024-04-05T02:08:07.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:07:00+00:00 exited with status success for try_number 1 2024-04-05T02:08:07.326099241Z [2024-04-05T02:08:07.325+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:07:00+00:00 exited with status success for try_number 1 2024-04-05T02:08:07.335764085Z [2024-04-05T02:08:07.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:07:00+00:00, map_index=-1, run_start_date=2024-04-05 02:08:03.777020+00:00, run_end_date=2024-04-05 02:08:06.091790+00:00, run_duration=2.31477, state=success, executor_state=success, try_number=1, max_tries=1, job_id=972, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:08:01.180188+00:00, queued_by_job_id=1, pid=14233 2024-04-05T02:08:07.336275062Z [2024-04-05T02:08:07.335+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:07:00+00:00, map_index=-1, run_start_date=2024-04-05 02:08:04.136598+00:00, run_end_date=2024-04-05 02:08:06.109903+00:00, run_duration=1.973305, state=success, executor_state=success, try_number=1, max_tries=1, job_id=973, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:08:01.180188+00:00, queued_by_job_id=1, pid=14244 2024-04-05T02:09:00.122192827Z [2024-04-05T02:09:00.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:09:00+00:00, run_after=2024-04-05T02:10:00+00:00 2024-04-05T02:09:00.138889007Z [2024-04-05T02:09:00.138+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:09:00+00:00, run_after=2024-04-05T02:10:00+00:00 2024-04-05T02:09:00.147373298Z [2024-04-05T02:09:00.146+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:09:00.217124668Z [2024-04-05T02:09:00.216+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:09:00.217149930Z 2024-04-05T02:09:00.217153900Z 2024-04-05T02:09:00.217157102Z 2024-04-05T02:09:00.217442268Z [2024-04-05T02:09:00.217+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:09:00.217747125Z [2024-04-05T02:09:00.217+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:09:00.217948994Z [2024-04-05T02:09:00.217+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:09:00.218840890Z [2024-04-05T02:09:00.218+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:09:00.218848589Z 2024-04-05T02:09:00.218851937Z 2024-04-05T02:09:00.218855429Z 2024-04-05T02:09:00.223618056Z [2024-04-05T02:09:00.223+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:09:00.223827582Z [2024-04-05T02:09:00.223+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:09:00.224230525Z [2024-04-05T02:09:00.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:09:00.224633205Z [2024-04-05T02:09:00.224+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:09:00.225025840Z [2024-04-05T02:09:00.224+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:09:00.225245029Z [2024-04-05T02:09:00.225+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:09:00.646041430Z [2024-04-05T02:09:00.642+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:08:00+00:00 exited with status queued for try_number 1 2024-04-05T02:09:00.646535239Z [2024-04-05T02:09:00.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:08:00+00:00 exited with status queued for try_number 1 2024-04-05T02:09:00.646908985Z [2024-04-05T02:09:00.646+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:08:00+00:00 exited with status queued for try_number 1 2024-04-05T02:09:00.660201066Z [2024-04-05T02:09:00.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50a7741f-76cd-4bdc-9e6e-bd48ab430eb7 2024-04-05T02:09:00.660839885Z [2024-04-05T02:09:00.660+0000] {scheduler_job.py:635} INFO - Setting external_id for to c35bfecc-f060-4f19-959f-5afaacf7b6c9 2024-04-05T02:09:00.661233563Z [2024-04-05T02:09:00.660+0000] {scheduler_job.py:635} INFO - Setting external_id for to 12b1bc6e-0a09-4eef-8b7e-94654520fcf4 2024-04-05T02:09:03.496600792Z [2024-04-05T02:09:03.495+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:09:03.500285348Z [2024-04-05T02:09:03.499+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:08:00+00:00, run_id=scheduled__2024-04-05T02:08:00+00:00, run_start_date=2024-04-05 02:09:00.159138+00:00, run_end_date=2024-04-05 02:09:03.499484+00:00, run_duration=3.340346, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:08:00+00:00, data_interval_end=2024-04-05 02:09:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:09:03.516727763Z [2024-04-05T02:09:03.516+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:09:00+00:00, run_after=2024-04-05T02:10:00+00:00 2024-04-05T02:09:03.580744065Z [2024-04-05T02:09:03.580+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:08:00+00:00 exited with status success for try_number 1 2024-04-05T02:09:03.586256656Z [2024-04-05T02:09:03.585+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:08:00+00:00, map_index=-1, run_start_date=2024-04-05 02:09:01.932110+00:00, run_end_date=2024-04-05 02:09:02.485042+00:00, run_duration=0.552932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=974, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:09:00.220189+00:00, queued_by_job_id=1, pid=14274 2024-04-05T02:09:04.643684248Z [2024-04-05T02:09:04.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:09:04.644303755Z [2024-04-05T02:09:04.643+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:08:00+00:00, run_id=scheduled__2024-04-05T02:08:00+00:00, run_start_date=2024-04-05 02:09:00.160923+00:00, run_end_date=2024-04-05 02:09:04.643525+00:00, run_duration=4.482602, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:08:00+00:00, data_interval_end=2024-04-05 02:09:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:09:04.660844829Z [2024-04-05T02:09:04.660+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:09:00+00:00, run_after=2024-04-05T02:10:00+00:00 2024-04-05T02:09:04.718214408Z [2024-04-05T02:09:04.717+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:08:00+00:00 exited with status success for try_number 1 2024-04-05T02:09:04.726116290Z [2024-04-05T02:09:04.725+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:08:00+00:00, map_index=-1, run_start_date=2024-04-05 02:09:02.784039+00:00, run_end_date=2024-04-05 02:09:04.419999+00:00, run_duration=1.63596, state=success, executor_state=success, try_number=1, max_tries=1, job_id=975, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:09:00.220189+00:00, queued_by_job_id=1, pid=14287 2024-04-05T02:09:05.895641786Z [2024-04-05T02:09:05.895+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:09:05.896008407Z [2024-04-05T02:09:05.895+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:08:00+00:00, run_id=scheduled__2024-04-05T02:08:00+00:00, run_start_date=2024-04-05 02:09:00.162530+00:00, run_end_date=2024-04-05 02:09:05.895461+00:00, run_duration=5.732931, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:08:00+00:00, data_interval_end=2024-04-05 02:09:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:09:05.908125638Z [2024-04-05T02:09:05.907+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:09:00+00:00, run_after=2024-04-05T02:10:00+00:00 2024-04-05T02:09:05.953691615Z [2024-04-05T02:09:05.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:08:00+00:00 exited with status success for try_number 1 2024-04-05T02:09:05.960815707Z [2024-04-05T02:09:05.960+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:08:00+00:00, map_index=-1, run_start_date=2024-04-05 02:09:03.058069+00:00, run_end_date=2024-04-05 02:09:05.703795+00:00, run_duration=2.645726, state=success, executor_state=success, try_number=1, max_tries=1, job_id=976, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:09:00.220189+00:00, queued_by_job_id=1, pid=14291 2024-04-05T02:10:00.518637042Z [2024-04-05T02:10:00.518+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:10:00.541542325Z [2024-04-05T02:10:00.541+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:10:00+00:00, run_after=2024-04-05T02:11:00+00:00 2024-04-05T02:10:00.575188819Z [2024-04-05T02:10:00.574+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:10:00+00:00, run_after=2024-04-05T02:11:00+00:00 2024-04-05T02:10:00.598076954Z [2024-04-05T02:10:00.597+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:10:00+00:00, run_after=2024-04-05T02:15:00+00:00 2024-04-05T02:10:00.609288266Z [2024-04-05T02:10:00.608+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:10:00.745387544Z [2024-04-05T02:10:00.745+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T02:10:00.745412086Z 2024-04-05T02:10:00.745415689Z 2024-04-05T02:10:00.745420410Z 2024-04-05T02:10:00.745423808Z 2024-04-05T02:10:00.745427121Z 2024-04-05T02:10:00.745630149Z [2024-04-05T02:10:00.745+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:10:00.745948004Z [2024-04-05T02:10:00.745+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:10:00.746135539Z [2024-04-05T02:10:00.745+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:10:00.746335488Z [2024-04-05T02:10:00.746+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:10:00.746515106Z [2024-04-05T02:10:00.746+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:10:00.747193148Z [2024-04-05T02:10:00.747+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:10:00.747204196Z 2024-04-05T02:10:00.747208626Z 2024-04-05T02:10:00.747212167Z 2024-04-05T02:10:00.747215408Z 2024-04-05T02:10:00.747223972Z 2024-04-05T02:10:00.752445071Z [2024-04-05T02:10:00.752+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:10:00.752711078Z [2024-04-05T02:10:00.752+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:10:00.753036349Z [2024-04-05T02:10:00.752+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:08:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:10:00.753243676Z [2024-04-05T02:10:00.753+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:10:00.753580174Z [2024-04-05T02:10:00.753+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:10:00.753799253Z [2024-04-05T02:10:00.753+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:10:00.754113317Z [2024-04-05T02:10:00.753+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:10:00.755489889Z [2024-04-05T02:10:00.754+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:10:00.756379587Z [2024-04-05T02:10:00.756+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:09:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:10:00.757867867Z [2024-04-05T02:10:00.756+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:10:01.622892755Z [2024-04-05T02:10:01.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status queued for try_number 1 2024-04-05T02:10:01.622930564Z [2024-04-05T02:10:01.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:08:00+00:00 exited with status queued for try_number 1 2024-04-05T02:10:01.622991177Z [2024-04-05T02:10:01.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:09:00+00:00 exited with status queued for try_number 1 2024-04-05T02:10:01.623069306Z [2024-04-05T02:10:01.622+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:09:00+00:00 exited with status queued for try_number 1 2024-04-05T02:10:01.623133945Z [2024-04-05T02:10:01.623+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:09:00+00:00 exited with status queued for try_number 1 2024-04-05T02:10:01.693354854Z [2024-04-05T02:10:01.692+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4abe1c0c-c708-429a-9a88-c7caca5d592d 2024-04-05T02:10:01.693435733Z [2024-04-05T02:10:01.693+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9ac7ea51-4a84-4639-a643-98b66d458bee 2024-04-05T02:10:01.693528770Z [2024-04-05T02:10:01.693+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7adf5b6a-b611-44cf-a0af-ece08fa00316 2024-04-05T02:10:01.693648953Z [2024-04-05T02:10:01.693+0000] {scheduler_job.py:635} INFO - Setting external_id for to c4b1019e-d571-43d4-b8be-00ca2fdcf2b9 2024-04-05T02:10:01.693766929Z [2024-04-05T02:10:01.693+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa4496f1-b1be-4e51-b3b7-eb8aa206a06e 2024-04-05T02:10:04.116360847Z [2024-04-05T02:10:04.115+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:10:04.116779593Z [2024-04-05T02:10:04.116+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:09:00+00:00, run_id=scheduled__2024-04-05T02:09:00+00:00, run_start_date=2024-04-05 02:10:00.631062+00:00, run_end_date=2024-04-05 02:10:04.116357+00:00, run_duration=3.485295, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:09:00+00:00, data_interval_end=2024-04-05 02:10:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:10:04.126737894Z [2024-04-05T02:10:04.126+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:10:00+00:00, run_after=2024-04-05T02:11:00+00:00 2024-04-05T02:10:04.134798349Z [2024-04-05T02:10:04.134+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:10:04.135078621Z [2024-04-05T02:10:04.134+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:08:00+00:00, run_id=scheduled__2024-04-05T02:08:00+00:00, run_start_date=2024-04-05 02:10:00.629338+00:00, run_end_date=2024-04-05 02:10:04.134764+00:00, run_duration=3.505426, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:08:00+00:00, data_interval_end=2024-04-05 02:10:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:10:04.142750292Z [2024-04-05T02:10:04.142+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:10:00+00:00, run_after=2024-04-05T02:12:00+00:00 2024-04-05T02:10:04.293054873Z [2024-04-05T02:10:04.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:08:00+00:00 exited with status success for try_number 1 2024-04-05T02:10:04.293090417Z [2024-04-05T02:10:04.292+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:09:00+00:00 exited with status success for try_number 1 2024-04-05T02:10:04.313058352Z [2024-04-05T02:10:04.312+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:09:00+00:00, map_index=-1, run_start_date=2024-04-05 02:10:02.361986+00:00, run_end_date=2024-04-05 02:10:03.331050+00:00, run_duration=0.969064, state=success, executor_state=success, try_number=1, max_tries=1, job_id=977, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:10:00.748545+00:00, queued_by_job_id=1, pid=14325 2024-04-05T02:10:04.313492633Z [2024-04-05T02:10:04.313+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:08:00+00:00, map_index=-1, run_start_date=2024-04-05 02:10:02.830478+00:00, run_end_date=2024-04-05 02:10:03.361232+00:00, run_duration=0.530754, state=success, executor_state=success, try_number=1, max_tries=1, job_id=978, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:10:00.748545+00:00, queued_by_job_id=1, pid=14326 2024-04-05T02:10:05.452454894Z [2024-04-05T02:10:05.451+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:10:05.452497382Z 2024-04-05T02:10:05.452786618Z [2024-04-05T02:10:05.452+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:10:05.453577203Z [2024-04-05T02:10:05.453+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:10:05.453590206Z 2024-04-05T02:10:05.457494996Z [2024-04-05T02:10:05.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:10:05.457752440Z [2024-04-05T02:10:05.457+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:10:05.525058285Z [2024-04-05T02:10:05.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status queued for try_number 1 2024-04-05T02:10:05.525150685Z [2024-04-05T02:10:05.524+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status success for try_number 1 2024-04-05T02:10:05.534476978Z [2024-04-05T02:10:05.533+0000] {scheduler_job.py:635} INFO - Setting external_id for to 830c1e2d-f770-44d4-adf4-67669b800032 2024-04-05T02:10:05.534870660Z [2024-04-05T02:10:05.534+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:05:00+00:00, map_index=-1, run_start_date=2024-04-05 02:10:04.330553+00:00, run_end_date=2024-04-05 02:10:04.807292+00:00, run_duration=0.476739, state=success, executor_state=success, try_number=1, max_tries=1, job_id=980, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:10:00.748545+00:00, queued_by_job_id=1, pid=14356 2024-04-05T02:10:06.712567832Z [2024-04-05T02:10:06.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:10:06.713039091Z [2024-04-05T02:10:06.712+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:09:00+00:00, run_id=scheduled__2024-04-05T02:09:00+00:00, run_start_date=2024-04-05 02:10:00.634853+00:00, run_end_date=2024-04-05 02:10:06.712454+00:00, run_duration=6.077601, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:09:00+00:00, data_interval_end=2024-04-05 02:10:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:10:06.730100504Z [2024-04-05T02:10:06.729+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:10:00+00:00, run_after=2024-04-05T02:11:00+00:00 2024-04-05T02:10:06.742581513Z [2024-04-05T02:10:06.741+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:10:06.743077965Z [2024-04-05T02:10:06.742+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:09:00+00:00, run_id=scheduled__2024-04-05T02:09:00+00:00, run_start_date=2024-04-05 02:10:00.633233+00:00, run_end_date=2024-04-05 02:10:06.742516+00:00, run_duration=6.109283, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:09:00+00:00, data_interval_end=2024-04-05 02:10:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:10:06.762761287Z [2024-04-05T02:10:06.762+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:10:00+00:00, run_after=2024-04-05T02:11:00+00:00 2024-04-05T02:10:06.831659892Z [2024-04-05T02:10:06.830+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:09:00+00:00 exited with status success for try_number 1 2024-04-05T02:10:06.832076030Z [2024-04-05T02:10:06.831+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:09:00+00:00 exited with status success for try_number 1 2024-04-05T02:10:06.857317292Z [2024-04-05T02:10:06.856+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:09:00+00:00, map_index=-1, run_start_date=2024-04-05 02:10:04.510705+00:00, run_end_date=2024-04-05 02:10:05.864488+00:00, run_duration=1.353783, state=success, executor_state=success, try_number=1, max_tries=1, job_id=981, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:10:00.748545+00:00, queued_by_job_id=1, pid=14357 2024-04-05T02:10:06.857635613Z [2024-04-05T02:10:06.857+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:09:00+00:00, map_index=-1, run_start_date=2024-04-05 02:10:04.299665+00:00, run_end_date=2024-04-05 02:10:06.046591+00:00, run_duration=1.746926, state=success, executor_state=success, try_number=1, max_tries=1, job_id=979, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:10:00.748545+00:00, queued_by_job_id=1, pid=14355 2024-04-05T02:10:09.080614564Z [2024-04-05T02:10:09.080+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:10:09.080657563Z 2024-04-05T02:10:09.080944619Z [2024-04-05T02:10:09.080+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:10:09.081669475Z [2024-04-05T02:10:09.081+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:10:09.081683320Z 2024-04-05T02:10:09.085381416Z [2024-04-05T02:10:09.085+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:05:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:10:09.085432252Z [2024-04-05T02:10:09.085+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:10:09.136210788Z [2024-04-05T02:10:09.135+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status queued for try_number 1 2024-04-05T02:10:09.136474379Z [2024-04-05T02:10:09.136+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status success for try_number 1 2024-04-05T02:10:09.143691465Z [2024-04-05T02:10:09.142+0000] {scheduler_job.py:635} INFO - Setting external_id for to 51c86598-e994-4ae8-b109-8ce84796b584 2024-04-05T02:10:09.144063744Z [2024-04-05T02:10:09.143+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T02:05:00+00:00, map_index=-1, run_start_date=2024-04-05 02:10:07.620986+00:00, run_end_date=2024-04-05 02:10:08.048137+00:00, run_duration=0.427151, state=success, executor_state=success, try_number=1, max_tries=1, job_id=982, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:10:05.454154+00:00, queued_by_job_id=1, pid=14380 2024-04-05T02:10:13.154039124Z [2024-04-05T02:10:13.153+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:10:13.154075961Z 2024-04-05T02:10:13.154480615Z [2024-04-05T02:10:13.154+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:10:13.155675167Z [2024-04-05T02:10:13.155+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:10:13.155693546Z 2024-04-05T02:10:13.159966209Z [2024-04-05T02:10:13.159+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:05:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:10:13.160363158Z [2024-04-05T02:10:13.159+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:10:13.224031754Z [2024-04-05T02:10:13.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status queued for try_number 1 2024-04-05T02:10:13.224182447Z [2024-04-05T02:10:13.223+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status success for try_number 1 2024-04-05T02:10:13.232812451Z [2024-04-05T02:10:13.232+0000] {scheduler_job.py:635} INFO - Setting external_id for to e339f4a5-80dd-44e2-a345-856457e2ff01 2024-04-05T02:10:13.233207434Z [2024-04-05T02:10:13.232+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:05:00+00:00, map_index=0, run_start_date=2024-04-05 02:10:11.029733+00:00, run_end_date=2024-04-05 02:10:12.456239+00:00, run_duration=1.426506, state=success, executor_state=success, try_number=1, max_tries=1, job_id=983, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:10:09.082443+00:00, queued_by_job_id=1, pid=14397 2024-04-05T02:10:15.499351513Z [2024-04-05T02:10:15.498+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:10:15.500115804Z [2024-04-05T02:10:15.499+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:05:00+00:00, run_id=scheduled__2024-04-05T02:05:00+00:00, run_start_date=2024-04-05 02:10:00.626883+00:00, run_end_date=2024-04-05 02:10:15.499526+00:00, run_duration=14.872643, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:05:00+00:00, data_interval_end=2024-04-05 02:10:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T02:10:15.510624463Z [2024-04-05T02:10:15.510+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:10:00+00:00, run_after=2024-04-05T02:15:00+00:00 2024-04-05T02:10:15.575515014Z [2024-04-05T02:10:15.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:05:00+00:00 exited with status success for try_number 1 2024-04-05T02:10:15.581630037Z [2024-04-05T02:10:15.581+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:05:00+00:00, map_index=-1, run_start_date=2024-04-05 02:10:14.850927+00:00, run_end_date=2024-04-05 02:10:15.182332+00:00, run_duration=0.331405, state=success, executor_state=success, try_number=1, max_tries=1, job_id=984, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:10:13.156463+00:00, queued_by_job_id=1, pid=14413 2024-04-05T02:10:41.808910603Z [2024-04-05T02:10:41.808+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:11:00.812603150Z [2024-04-05T02:11:00.812+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:11:00+00:00, run_after=2024-04-05T02:12:00+00:00 2024-04-05T02:11:00.845695264Z [2024-04-05T02:11:00.844+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:11:00+00:00, run_after=2024-04-05T02:12:00+00:00 2024-04-05T02:11:00.860992520Z [2024-04-05T02:11:00.860+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:11:00.976650779Z [2024-04-05T02:11:00.976+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:11:00.976683394Z 2024-04-05T02:11:00.976689345Z 2024-04-05T02:11:00.976694499Z 2024-04-05T02:11:00.976851349Z [2024-04-05T02:11:00.976+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:11:00.977172524Z [2024-04-05T02:11:00.976+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:11:00.977394286Z [2024-04-05T02:11:00.977+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:11:00.978497847Z [2024-04-05T02:11:00.978+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:11:00.978515330Z 2024-04-05T02:11:00.978521084Z 2024-04-05T02:11:00.978525799Z 2024-04-05T02:11:00.984439894Z [2024-04-05T02:11:00.984+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:11:00.984902525Z [2024-04-05T02:11:00.984+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:11:00.985390540Z [2024-04-05T02:11:00.985+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:11:00.985601525Z [2024-04-05T02:11:00.985+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:11:00.986038228Z [2024-04-05T02:11:00.985+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:11:00.986247274Z [2024-04-05T02:11:00.985+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:11:01.557081022Z [2024-04-05T02:11:01.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status queued for try_number 1 2024-04-05T02:11:01.557114739Z [2024-04-05T02:11:01.556+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status queued for try_number 1 2024-04-05T02:11:01.560085162Z [2024-04-05T02:11:01.559+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status queued for try_number 1 2024-04-05T02:11:01.596349291Z [2024-04-05T02:11:01.595+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed3fa0e3-6181-4f6a-9311-9f5f08260359 2024-04-05T02:11:01.596542823Z [2024-04-05T02:11:01.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4f139ce8-0ca0-47eb-b4fc-3ff0bba28ceb 2024-04-05T02:11:01.597082639Z [2024-04-05T02:11:01.596+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2e5959a-9e1e-4ac8-b7bd-64c543b2e76c 2024-04-05T02:11:03.495334707Z [2024-04-05T02:11:03.494+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:11:03.496489806Z [2024-04-05T02:11:03.495+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:10:00+00:00, run_id=scheduled__2024-04-05T02:10:00+00:00, run_start_date=2024-04-05 02:11:00.875188+00:00, run_end_date=2024-04-05 02:11:03.495265+00:00, run_duration=2.620077, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:10:00+00:00, data_interval_end=2024-04-05 02:11:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:11:03.513843850Z [2024-04-05T02:11:03.512+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:11:00+00:00, run_after=2024-04-05T02:12:00+00:00 2024-04-05T02:11:03.581992761Z [2024-04-05T02:11:03.581+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status success for try_number 1 2024-04-05T02:11:03.593358040Z [2024-04-05T02:11:03.592+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:10:00+00:00, map_index=-1, run_start_date=2024-04-05 02:11:02.399533+00:00, run_end_date=2024-04-05 02:11:02.921334+00:00, run_duration=0.521801, state=success, executor_state=success, try_number=1, max_tries=1, job_id=985, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:11:00.980026+00:00, queued_by_job_id=1, pid=14422 2024-04-05T02:11:05.749585961Z [2024-04-05T02:11:05.749+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:11:05.750213064Z [2024-04-05T02:11:05.749+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:10:00+00:00, run_id=scheduled__2024-04-05T02:10:00+00:00, run_start_date=2024-04-05 02:11:00.877348+00:00, run_end_date=2024-04-05 02:11:05.749557+00:00, run_duration=4.872209, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:10:00+00:00, data_interval_end=2024-04-05 02:11:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:11:05.771394600Z [2024-04-05T02:11:05.770+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:11:00+00:00, run_after=2024-04-05T02:12:00+00:00 2024-04-05T02:11:05.848118245Z [2024-04-05T02:11:05.847+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status success for try_number 1 2024-04-05T02:11:05.854276456Z [2024-04-05T02:11:05.853+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:10:00+00:00, map_index=-1, run_start_date=2024-04-05 02:11:03.688830+00:00, run_end_date=2024-04-05 02:11:05.343480+00:00, run_duration=1.65465, state=success, executor_state=success, try_number=1, max_tries=1, job_id=986, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:11:00.980026+00:00, queued_by_job_id=1, pid=14441 2024-04-05T02:11:06.900721377Z [2024-04-05T02:11:06.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:11:06.901492093Z [2024-04-05T02:11:06.901+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:10:00+00:00, run_id=scheduled__2024-04-05T02:10:00+00:00, run_start_date=2024-04-05 02:11:00.881393+00:00, run_end_date=2024-04-05 02:11:06.900869+00:00, run_duration=6.019476, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:10:00+00:00, data_interval_end=2024-04-05 02:11:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:11:06.915939145Z [2024-04-05T02:11:06.915+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:11:00+00:00, run_after=2024-04-05T02:12:00+00:00 2024-04-05T02:11:06.954403293Z [2024-04-05T02:11:06.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status success for try_number 1 2024-04-05T02:11:06.963421417Z [2024-04-05T02:11:06.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:10:00+00:00, map_index=-1, run_start_date=2024-04-05 02:11:03.688387+00:00, run_end_date=2024-04-05 02:11:05.804539+00:00, run_duration=2.116152, state=success, executor_state=success, try_number=1, max_tries=1, job_id=987, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:11:00.980026+00:00, queued_by_job_id=1, pid=14440 2024-04-05T02:12:00.636333214Z [2024-04-05T02:12:00.635+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:12:00+00:00, run_after=2024-04-05T02:13:00+00:00 2024-04-05T02:12:00.649541260Z [2024-04-05T02:12:00.649+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:12:00+00:00, run_after=2024-04-05T02:13:00+00:00 2024-04-05T02:12:00.657612501Z [2024-04-05T02:12:00.657+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:12:00.664942762Z [2024-04-05T02:12:00.664+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:12:00.742459697Z [2024-04-05T02:12:00.741+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:12:00.742496232Z 2024-04-05T02:12:00.742505902Z 2024-04-05T02:12:00.742512872Z 2024-04-05T02:12:00.742519320Z 2024-04-05T02:12:00.742815518Z [2024-04-05T02:12:00.742+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:12:00.743184644Z [2024-04-05T02:12:00.742+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:12:00.743448188Z [2024-04-05T02:12:00.743+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:12:00.743849728Z [2024-04-05T02:12:00.743+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:12:00.744941685Z [2024-04-05T02:12:00.744+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:12:00.744960010Z 2024-04-05T02:12:00.744966784Z 2024-04-05T02:12:00.744972951Z 2024-04-05T02:12:00.744978364Z 2024-04-05T02:12:00.751870816Z [2024-04-05T02:12:00.751+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:12:00.752197202Z [2024-04-05T02:12:00.751+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:12:00.752818392Z [2024-04-05T02:12:00.752+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:12:00.753243245Z [2024-04-05T02:12:00.752+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:12:00.753963831Z [2024-04-05T02:12:00.753+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:12:00.754199472Z [2024-04-05T02:12:00.753+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:12:00.754911055Z [2024-04-05T02:12:00.754+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:11:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:12:00.755079701Z [2024-04-05T02:12:00.754+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:12:01.266644380Z [2024-04-05T02:12:01.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status queued for try_number 1 2024-04-05T02:12:01.267199006Z [2024-04-05T02:12:01.266+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:11:00+00:00 exited with status queued for try_number 1 2024-04-05T02:12:01.267425158Z [2024-04-05T02:12:01.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:11:00+00:00 exited with status queued for try_number 1 2024-04-05T02:12:01.267613357Z [2024-04-05T02:12:01.267+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:11:00+00:00 exited with status queued for try_number 1 2024-04-05T02:12:01.281861868Z [2024-04-05T02:12:01.280+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8abfeea-f3db-45a6-b21e-d344bb3e12ea 2024-04-05T02:12:01.282675670Z [2024-04-05T02:12:01.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to 09d9317c-9602-4489-ab4d-402eda0faf97 2024-04-05T02:12:01.283329327Z [2024-04-05T02:12:01.282+0000] {scheduler_job.py:635} INFO - Setting external_id for to 702d3728-a55d-4149-ade9-f7587402be55 2024-04-05T02:12:01.283875819Z [2024-04-05T02:12:01.283+0000] {scheduler_job.py:635} INFO - Setting external_id for to bfc71ffe-aeeb-48e1-8e33-1be6945e627b 2024-04-05T02:12:03.643889174Z [2024-04-05T02:12:03.643+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:12:03.644485226Z [2024-04-05T02:12:03.644+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:10:00+00:00, run_id=scheduled__2024-04-05T02:10:00+00:00, run_start_date=2024-04-05 02:12:00.675313+00:00, run_end_date=2024-04-05 02:12:03.643861+00:00, run_duration=2.968548, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:10:00+00:00, data_interval_end=2024-04-05 02:12:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:12:03.659716956Z [2024-04-05T02:12:03.659+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:12:00+00:00, run_after=2024-04-05T02:14:00+00:00 2024-04-05T02:12:03.672529582Z [2024-04-05T02:12:03.671+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:12:03.673108660Z [2024-04-05T02:12:03.672+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:11:00+00:00, run_id=scheduled__2024-04-05T02:11:00+00:00, run_start_date=2024-04-05 02:12:00.676773+00:00, run_end_date=2024-04-05 02:12:03.672582+00:00, run_duration=2.995809, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:11:00+00:00, data_interval_end=2024-04-05 02:12:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:12:03.694981372Z [2024-04-05T02:12:03.694+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:12:00+00:00, run_after=2024-04-05T02:13:00+00:00 2024-04-05T02:12:03.781437478Z [2024-04-05T02:12:03.780+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status success for try_number 1 2024-04-05T02:12:03.784907049Z [2024-04-05T02:12:03.781+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:11:00+00:00 exited with status success for try_number 1 2024-04-05T02:12:03.797311503Z [2024-04-05T02:12:03.796+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:10:00+00:00, map_index=-1, run_start_date=2024-04-05 02:12:02.281374+00:00, run_end_date=2024-04-05 02:12:02.971896+00:00, run_duration=0.690522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=988, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:12:00.746665+00:00, queued_by_job_id=1, pid=14469 2024-04-05T02:12:03.797844903Z [2024-04-05T02:12:03.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:11:00+00:00, map_index=-1, run_start_date=2024-04-05 02:12:02.792699+00:00, run_end_date=2024-04-05 02:12:03.442266+00:00, run_duration=0.649567, state=success, executor_state=success, try_number=1, max_tries=1, job_id=989, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:12:00.746665+00:00, queued_by_job_id=1, pid=14475 2024-04-05T02:12:07.298542155Z [2024-04-05T02:12:07.297+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:12:07.298931645Z [2024-04-05T02:12:07.298+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:11:00+00:00, run_id=scheduled__2024-04-05T02:11:00+00:00, run_start_date=2024-04-05 02:12:00.678982+00:00, run_end_date=2024-04-05 02:12:07.298483+00:00, run_duration=6.619501, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:11:00+00:00, data_interval_end=2024-04-05 02:12:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:12:07.317489947Z [2024-04-05T02:12:07.316+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:12:00+00:00, run_after=2024-04-05T02:13:00+00:00 2024-04-05T02:12:07.330243222Z [2024-04-05T02:12:07.329+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:12:07.330678423Z [2024-04-05T02:12:07.330+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:11:00+00:00, run_id=scheduled__2024-04-05T02:11:00+00:00, run_start_date=2024-04-05 02:12:00.677901+00:00, run_end_date=2024-04-05 02:12:07.330078+00:00, run_duration=6.652177, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:11:00+00:00, data_interval_end=2024-04-05 02:12:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:12:07.350588821Z [2024-04-05T02:12:07.349+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:12:00+00:00, run_after=2024-04-05T02:13:00+00:00 2024-04-05T02:12:07.397501431Z [2024-04-05T02:12:07.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:11:00+00:00 exited with status success for try_number 1 2024-04-05T02:12:07.397754303Z [2024-04-05T02:12:07.397+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:11:00+00:00 exited with status success for try_number 1 2024-04-05T02:12:07.408189627Z [2024-04-05T02:12:07.407+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:11:00+00:00, map_index=-1, run_start_date=2024-04-05 02:12:04.101083+00:00, run_end_date=2024-04-05 02:12:06.289350+00:00, run_duration=2.188267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=990, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:12:00.746665+00:00, queued_by_job_id=1, pid=14493 2024-04-05T02:12:07.408630716Z [2024-04-05T02:12:07.408+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:11:00+00:00, map_index=-1, run_start_date=2024-04-05 02:12:04.471465+00:00, run_end_date=2024-04-05 02:12:06.325048+00:00, run_duration=1.853583, state=success, executor_state=success, try_number=1, max_tries=1, job_id=991, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:12:00.746665+00:00, queued_by_job_id=1, pid=14504 2024-04-05T02:13:00.511700853Z [2024-04-05T02:13:00.510+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:13:00+00:00, run_after=2024-04-05T02:14:00+00:00 2024-04-05T02:13:00.536328411Z [2024-04-05T02:13:00.535+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:13:00+00:00, run_after=2024-04-05T02:14:00+00:00 2024-04-05T02:13:00.549905907Z [2024-04-05T02:13:00.549+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:13:00.644811062Z [2024-04-05T02:13:00.644+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:13:00.644836936Z 2024-04-05T02:13:00.644841087Z 2024-04-05T02:13:00.644844418Z 2024-04-05T02:13:00.645151174Z [2024-04-05T02:13:00.644+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:13:00.645401333Z [2024-04-05T02:13:00.645+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:13:00.645645706Z [2024-04-05T02:13:00.645+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:13:00.646798839Z [2024-04-05T02:13:00.646+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:13:00.646810732Z 2024-04-05T02:13:00.646814521Z 2024-04-05T02:13:00.646818128Z 2024-04-05T02:13:00.652426902Z [2024-04-05T02:13:00.651+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:13:00.653247870Z [2024-04-05T02:13:00.652+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:13:00.653831885Z [2024-04-05T02:13:00.653+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:13:00.654090197Z [2024-04-05T02:13:00.653+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:13:00.654399084Z [2024-04-05T02:13:00.654+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:13:00.654576163Z [2024-04-05T02:13:00.654+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:13:01.049862817Z [2024-04-05T02:13:01.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:12:00+00:00 exited with status queued for try_number 1 2024-04-05T02:13:01.049898403Z [2024-04-05T02:13:01.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:12:00+00:00 exited with status queued for try_number 1 2024-04-05T02:13:01.049916854Z [2024-04-05T02:13:01.049+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:12:00+00:00 exited with status queued for try_number 1 2024-04-05T02:13:01.065917929Z [2024-04-05T02:13:01.065+0000] {scheduler_job.py:635} INFO - Setting external_id for to 768306f8-754e-4c48-9e1a-4ebbb2e59ffe 2024-04-05T02:13:01.065956343Z [2024-04-05T02:13:01.065+0000] {scheduler_job.py:635} INFO - Setting external_id for to 996bedaf-b6dc-48b5-8df0-1aa85392d400 2024-04-05T02:13:01.066039767Z [2024-04-05T02:13:01.065+0000] {scheduler_job.py:635} INFO - Setting external_id for to e98f199f-d3d7-4d23-9041-29bcec87cf19 2024-04-05T02:13:03.681097781Z [2024-04-05T02:13:03.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:13:03.681463598Z [2024-04-05T02:13:03.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:12:00+00:00, run_id=scheduled__2024-04-05T02:12:00+00:00, run_start_date=2024-04-05 02:13:00.570045+00:00, run_end_date=2024-04-05 02:13:03.681001+00:00, run_duration=3.110956, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:12:00+00:00, data_interval_end=2024-04-05 02:13:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:13:03.693855298Z [2024-04-05T02:13:03.693+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:13:00+00:00, run_after=2024-04-05T02:14:00+00:00 2024-04-05T02:13:03.759735171Z [2024-04-05T02:13:03.759+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:12:00+00:00 exited with status success for try_number 1 2024-04-05T02:13:03.766198158Z [2024-04-05T02:13:03.765+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:12:00+00:00, map_index=-1, run_start_date=2024-04-05 02:13:02.144079+00:00, run_end_date=2024-04-05 02:13:02.693099+00:00, run_duration=0.54902, state=success, executor_state=success, try_number=1, max_tries=1, job_id=992, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:13:00.648017+00:00, queued_by_job_id=1, pid=14532 2024-04-05T02:13:06.732664649Z [2024-04-05T02:13:06.731+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:13:06.733318794Z [2024-04-05T02:13:06.732+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:12:00+00:00, run_id=scheduled__2024-04-05T02:12:00+00:00, run_start_date=2024-04-05 02:13:00.572721+00:00, run_end_date=2024-04-05 02:13:06.732581+00:00, run_duration=6.15986, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:12:00+00:00, data_interval_end=2024-04-05 02:13:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:13:06.743971686Z [2024-04-05T02:13:06.743+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:13:00+00:00, run_after=2024-04-05T02:14:00+00:00 2024-04-05T02:13:06.788730685Z [2024-04-05T02:13:06.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:12:00+00:00 exited with status success for try_number 1 2024-04-05T02:13:06.797988858Z [2024-04-05T02:13:06.797+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:12:00+00:00, map_index=-1, run_start_date=2024-04-05 02:13:03.438670+00:00, run_end_date=2024-04-05 02:13:06.116100+00:00, run_duration=2.67743, state=success, executor_state=success, try_number=1, max_tries=1, job_id=994, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:13:00.648017+00:00, queued_by_job_id=1, pid=14550 2024-04-05T02:13:07.842390137Z [2024-04-05T02:13:07.841+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:13:07.842935727Z [2024-04-05T02:13:07.842+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:12:00+00:00, run_id=scheduled__2024-04-05T02:12:00+00:00, run_start_date=2024-04-05 02:13:00.574534+00:00, run_end_date=2024-04-05 02:13:07.842237+00:00, run_duration=7.267703, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:12:00+00:00, data_interval_end=2024-04-05 02:13:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:13:07.858428886Z [2024-04-05T02:13:07.858+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:13:00+00:00, run_after=2024-04-05T02:14:00+00:00 2024-04-05T02:13:07.897678933Z [2024-04-05T02:13:07.897+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:12:00+00:00 exited with status success for try_number 1 2024-04-05T02:13:07.908906620Z [2024-04-05T02:13:07.908+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:12:00+00:00, map_index=-1, run_start_date=2024-04-05 02:13:03.255138+00:00, run_end_date=2024-04-05 02:13:06.787150+00:00, run_duration=3.532012, state=success, executor_state=success, try_number=1, max_tries=1, job_id=993, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:13:00.648017+00:00, queued_by_job_id=1, pid=14549 2024-04-05T02:14:00.343842918Z [2024-04-05T02:14:00.343+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:14:00+00:00, run_after=2024-04-05T02:15:00+00:00 2024-04-05T02:14:00.351184551Z [2024-04-05T02:14:00.350+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:14:00.360067590Z [2024-04-05T02:14:00.359+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:14:00.374018604Z [2024-04-05T02:14:00.373+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:14:00+00:00, run_after=2024-04-05T02:15:00+00:00 2024-04-05T02:14:00.449195071Z [2024-04-05T02:14:00.448+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:14:00.449227375Z 2024-04-05T02:14:00.449235019Z 2024-04-05T02:14:00.449240792Z 2024-04-05T02:14:00.449246202Z 2024-04-05T02:14:00.449733789Z [2024-04-05T02:14:00.449+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:14:00.450165595Z [2024-04-05T02:14:00.449+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:14:00.450492111Z [2024-04-05T02:14:00.450+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:14:00.450741195Z [2024-04-05T02:14:00.450+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:14:00.451946703Z [2024-04-05T02:14:00.451+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:14:00.451959613Z 2024-04-05T02:14:00.451965401Z 2024-04-05T02:14:00.451968739Z 2024-04-05T02:14:00.451990649Z 2024-04-05T02:14:00.458004378Z [2024-04-05T02:14:00.457+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:12:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:14:00.458446769Z [2024-04-05T02:14:00.458+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:14:00.459010176Z [2024-04-05T02:14:00.458+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:14:00.459816741Z [2024-04-05T02:14:00.459+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:14:00.460313824Z [2024-04-05T02:14:00.460+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:14:00.460727196Z [2024-04-05T02:14:00.460+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:14:00.461247778Z [2024-04-05T02:14:00.461+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:13:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:14:00.461631607Z [2024-04-05T02:14:00.461+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:14:01.014743500Z [2024-04-05T02:14:01.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:12:00+00:00 exited with status queued for try_number 1 2024-04-05T02:14:01.017672007Z [2024-04-05T02:14:01.014+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:13:00+00:00 exited with status queued for try_number 1 2024-04-05T02:14:01.017989156Z [2024-04-05T02:14:01.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:13:00+00:00 exited with status queued for try_number 1 2024-04-05T02:14:01.018142102Z [2024-04-05T02:14:01.017+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:13:00+00:00 exited with status queued for try_number 1 2024-04-05T02:14:01.030745991Z [2024-04-05T02:14:01.030+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7d975855-3dfe-4c1a-ad2f-d4aeaaf6b1df 2024-04-05T02:14:01.033536090Z [2024-04-05T02:14:01.030+0000] {scheduler_job.py:635} INFO - Setting external_id for to 87577ee3-d47d-4187-bd64-25dfb4620025 2024-04-05T02:14:01.036242309Z [2024-04-05T02:14:01.035+0000] {scheduler_job.py:635} INFO - Setting external_id for to 48b6bd6d-ad57-4285-a8c6-f4b254f1e65f 2024-04-05T02:14:01.038398133Z [2024-04-05T02:14:01.038+0000] {scheduler_job.py:635} INFO - Setting external_id for to bac43c2e-1c9e-459c-9167-d25d8880e501 2024-04-05T02:14:03.626824093Z [2024-04-05T02:14:03.626+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:14:03.627542623Z [2024-04-05T02:14:03.627+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:13:00+00:00, run_id=scheduled__2024-04-05T02:13:00+00:00, run_start_date=2024-04-05 02:14:00.387472+00:00, run_end_date=2024-04-05 02:14:03.626983+00:00, run_duration=3.239511, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:13:00+00:00, data_interval_end=2024-04-05 02:14:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:14:03.646554217Z [2024-04-05T02:14:03.646+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:14:00+00:00, run_after=2024-04-05T02:15:00+00:00 2024-04-05T02:14:03.661726658Z [2024-04-05T02:14:03.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:14:03.662353958Z [2024-04-05T02:14:03.661+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:12:00+00:00, run_id=scheduled__2024-04-05T02:12:00+00:00, run_start_date=2024-04-05 02:14:00.386204+00:00, run_end_date=2024-04-05 02:14:03.661604+00:00, run_duration=3.2754, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:12:00+00:00, data_interval_end=2024-04-05 02:14:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:14:03.683260360Z [2024-04-05T02:14:03.682+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:14:00+00:00, run_after=2024-04-05T02:16:00+00:00 2024-04-05T02:14:03.765085978Z [2024-04-05T02:14:03.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:12:00+00:00 exited with status success for try_number 1 2024-04-05T02:14:03.765508989Z [2024-04-05T02:14:03.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:13:00+00:00 exited with status success for try_number 1 2024-04-05T02:14:03.782589241Z [2024-04-05T02:14:03.781+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:13:00+00:00, map_index=-1, run_start_date=2024-04-05 02:14:02.029177+00:00, run_end_date=2024-04-05 02:14:02.657349+00:00, run_duration=0.628172, state=success, executor_state=success, try_number=1, max_tries=1, job_id=995, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:14:00.453443+00:00, queued_by_job_id=1, pid=14584 2024-04-05T02:14:03.783045782Z [2024-04-05T02:14:03.782+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:12:00+00:00, map_index=-1, run_start_date=2024-04-05 02:14:02.424820+00:00, run_end_date=2024-04-05 02:14:03.017166+00:00, run_duration=0.592346, state=success, executor_state=success, try_number=1, max_tries=1, job_id=996, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:14:00.453443+00:00, queued_by_job_id=1, pid=14586 2024-04-05T02:14:05.963590936Z [2024-04-05T02:14:05.963+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:14:05.964084070Z [2024-04-05T02:14:05.963+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:13:00+00:00, run_id=scheduled__2024-04-05T02:13:00+00:00, run_start_date=2024-04-05 02:14:00.388622+00:00, run_end_date=2024-04-05 02:14:05.963437+00:00, run_duration=5.574815, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:13:00+00:00, data_interval_end=2024-04-05 02:14:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:14:05.979038388Z [2024-04-05T02:14:05.978+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:14:00+00:00, run_after=2024-04-05T02:15:00+00:00 2024-04-05T02:14:06.031364613Z [2024-04-05T02:14:06.030+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:13:00+00:00 exited with status success for try_number 1 2024-04-05T02:14:06.038736666Z [2024-04-05T02:14:06.038+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:13:00+00:00, map_index=-1, run_start_date=2024-04-05 02:14:03.260879+00:00, run_end_date=2024-04-05 02:14:05.276951+00:00, run_duration=2.016072, state=success, executor_state=success, try_number=1, max_tries=1, job_id=997, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:14:00.453443+00:00, queued_by_job_id=1, pid=14603 2024-04-05T02:14:09.368921197Z [2024-04-05T02:14:09.368+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:14:09.369180293Z [2024-04-05T02:14:09.368+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:13:00+00:00, run_id=scheduled__2024-04-05T02:13:00+00:00, run_start_date=2024-04-05 02:14:00.389681+00:00, run_end_date=2024-04-05 02:14:09.368799+00:00, run_duration=8.979118, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:13:00+00:00, data_interval_end=2024-04-05 02:14:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:14:09.378608081Z [2024-04-05T02:14:09.378+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:14:00+00:00, run_after=2024-04-05T02:15:00+00:00 2024-04-05T02:14:09.410363854Z [2024-04-05T02:14:09.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:13:00+00:00 exited with status success for try_number 1 2024-04-05T02:14:09.416315686Z [2024-04-05T02:14:09.415+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:13:00+00:00, map_index=-1, run_start_date=2024-04-05 02:14:03.747060+00:00, run_end_date=2024-04-05 02:14:08.184517+00:00, run_duration=4.437457, state=success, executor_state=success, try_number=1, max_tries=1, job_id=998, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:14:00.453443+00:00, queued_by_job_id=1, pid=14614 2024-04-05T02:15:00.684827488Z [2024-04-05T02:15:00.684+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:15:00+00:00, run_after=2024-04-05T02:16:00+00:00 2024-04-05T02:15:00.699529121Z [2024-04-05T02:15:00.699+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:15:00+00:00, run_after=2024-04-05T02:16:00+00:00 2024-04-05T02:15:00.709744390Z [2024-04-05T02:15:00.709+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:15:00.725200622Z [2024-04-05T02:15:00.724+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:15:00+00:00, run_after=2024-04-05T02:20:00+00:00 2024-04-05T02:15:00.836327728Z [2024-04-05T02:15:00.835+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:15:00.836354191Z 2024-04-05T02:15:00.836373862Z 2024-04-05T02:15:00.836377196Z 2024-04-05T02:15:00.836380848Z 2024-04-05T02:15:00.836695340Z [2024-04-05T02:15:00.836+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:15:00.836988339Z [2024-04-05T02:15:00.836+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:15:00.837373066Z [2024-04-05T02:15:00.837+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:15:00.837612485Z [2024-04-05T02:15:00.837+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:15:00.838677728Z [2024-04-05T02:15:00.838+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:15:00.838691286Z 2024-04-05T02:15:00.838695358Z 2024-04-05T02:15:00.838698682Z 2024-04-05T02:15:00.838701932Z 2024-04-05T02:15:00.843127769Z [2024-04-05T02:15:00.842+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:15:00.843299979Z [2024-04-05T02:15:00.843+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:15:00.843606529Z [2024-04-05T02:15:00.843+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:15:00.843795405Z [2024-04-05T02:15:00.843+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:15:00.844068936Z [2024-04-05T02:15:00.843+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:15:00.844229460Z [2024-04-05T02:15:00.844+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:15:00.844590159Z [2024-04-05T02:15:00.844+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:15:00.844708018Z [2024-04-05T02:15:00.844+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:15:01.591539829Z [2024-04-05T02:15:01.590+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status queued for try_number 1 2024-04-05T02:15:01.591607133Z [2024-04-05T02:15:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:14:00+00:00 exited with status queued for try_number 1 2024-04-05T02:15:01.594422511Z [2024-04-05T02:15:01.591+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:14:00+00:00 exited with status queued for try_number 1 2024-04-05T02:15:01.594536541Z [2024-04-05T02:15:01.594+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:14:00+00:00 exited with status queued for try_number 1 2024-04-05T02:15:01.614447535Z [2024-04-05T02:15:01.614+0000] {scheduler_job.py:635} INFO - Setting external_id for to b183185a-3709-4807-8492-071341f8371b 2024-04-05T02:15:01.619609951Z [2024-04-05T02:15:01.619+0000] {scheduler_job.py:635} INFO - Setting external_id for to a208f4ce-0d91-4699-b181-663eaf653a46 2024-04-05T02:15:01.619784359Z [2024-04-05T02:15:01.619+0000] {scheduler_job.py:635} INFO - Setting external_id for to 07d7540b-69e4-4805-be22-56ef9fa51692 2024-04-05T02:15:01.619950786Z [2024-04-05T02:15:01.619+0000] {scheduler_job.py:635} INFO - Setting external_id for to f530053b-6976-4692-8dc6-90c8e4459a9a 2024-04-05T02:15:03.244386221Z [2024-04-05T02:15:03.243+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:15:03.245184807Z [2024-04-05T02:15:03.244+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:14:00+00:00, run_id=scheduled__2024-04-05T02:14:00+00:00, run_start_date=2024-04-05 02:15:00.739332+00:00, run_end_date=2024-04-05 02:15:03.244443+00:00, run_duration=2.505111, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:14:00+00:00, data_interval_end=2024-04-05 02:15:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:15:03.270258364Z [2024-04-05T02:15:03.269+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:15:00+00:00, run_after=2024-04-05T02:16:00+00:00 2024-04-05T02:15:03.385709395Z [2024-04-05T02:15:03.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:14:00+00:00 exited with status success for try_number 1 2024-04-05T02:15:03.391825104Z [2024-04-05T02:15:03.391+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:14:00+00:00, map_index=-1, run_start_date=2024-04-05 02:15:02.267286+00:00, run_end_date=2024-04-05 02:15:02.831293+00:00, run_duration=0.564007, state=success, executor_state=success, try_number=1, max_tries=1, job_id=999, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:15:00.839713+00:00, queued_by_job_id=1, pid=14642 2024-04-05T02:15:04.524630258Z [2024-04-05T02:15:04.524+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:15:04.524655727Z 2024-04-05T02:15:04.524994659Z [2024-04-05T02:15:04.524+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:15:04.525788149Z [2024-04-05T02:15:04.525+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:15:04.525801927Z 2024-04-05T02:15:04.528799869Z [2024-04-05T02:15:04.528+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:15:04.528997809Z [2024-04-05T02:15:04.528+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:15:04.613602037Z [2024-04-05T02:15:04.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status queued for try_number 1 2024-04-05T02:15:04.622856656Z [2024-04-05T02:15:04.622+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd9fb62a-5358-4330-a35f-8f9292e193f7 2024-04-05T02:15:04.766651495Z [2024-04-05T02:15:04.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status success for try_number 1 2024-04-05T02:15:04.776763855Z [2024-04-05T02:15:04.776+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:10:00+00:00, map_index=-1, run_start_date=2024-04-05 02:15:03.966002+00:00, run_end_date=2024-04-05 02:15:04.398683+00:00, run_duration=0.432681, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1000, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:15:00.839713+00:00, queued_by_job_id=1, pid=14666 2024-04-05T02:15:06.484629997Z [2024-04-05T02:15:06.483+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:15:06.487218563Z [2024-04-05T02:15:06.484+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:14:00+00:00, run_id=scheduled__2024-04-05T02:14:00+00:00, run_start_date=2024-04-05 02:15:00.740775+00:00, run_end_date=2024-04-05 02:15:06.484472+00:00, run_duration=5.743697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:14:00+00:00, data_interval_end=2024-04-05 02:15:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:15:06.520099388Z [2024-04-05T02:15:06.519+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:15:00+00:00, run_after=2024-04-05T02:16:00+00:00 2024-04-05T02:15:06.533705479Z [2024-04-05T02:15:06.533+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:15:06.534195919Z [2024-04-05T02:15:06.533+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:14:00+00:00, run_id=scheduled__2024-04-05T02:14:00+00:00, run_start_date=2024-04-05 02:15:00.741938+00:00, run_end_date=2024-04-05 02:15:06.533505+00:00, run_duration=5.791567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:14:00+00:00, data_interval_end=2024-04-05 02:15:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:15:06.545957622Z [2024-04-05T02:15:06.545+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:15:00+00:00, run_after=2024-04-05T02:16:00+00:00 2024-04-05T02:15:06.611814603Z [2024-04-05T02:15:06.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:14:00+00:00 exited with status success for try_number 1 2024-04-05T02:15:06.612010346Z [2024-04-05T02:15:06.611+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:14:00+00:00 exited with status success for try_number 1 2024-04-05T02:15:06.620811518Z [2024-04-05T02:15:06.620+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:14:00+00:00, map_index=-1, run_start_date=2024-04-05 02:15:04.044946+00:00, run_end_date=2024-04-05 02:15:05.919475+00:00, run_duration=1.874529, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1001, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:15:00.839713+00:00, queued_by_job_id=1, pid=14667 2024-04-05T02:15:06.621376907Z [2024-04-05T02:15:06.621+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:14:00+00:00, map_index=-1, run_start_date=2024-04-05 02:15:04.153849+00:00, run_end_date=2024-04-05 02:15:05.510328+00:00, run_duration=1.356479, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1002, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:15:00.839713+00:00, queued_by_job_id=1, pid=14668 2024-04-05T02:15:08.318625918Z [2024-04-05T02:15:08.318+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:15:08.318684874Z 2024-04-05T02:15:08.318711379Z [2024-04-05T02:15:08.318+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:15:08.319370829Z [2024-04-05T02:15:08.319+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:15:08.319392757Z 2024-04-05T02:15:08.322543457Z [2024-04-05T02:15:08.322+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:10:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:15:08.322631888Z [2024-04-05T02:15:08.322+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:15:08.383246364Z [2024-04-05T02:15:08.382+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status queued for try_number 1 2024-04-05T02:15:08.383652905Z [2024-04-05T02:15:08.383+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status success for try_number 1 2024-04-05T02:15:08.390861967Z [2024-04-05T02:15:08.390+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19212f8c-3ab4-4a1c-8f5b-02649297d107 2024-04-05T02:15:08.391184672Z [2024-04-05T02:15:08.390+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T02:10:00+00:00, map_index=-1, run_start_date=2024-04-05 02:15:06.692546+00:00, run_end_date=2024-04-05 02:15:07.097899+00:00, run_duration=0.405353, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1003, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:15:04.526208+00:00, queued_by_job_id=1, pid=14691 2024-04-05T02:15:11.822500190Z [2024-04-05T02:15:11.812+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:15:11.822536630Z 2024-04-05T02:15:11.822544679Z [2024-04-05T02:15:11.812+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:15:11.827963893Z [2024-04-05T02:15:11.813+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:15:11.827994054Z 2024-04-05T02:15:11.835063034Z [2024-04-05T02:15:11.834+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:10:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:15:11.835834762Z [2024-04-05T02:15:11.835+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:15:11.915145686Z [2024-04-05T02:15:11.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status queued for try_number 1 2024-04-05T02:15:11.915223489Z [2024-04-05T02:15:11.915+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status success for try_number 1 2024-04-05T02:15:11.926141278Z [2024-04-05T02:15:11.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5336a6d7-e0e2-4d3c-b17e-3548908a2600 2024-04-05T02:15:11.926347787Z [2024-04-05T02:15:11.926+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:10:00+00:00, map_index=0, run_start_date=2024-04-05 02:15:10.170727+00:00, run_end_date=2024-04-05 02:15:11.498437+00:00, run_duration=1.32771, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1004, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:15:08.319845+00:00, queued_by_job_id=1, pid=14709 2024-04-05T02:15:14.731679301Z [2024-04-05T02:15:14.731+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:15:14.731933632Z [2024-04-05T02:15:14.731+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:10:00+00:00, run_id=scheduled__2024-04-05T02:10:00+00:00, run_start_date=2024-04-05 02:15:00.737708+00:00, run_end_date=2024-04-05 02:15:14.731482+00:00, run_duration=13.993774, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:10:00+00:00, data_interval_end=2024-04-05 02:15:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T02:15:14.740552031Z [2024-04-05T02:15:14.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:15:00+00:00, run_after=2024-04-05T02:20:00+00:00 2024-04-05T02:15:14.786516285Z [2024-04-05T02:15:14.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:10:00+00:00 exited with status success for try_number 1 2024-04-05T02:15:14.794711346Z [2024-04-05T02:15:14.794+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:10:00+00:00, map_index=-1, run_start_date=2024-04-05 02:15:13.846309+00:00, run_end_date=2024-04-05 02:15:14.189813+00:00, run_duration=0.343504, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1005, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:15:11.823017+00:00, queued_by_job_id=1, pid=14725 2024-04-05T02:15:41.887519742Z [2024-04-05T02:15:41.887+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:16:00.971074244Z [2024-04-05T02:16:00.970+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:16:00.998216735Z [2024-04-05T02:16:00.997+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:16:00+00:00, run_after=2024-04-05T02:17:00+00:00 2024-04-05T02:16:01.016800096Z [2024-04-05T02:16:01.016+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:16:01.037569081Z [2024-04-05T02:16:01.037+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:16:00+00:00, run_after=2024-04-05T02:17:00+00:00 2024-04-05T02:16:01.140483363Z [2024-04-05T02:16:01.139+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:16:01.140514557Z 2024-04-05T02:16:01.140524122Z 2024-04-05T02:16:01.140529310Z 2024-04-05T02:16:01.140534491Z 2024-04-05T02:16:01.140939038Z [2024-04-05T02:16:01.140+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:16:01.141377918Z [2024-04-05T02:16:01.141+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:16:01.141690001Z [2024-04-05T02:16:01.141+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:16:01.141952022Z [2024-04-05T02:16:01.141+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:16:01.142898458Z [2024-04-05T02:16:01.142+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:16:01.142946735Z 2024-04-05T02:16:01.142955436Z 2024-04-05T02:16:01.142961771Z 2024-04-05T02:16:01.142968709Z 2024-04-05T02:16:01.155650782Z [2024-04-05T02:16:01.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:14:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:16:01.155684991Z [2024-04-05T02:16:01.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:16:01.155694915Z [2024-04-05T02:16:01.155+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:16:01.155700400Z [2024-04-05T02:16:01.155+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:16:01.163306799Z [2024-04-05T02:16:01.161+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:16:01.163338913Z [2024-04-05T02:16:01.161+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:16:01.163346555Z [2024-04-05T02:16:01.162+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:16:01.163352156Z [2024-04-05T02:16:01.162+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:16:01.957506873Z [2024-04-05T02:16:01.956+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:14:00+00:00 exited with status queued for try_number 1 2024-04-05T02:16:01.957833205Z [2024-04-05T02:16:01.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status queued for try_number 1 2024-04-05T02:16:01.957953622Z [2024-04-05T02:16:01.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status queued for try_number 1 2024-04-05T02:16:01.958188069Z [2024-04-05T02:16:01.957+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status queued for try_number 1 2024-04-05T02:16:01.977212686Z [2024-04-05T02:16:01.976+0000] {scheduler_job.py:635} INFO - Setting external_id for to e5612504-2e41-4621-a56b-ac98296e44fd 2024-04-05T02:16:01.977374497Z [2024-04-05T02:16:01.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to e064e50c-9942-4751-a9ad-30cb9ce93aec 2024-04-05T02:16:01.977547386Z [2024-04-05T02:16:01.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to 436d4088-90be-451b-8790-953d7e6649a5 2024-04-05T02:16:01.977759645Z [2024-04-05T02:16:01.977+0000] {scheduler_job.py:635} INFO - Setting external_id for to ffac851c-7ae1-4422-8d13-f5c4c612c4ae 2024-04-05T02:16:04.180907249Z [2024-04-05T02:16:04.179+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:16:04.181851661Z [2024-04-05T02:16:04.181+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:14:00+00:00, run_id=scheduled__2024-04-05T02:14:00+00:00, run_start_date=2024-04-05 02:16:01.055434+00:00, run_end_date=2024-04-05 02:16:04.181374+00:00, run_duration=3.12594, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:14:00+00:00, data_interval_end=2024-04-05 02:16:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:16:04.191949563Z [2024-04-05T02:16:04.191+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:16:00+00:00, run_after=2024-04-05T02:18:00+00:00 2024-04-05T02:16:04.205293699Z [2024-04-05T02:16:04.204+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:16:04.205834026Z [2024-04-05T02:16:04.205+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:15:00+00:00, run_id=scheduled__2024-04-05T02:15:00+00:00, run_start_date=2024-04-05 02:16:01.057616+00:00, run_end_date=2024-04-05 02:16:04.205196+00:00, run_duration=3.14758, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:15:00+00:00, data_interval_end=2024-04-05 02:16:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:16:04.218472936Z [2024-04-05T02:16:04.218+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:16:00+00:00, run_after=2024-04-05T02:17:00+00:00 2024-04-05T02:16:04.278190936Z [2024-04-05T02:16:04.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:14:00+00:00 exited with status success for try_number 1 2024-04-05T02:16:04.278262868Z [2024-04-05T02:16:04.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status success for try_number 1 2024-04-05T02:16:04.290312900Z [2024-04-05T02:16:04.289+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:15:00+00:00, map_index=-1, run_start_date=2024-04-05 02:16:02.492207+00:00, run_end_date=2024-04-05 02:16:03.178258+00:00, run_duration=0.686051, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1006, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:16:01.148660+00:00, queued_by_job_id=1, pid=14735 2024-04-05T02:16:04.290627712Z [2024-04-05T02:16:04.290+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:14:00+00:00, map_index=-1, run_start_date=2024-04-05 02:16:02.748752+00:00, run_end_date=2024-04-05 02:16:03.223151+00:00, run_duration=0.474399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1007, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:16:01.148660+00:00, queued_by_job_id=1, pid=14736 2024-04-05T02:16:05.350051468Z [2024-04-05T02:16:05.349+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:16:05.350386682Z [2024-04-05T02:16:05.350+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:15:00+00:00, run_id=scheduled__2024-04-05T02:15:00+00:00, run_start_date=2024-04-05 02:16:01.060202+00:00, run_end_date=2024-04-05 02:16:05.349848+00:00, run_duration=4.289646, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:15:00+00:00, data_interval_end=2024-04-05 02:16:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:16:05.365194874Z [2024-04-05T02:16:05.364+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:16:00+00:00, run_after=2024-04-05T02:17:00+00:00 2024-04-05T02:16:05.414936720Z [2024-04-05T02:16:05.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status success for try_number 1 2024-04-05T02:16:05.420669605Z [2024-04-05T02:16:05.420+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:15:00+00:00, map_index=-1, run_start_date=2024-04-05 02:16:03.762535+00:00, run_end_date=2024-04-05 02:16:05.171985+00:00, run_duration=1.40945, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1008, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:16:01.148660+00:00, queued_by_job_id=1, pid=14754 2024-04-05T02:16:06.895405373Z [2024-04-05T02:16:06.894+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:16:06.895899480Z [2024-04-05T02:16:06.895+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:15:00+00:00, run_id=scheduled__2024-04-05T02:15:00+00:00, run_start_date=2024-04-05 02:16:01.062328+00:00, run_end_date=2024-04-05 02:16:06.895223+00:00, run_duration=5.832895, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:15:00+00:00, data_interval_end=2024-04-05 02:16:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:16:06.908497827Z [2024-04-05T02:16:06.908+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:16:00+00:00, run_after=2024-04-05T02:17:00+00:00 2024-04-05T02:16:06.948827345Z [2024-04-05T02:16:06.948+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status success for try_number 1 2024-04-05T02:16:06.962787691Z [2024-04-05T02:16:06.962+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:15:00+00:00, map_index=-1, run_start_date=2024-04-05 02:16:04.114613+00:00, run_end_date=2024-04-05 02:16:06.717434+00:00, run_duration=2.602821, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1009, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:16:01.148660+00:00, queued_by_job_id=1, pid=14765 2024-04-05T02:17:00.156589628Z [2024-04-05T02:17:00.156+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:17:00.180561812Z [2024-04-05T02:17:00.180+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:17:00+00:00, run_after=2024-04-05T02:18:00+00:00 2024-04-05T02:17:00.205180858Z [2024-04-05T02:17:00.203+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:17:00+00:00, run_after=2024-04-05T02:18:00+00:00 2024-04-05T02:17:00.289953772Z [2024-04-05T02:17:00.289+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:17:00.289982136Z 2024-04-05T02:17:00.289989165Z 2024-04-05T02:17:00.289993990Z 2024-04-05T02:17:00.290008349Z [2024-04-05T02:17:00.289+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:17:00.290080891Z [2024-04-05T02:17:00.289+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:17:00.290148746Z [2024-04-05T02:17:00.290+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:17:00.290753917Z [2024-04-05T02:17:00.290+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:17:00.290764542Z 2024-04-05T02:17:00.290768053Z 2024-04-05T02:17:00.290790112Z 2024-04-05T02:17:00.294820800Z [2024-04-05T02:17:00.294+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:17:00.294967785Z [2024-04-05T02:17:00.294+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:17:00.295408137Z [2024-04-05T02:17:00.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:17:00.295582381Z [2024-04-05T02:17:00.295+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:17:00.296052200Z [2024-04-05T02:17:00.295+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:17:00.296146574Z [2024-04-05T02:17:00.296+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:17:00.620610754Z [2024-04-05T02:17:00.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:16:00+00:00 exited with status queued for try_number 1 2024-04-05T02:17:00.620645065Z [2024-04-05T02:17:00.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:16:00+00:00 exited with status queued for try_number 1 2024-04-05T02:17:00.620679965Z [2024-04-05T02:17:00.620+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:16:00+00:00 exited with status queued for try_number 1 2024-04-05T02:17:00.631690445Z [2024-04-05T02:17:00.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 34c6415d-0bea-4f2b-8d58-69ef1e2e56f2 2024-04-05T02:17:00.631746806Z [2024-04-05T02:17:00.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to 878fb034-da82-4d30-a816-ac70c05782ea 2024-04-05T02:17:00.631855501Z [2024-04-05T02:17:00.631+0000] {scheduler_job.py:635} INFO - Setting external_id for to eb131f9a-c3c4-45f5-ab27-5b61cdc0ecec 2024-04-05T02:17:03.030879317Z [2024-04-05T02:17:03.030+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:17:03.031297666Z [2024-04-05T02:17:03.031+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:16:00+00:00, run_id=scheduled__2024-04-05T02:16:00+00:00, run_start_date=2024-04-05 02:17:00.236777+00:00, run_end_date=2024-04-05 02:17:03.030814+00:00, run_duration=2.794037, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:16:00+00:00, data_interval_end=2024-04-05 02:17:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:17:03.051457400Z [2024-04-05T02:17:03.049+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:17:00+00:00, run_after=2024-04-05T02:18:00+00:00 2024-04-05T02:17:03.125569232Z [2024-04-05T02:17:03.125+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:16:00+00:00 exited with status success for try_number 1 2024-04-05T02:17:03.133515250Z [2024-04-05T02:17:03.132+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:16:00+00:00, map_index=-1, run_start_date=2024-04-05 02:17:01.458021+00:00, run_end_date=2024-04-05 02:17:02.055024+00:00, run_duration=0.597003, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1010, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:17:00.291523+00:00, queued_by_job_id=1, pid=14793 2024-04-05T02:17:04.979533822Z [2024-04-05T02:17:04.978+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:17:04.980081495Z [2024-04-05T02:17:04.979+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:16:00+00:00, run_id=scheduled__2024-04-05T02:16:00+00:00, run_start_date=2024-04-05 02:17:00.238475+00:00, run_end_date=2024-04-05 02:17:04.979410+00:00, run_duration=4.740935, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:16:00+00:00, data_interval_end=2024-04-05 02:17:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:17:04.996852006Z [2024-04-05T02:17:04.996+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:17:00+00:00, run_after=2024-04-05T02:18:00+00:00 2024-04-05T02:17:05.008705201Z [2024-04-05T02:17:05.008+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:17:05.009318181Z [2024-04-05T02:17:05.008+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:16:00+00:00, run_id=scheduled__2024-04-05T02:16:00+00:00, run_start_date=2024-04-05 02:17:00.239791+00:00, run_end_date=2024-04-05 02:17:05.008797+00:00, run_duration=4.769006, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:16:00+00:00, data_interval_end=2024-04-05 02:17:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:17:05.022456050Z [2024-04-05T02:17:05.022+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:17:00+00:00, run_after=2024-04-05T02:18:00+00:00 2024-04-05T02:17:05.059922534Z [2024-04-05T02:17:05.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:16:00+00:00 exited with status success for try_number 1 2024-04-05T02:17:05.059956072Z [2024-04-05T02:17:05.059+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:16:00+00:00 exited with status success for try_number 1 2024-04-05T02:17:05.071112900Z [2024-04-05T02:17:05.070+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:16:00+00:00, map_index=-1, run_start_date=2024-04-05 02:17:03.172632+00:00, run_end_date=2024-04-05 02:17:04.816837+00:00, run_duration=1.644205, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1012, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:17:00.291523+00:00, queued_by_job_id=1, pid=14812 2024-04-05T02:17:05.071484490Z [2024-04-05T02:17:05.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:16:00+00:00, map_index=-1, run_start_date=2024-04-05 02:17:03.044245+00:00, run_end_date=2024-04-05 02:17:04.838280+00:00, run_duration=1.794035, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1011, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:17:00.291523+00:00, queued_by_job_id=1, pid=14811 2024-04-05T02:18:00.660144664Z [2024-04-05T02:18:00.658+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:18:00.690369498Z [2024-04-05T02:18:00.689+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:18:00+00:00, run_after=2024-04-05T02:19:00+00:00 2024-04-05T02:18:00.708173065Z [2024-04-05T02:18:00.707+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:18:00.723004292Z [2024-04-05T02:18:00.722+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:18:00+00:00, run_after=2024-04-05T02:19:00+00:00 2024-04-05T02:18:00.850050675Z [2024-04-05T02:18:00.849+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:18:00.850197230Z 2024-04-05T02:18:00.850217544Z 2024-04-05T02:18:00.850223815Z 2024-04-05T02:18:00.850229785Z 2024-04-05T02:18:00.850256478Z [2024-04-05T02:18:00.849+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:18:00.850386921Z [2024-04-05T02:18:00.850+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:18:00.850609195Z [2024-04-05T02:18:00.850+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:18:00.850791140Z [2024-04-05T02:18:00.850+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:18:00.851801647Z [2024-04-05T02:18:00.851+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:18:00.851822927Z 2024-04-05T02:18:00.851829838Z 2024-04-05T02:18:00.851835548Z 2024-04-05T02:18:00.851840959Z 2024-04-05T02:18:00.858996431Z [2024-04-05T02:18:00.858+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:16:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:18:00.859322425Z [2024-04-05T02:18:00.858+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:18:00.859817702Z [2024-04-05T02:18:00.859+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:18:00.860102823Z [2024-04-05T02:18:00.859+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:18:00.860601293Z [2024-04-05T02:18:00.860+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:18:00.860804516Z [2024-04-05T02:18:00.860+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:18:00.861110018Z [2024-04-05T02:18:00.860+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:17:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:18:00.861349920Z [2024-04-05T02:18:00.861+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:18:01.597070208Z [2024-04-05T02:18:01.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:16:00+00:00 exited with status queued for try_number 1 2024-04-05T02:18:01.597157966Z [2024-04-05T02:18:01.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:17:00+00:00 exited with status queued for try_number 1 2024-04-05T02:18:01.597165301Z [2024-04-05T02:18:01.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:17:00+00:00 exited with status queued for try_number 1 2024-04-05T02:18:01.597239221Z [2024-04-05T02:18:01.597+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:17:00+00:00 exited with status queued for try_number 1 2024-04-05T02:18:01.625361174Z [2024-04-05T02:18:01.624+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3acebddf-ea4b-4486-a260-631bea1b5bf9 2024-04-05T02:18:01.625435518Z [2024-04-05T02:18:01.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 382272d4-4592-490b-8fe3-6ed327717c58 2024-04-05T02:18:01.625552043Z [2024-04-05T02:18:01.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to c36559a4-881f-4b6b-91bc-a93c11add8b4 2024-04-05T02:18:01.625648680Z [2024-04-05T02:18:01.625+0000] {scheduler_job.py:635} INFO - Setting external_id for to 890ffdd5-d4a7-4206-a972-ac19953ed354 2024-04-05T02:18:04.317143334Z [2024-04-05T02:18:04.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:18:04.317865992Z [2024-04-05T02:18:04.317+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:16:00+00:00, run_id=scheduled__2024-04-05T02:16:00+00:00, run_start_date=2024-04-05 02:18:00.735674+00:00, run_end_date=2024-04-05 02:18:04.317072+00:00, run_duration=3.581398, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:16:00+00:00, data_interval_end=2024-04-05 02:18:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:18:04.329424026Z [2024-04-05T02:18:04.329+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:18:00+00:00, run_after=2024-04-05T02:20:00+00:00 2024-04-05T02:18:04.339257786Z [2024-04-05T02:18:04.338+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:18:04.339717070Z [2024-04-05T02:18:04.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:17:00+00:00, run_id=scheduled__2024-04-05T02:17:00+00:00, run_start_date=2024-04-05 02:18:00.737104+00:00, run_end_date=2024-04-05 02:18:04.339167+00:00, run_duration=3.602063, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:17:00+00:00, data_interval_end=2024-04-05 02:18:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:18:04.358922553Z [2024-04-05T02:18:04.358+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:18:00+00:00, run_after=2024-04-05T02:19:00+00:00 2024-04-05T02:18:04.427487260Z [2024-04-05T02:18:04.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:16:00+00:00 exited with status success for try_number 1 2024-04-05T02:18:04.427820085Z [2024-04-05T02:18:04.427+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:17:00+00:00 exited with status success for try_number 1 2024-04-05T02:18:04.438056496Z [2024-04-05T02:18:04.437+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:17:00+00:00, map_index=-1, run_start_date=2024-04-05 02:18:02.538249+00:00, run_end_date=2024-04-05 02:18:03.204377+00:00, run_duration=0.666128, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1013, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:18:00.853184+00:00, queued_by_job_id=1, pid=14845 2024-04-05T02:18:04.438765296Z [2024-04-05T02:18:04.438+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:16:00+00:00, map_index=-1, run_start_date=2024-04-05 02:18:02.812694+00:00, run_end_date=2024-04-05 02:18:03.470828+00:00, run_duration=0.658134, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1014, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:18:00.853184+00:00, queued_by_job_id=1, pid=14847 2024-04-05T02:18:06.580916487Z [2024-04-05T02:18:06.580+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:18:06.581364257Z [2024-04-05T02:18:06.580+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:17:00+00:00, run_id=scheduled__2024-04-05T02:17:00+00:00, run_start_date=2024-04-05 02:18:00.740954+00:00, run_end_date=2024-04-05 02:18:06.580797+00:00, run_duration=5.839843, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:17:00+00:00, data_interval_end=2024-04-05 02:18:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:18:06.599154296Z [2024-04-05T02:18:06.598+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:18:00+00:00, run_after=2024-04-05T02:19:00+00:00 2024-04-05T02:18:06.656018894Z [2024-04-05T02:18:06.655+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:17:00+00:00 exited with status success for try_number 1 2024-04-05T02:18:06.663366707Z [2024-04-05T02:18:06.662+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:17:00+00:00, map_index=-1, run_start_date=2024-04-05 02:18:04.156765+00:00, run_end_date=2024-04-05 02:18:06.218910+00:00, run_duration=2.062145, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1015, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:18:00.853184+00:00, queued_by_job_id=1, pid=14869 2024-04-05T02:18:07.717844792Z [2024-04-05T02:18:07.717+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:18:07.718652620Z [2024-04-05T02:18:07.718+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:17:00+00:00, run_id=scheduled__2024-04-05T02:17:00+00:00, run_start_date=2024-04-05 02:18:00.739113+00:00, run_end_date=2024-04-05 02:18:07.717755+00:00, run_duration=6.978642, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:17:00+00:00, data_interval_end=2024-04-05 02:18:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:18:07.735074243Z [2024-04-05T02:18:07.734+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:18:00+00:00, run_after=2024-04-05T02:19:00+00:00 2024-04-05T02:18:07.771703869Z [2024-04-05T02:18:07.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:17:00+00:00 exited with status success for try_number 1 2024-04-05T02:18:07.777464279Z [2024-04-05T02:18:07.777+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:17:00+00:00, map_index=-1, run_start_date=2024-04-05 02:18:04.458263+00:00, run_end_date=2024-04-05 02:18:07.298693+00:00, run_duration=2.84043, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1016, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:18:00.853184+00:00, queued_by_job_id=1, pid=14870 2024-04-05T02:19:00.561818688Z [2024-04-05T02:19:00.561+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:19:00+00:00, run_after=2024-04-05T02:20:00+00:00 2024-04-05T02:19:00.585788511Z [2024-04-05T02:19:00.585+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:19:00+00:00, run_after=2024-04-05T02:20:00+00:00 2024-04-05T02:19:00.604422223Z [2024-04-05T02:19:00.604+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:19:00.705450053Z [2024-04-05T02:19:00.705+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:19:00.705475284Z 2024-04-05T02:19:00.705479010Z 2024-04-05T02:19:00.705482357Z 2024-04-05T02:19:00.705555388Z [2024-04-05T02:19:00.705+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:19:00.705699066Z [2024-04-05T02:19:00.705+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:19:00.705835787Z [2024-04-05T02:19:00.705+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:19:00.706429287Z [2024-04-05T02:19:00.706+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:19:00.706439324Z 2024-04-05T02:19:00.706442658Z 2024-04-05T02:19:00.706445682Z 2024-04-05T02:19:00.716582501Z [2024-04-05T02:19:00.716+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:19:00.716697752Z [2024-04-05T02:19:00.716+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:19:00.716952381Z [2024-04-05T02:19:00.716+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:19:00.717090094Z [2024-04-05T02:19:00.716+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:19:00.717312130Z [2024-04-05T02:19:00.717+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:19:00.717443276Z [2024-04-05T02:19:00.717+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:19:01.409809514Z [2024-04-05T02:19:01.408+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:18:00+00:00 exited with status queued for try_number 1 2024-04-05T02:19:01.409921664Z [2024-04-05T02:19:01.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:18:00+00:00 exited with status queued for try_number 1 2024-04-05T02:19:01.410196104Z [2024-04-05T02:19:01.409+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:18:00+00:00 exited with status queued for try_number 1 2024-04-05T02:19:01.499319440Z [2024-04-05T02:19:01.498+0000] {scheduler_job.py:635} INFO - Setting external_id for to b059a505-e02b-4116-9446-7d564b62eaa7 2024-04-05T02:19:01.499593634Z [2024-04-05T02:19:01.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0f6a3967-d2e9-47eb-9e22-be5994e265ba 2024-04-05T02:19:01.499822466Z [2024-04-05T02:19:01.499+0000] {scheduler_job.py:635} INFO - Setting external_id for to af31f3e7-af31-4865-9b10-d6e9ac519e77 2024-04-05T02:19:04.080060322Z [2024-04-05T02:19:04.079+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:19:04.080829331Z [2024-04-05T02:19:04.080+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:18:00+00:00, run_id=scheduled__2024-04-05T02:18:00+00:00, run_start_date=2024-04-05 02:19:00.615667+00:00, run_end_date=2024-04-05 02:19:04.079957+00:00, run_duration=3.46429, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:18:00+00:00, data_interval_end=2024-04-05 02:19:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:19:04.105148627Z [2024-04-05T02:19:04.104+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:19:00+00:00, run_after=2024-04-05T02:20:00+00:00 2024-04-05T02:19:04.166083522Z [2024-04-05T02:19:04.165+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:18:00+00:00 exited with status success for try_number 1 2024-04-05T02:19:04.174544158Z [2024-04-05T02:19:04.174+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:18:00+00:00, map_index=-1, run_start_date=2024-04-05 02:19:02.446302+00:00, run_end_date=2024-04-05 02:19:03.092464+00:00, run_duration=0.646162, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1017, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:19:00.707125+00:00, queued_by_job_id=1, pid=14902 2024-04-05T02:19:06.329700258Z [2024-04-05T02:19:06.329+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:19:06.330119124Z [2024-04-05T02:19:06.329+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:18:00+00:00, run_id=scheduled__2024-04-05T02:18:00+00:00, run_start_date=2024-04-05 02:19:00.617934+00:00, run_end_date=2024-04-05 02:19:06.329647+00:00, run_duration=5.711713, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:18:00+00:00, data_interval_end=2024-04-05 02:19:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:19:06.349679002Z [2024-04-05T02:19:06.349+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:19:00+00:00, run_after=2024-04-05T02:20:00+00:00 2024-04-05T02:19:06.361003703Z [2024-04-05T02:19:06.360+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:19:06.361449491Z [2024-04-05T02:19:06.361+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:18:00+00:00, run_id=scheduled__2024-04-05T02:18:00+00:00, run_start_date=2024-04-05 02:19:00.616903+00:00, run_end_date=2024-04-05 02:19:06.360981+00:00, run_duration=5.744078, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:18:00+00:00, data_interval_end=2024-04-05 02:19:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:19:06.378220702Z [2024-04-05T02:19:06.377+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:19:00+00:00, run_after=2024-04-05T02:20:00+00:00 2024-04-05T02:19:06.417472451Z [2024-04-05T02:19:06.417+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:18:00+00:00 exited with status success for try_number 1 2024-04-05T02:19:06.424402556Z [2024-04-05T02:19:06.423+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:18:00+00:00, map_index=-1, run_start_date=2024-04-05 02:19:03.977333+00:00, run_end_date=2024-04-05 02:19:05.768512+00:00, run_duration=1.791179, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1018, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:19:00.707125+00:00, queued_by_job_id=1, pid=14920 2024-04-05T02:19:06.669525412Z [2024-04-05T02:19:06.669+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:18:00+00:00 exited with status success for try_number 1 2024-04-05T02:19:06.675010900Z [2024-04-05T02:19:06.674+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:18:00+00:00, map_index=-1, run_start_date=2024-04-05 02:19:03.991798+00:00, run_end_date=2024-04-05 02:19:06.257320+00:00, run_duration=2.265522, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1019, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:19:00.707125+00:00, queued_by_job_id=1, pid=14921 2024-04-05T02:20:00.857647320Z [2024-04-05T02:20:00.857+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:20:00.875427960Z [2024-04-05T02:20:00.875+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:20:00.889828257Z [2024-04-05T02:20:00.889+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:20:00+00:00, run_after=2024-04-05T02:25:00+00:00 2024-04-05T02:20:00.906517359Z [2024-04-05T02:20:00.905+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:20:00+00:00, run_after=2024-04-05T02:21:00+00:00 2024-04-05T02:20:00.922364169Z [2024-04-05T02:20:00.921+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:20:00+00:00, run_after=2024-04-05T02:21:00+00:00 2024-04-05T02:20:01.021526873Z [2024-04-05T02:20:01.021+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T02:20:01.021559614Z 2024-04-05T02:20:01.021564823Z 2024-04-05T02:20:01.021569972Z 2024-04-05T02:20:01.021574140Z 2024-04-05T02:20:01.021578550Z 2024-04-05T02:20:01.021592806Z [2024-04-05T02:20:01.021+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:20:01.021672190Z [2024-04-05T02:20:01.021+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:20:01.021715075Z [2024-04-05T02:20:01.021+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:20:01.021811046Z [2024-04-05T02:20:01.021+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:20:01.021873594Z [2024-04-05T02:20:01.021+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:20:01.022452475Z [2024-04-05T02:20:01.022+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:20:01.022468147Z 2024-04-05T02:20:01.022473963Z 2024-04-05T02:20:01.022478721Z 2024-04-05T02:20:01.022483146Z 2024-04-05T02:20:01.022488006Z 2024-04-05T02:20:01.026532301Z [2024-04-05T02:20:01.026+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:20:01.026632817Z [2024-04-05T02:20:01.026+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:20:01.026882008Z [2024-04-05T02:20:01.026+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:18:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:20:01.026985361Z [2024-04-05T02:20:01.026+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:20:01.027169597Z [2024-04-05T02:20:01.027+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:20:01.027229378Z [2024-04-05T02:20:01.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:20:01.027426644Z [2024-04-05T02:20:01.027+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:20:01.027481008Z [2024-04-05T02:20:01.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:20:01.027665126Z [2024-04-05T02:20:01.027+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:19:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:20:01.027779986Z [2024-04-05T02:20:01.027+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:20:01.648566941Z [2024-04-05T02:20:01.647+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status queued for try_number 1 2024-04-05T02:20:01.648617871Z [2024-04-05T02:20:01.648+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:18:00+00:00 exited with status queued for try_number 1 2024-04-05T02:20:01.652082334Z [2024-04-05T02:20:01.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:19:00+00:00 exited with status queued for try_number 1 2024-04-05T02:20:01.652128792Z [2024-04-05T02:20:01.651+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:19:00+00:00 exited with status queued for try_number 1 2024-04-05T02:20:01.652289119Z [2024-04-05T02:20:01.652+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:19:00+00:00 exited with status queued for try_number 1 2024-04-05T02:20:01.677264974Z [2024-04-05T02:20:01.676+0000] {scheduler_job.py:635} INFO - Setting external_id for to a07e45eb-e4b1-4ae5-bb52-2437f12f739b 2024-04-05T02:20:01.677527920Z [2024-04-05T02:20:01.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to e215f5c6-266a-475a-a08d-99fa1dd77ee8 2024-04-05T02:20:01.677794962Z [2024-04-05T02:20:01.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to c07c469d-4ec3-4203-a521-9056b956cb67 2024-04-05T02:20:01.677966011Z [2024-04-05T02:20:01.677+0000] {scheduler_job.py:635} INFO - Setting external_id for to be79f03f-0f7e-4cf1-b473-6d2ad3f29bd6 2024-04-05T02:20:01.678276740Z [2024-04-05T02:20:01.678+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7ad0feea-412b-4399-86d1-43d3a1a6709f 2024-04-05T02:20:03.681928680Z [2024-04-05T02:20:03.681+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:20:03.682113251Z [2024-04-05T02:20:03.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:19:00+00:00, run_id=scheduled__2024-04-05T02:19:00+00:00, run_start_date=2024-04-05 02:20:00.945352+00:00, run_end_date=2024-04-05 02:20:03.681772+00:00, run_duration=2.73642, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:19:00+00:00, data_interval_end=2024-04-05 02:20:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:20:03.694363933Z [2024-04-05T02:20:03.693+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:20:00+00:00, run_after=2024-04-05T02:21:00+00:00 2024-04-05T02:20:03.754421098Z [2024-04-05T02:20:03.753+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:19:00+00:00 exited with status success for try_number 1 2024-04-05T02:20:03.760504101Z [2024-04-05T02:20:03.760+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:19:00+00:00, map_index=-1, run_start_date=2024-04-05 02:20:02.860364+00:00, run_end_date=2024-04-05 02:20:03.350520+00:00, run_duration=0.490156, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1020, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:20:01.023403+00:00, queued_by_job_id=1, pid=14956 2024-04-05T02:20:04.850508034Z [2024-04-05T02:20:04.850+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:20:04.850661911Z [2024-04-05T02:20:04.850+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:18:00+00:00, run_id=scheduled__2024-04-05T02:18:00+00:00, run_start_date=2024-04-05 02:20:00.944010+00:00, run_end_date=2024-04-05 02:20:04.850376+00:00, run_duration=3.906366, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:18:00+00:00, data_interval_end=2024-04-05 02:20:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:20:04.864913607Z [2024-04-05T02:20:04.864+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:20:00+00:00, run_after=2024-04-05T02:22:00+00:00 2024-04-05T02:20:04.954588386Z [2024-04-05T02:20:04.953+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:18:00+00:00 exited with status success for try_number 1 2024-04-05T02:20:04.960300040Z [2024-04-05T02:20:04.959+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:18:00+00:00, map_index=-1, run_start_date=2024-04-05 02:20:02.808980+00:00, run_end_date=2024-04-05 02:20:03.919148+00:00, run_duration=1.110168, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1021, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:20:01.023403+00:00, queued_by_job_id=1, pid=14955 2024-04-05T02:20:06.090895017Z [2024-04-05T02:20:06.090+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:20:06.090931839Z 2024-04-05T02:20:06.096588166Z [2024-04-05T02:20:06.095+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:20:06.097773366Z [2024-04-05T02:20:06.097+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:20:06.097799715Z 2024-04-05T02:20:06.101791665Z [2024-04-05T02:20:06.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:20:06.102082195Z [2024-04-05T02:20:06.101+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:20:06.214888694Z [2024-04-05T02:20:06.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status queued for try_number 1 2024-04-05T02:20:06.214915061Z [2024-04-05T02:20:06.214+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status success for try_number 1 2024-04-05T02:20:06.224095077Z [2024-04-05T02:20:06.223+0000] {scheduler_job.py:635} INFO - Setting external_id for to 033b6289-bf31-42b8-b4b3-551e2f7e0a8b 2024-04-05T02:20:06.224252223Z [2024-04-05T02:20:06.224+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:15:00+00:00, map_index=-1, run_start_date=2024-04-05 02:20:04.805807+00:00, run_end_date=2024-04-05 02:20:05.464467+00:00, run_duration=0.65866, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1023, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:20:01.023403+00:00, queued_by_job_id=1, pid=14986 2024-04-05T02:20:07.382846586Z [2024-04-05T02:20:07.382+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:20:07.383409707Z [2024-04-05T02:20:07.383+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:19:00+00:00, run_id=scheduled__2024-04-05T02:19:00+00:00, run_start_date=2024-04-05 02:20:00.946722+00:00, run_end_date=2024-04-05 02:20:07.382721+00:00, run_duration=6.435999, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:19:00+00:00, data_interval_end=2024-04-05 02:20:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:20:07.400200784Z [2024-04-05T02:20:07.399+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:20:00+00:00, run_after=2024-04-05T02:21:00+00:00 2024-04-05T02:20:07.468161483Z [2024-04-05T02:20:07.467+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:19:00+00:00 exited with status success for try_number 1 2024-04-05T02:20:07.474165965Z [2024-04-05T02:20:07.473+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:19:00+00:00, map_index=-1, run_start_date=2024-04-05 02:20:04.972909+00:00, run_end_date=2024-04-05 02:20:07.043859+00:00, run_duration=2.07095, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1024, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:20:01.023403+00:00, queued_by_job_id=1, pid=14987 2024-04-05T02:20:07.544318739Z [2024-04-05T02:20:07.543+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:20:07.544796208Z [2024-04-05T02:20:07.544+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:19:00+00:00, run_id=scheduled__2024-04-05T02:19:00+00:00, run_start_date=2024-04-05 02:20:00.947775+00:00, run_end_date=2024-04-05 02:20:07.544156+00:00, run_duration=6.596381, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:19:00+00:00, data_interval_end=2024-04-05 02:20:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:20:07.560754895Z [2024-04-05T02:20:07.560+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:20:00+00:00, run_after=2024-04-05T02:21:00+00:00 2024-04-05T02:20:07.618880803Z [2024-04-05T02:20:07.618+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:19:00+00:00 exited with status success for try_number 1 2024-04-05T02:20:07.628631947Z [2024-04-05T02:20:07.627+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:19:00+00:00, map_index=-1, run_start_date=2024-04-05 02:20:04.656512+00:00, run_end_date=2024-04-05 02:20:07.362994+00:00, run_duration=2.706482, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1022, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:20:01.023403+00:00, queued_by_job_id=1, pid=14985 2024-04-05T02:20:08.731736637Z [2024-04-05T02:20:08.731+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:20:08.731800370Z 2024-04-05T02:20:08.731806437Z [2024-04-05T02:20:08.731+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:20:08.732542129Z [2024-04-05T02:20:08.732+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:20:08.732562913Z 2024-04-05T02:20:08.735158829Z [2024-04-05T02:20:08.734+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:15:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:20:08.735250784Z [2024-04-05T02:20:08.735+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:20:08.786801680Z [2024-04-05T02:20:08.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status queued for try_number 1 2024-04-05T02:20:08.787192930Z [2024-04-05T02:20:08.786+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status success for try_number 1 2024-04-05T02:20:08.795874271Z [2024-04-05T02:20:08.795+0000] {scheduler_job.py:635} INFO - Setting external_id for to e29849f9-89ad-4ef3-a333-80fe1a03246a 2024-04-05T02:20:08.796525274Z [2024-04-05T02:20:08.796+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T02:15:00+00:00, map_index=-1, run_start_date=2024-04-05 02:20:07.994839+00:00, run_end_date=2024-04-05 02:20:08.387352+00:00, run_duration=0.392513, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1025, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:20:06.098392+00:00, queued_by_job_id=1, pid=15010 2024-04-05T02:20:12.719120420Z [2024-04-05T02:20:12.718+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:20:12.719151459Z 2024-04-05T02:20:12.719324915Z [2024-04-05T02:20:12.719+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:20:12.720103815Z [2024-04-05T02:20:12.719+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:20:12.720123806Z 2024-04-05T02:20:12.722817472Z [2024-04-05T02:20:12.722+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:15:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:20:12.723046129Z [2024-04-05T02:20:12.722+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:20:12.789313866Z [2024-04-05T02:20:12.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status queued for try_number 1 2024-04-05T02:20:12.789341926Z [2024-04-05T02:20:12.789+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status success for try_number 1 2024-04-05T02:20:12.795321865Z [2024-04-05T02:20:12.794+0000] {scheduler_job.py:635} INFO - Setting external_id for to d3d1f4e2-9e1d-4035-a83a-8179adddab0e 2024-04-05T02:20:12.795532456Z [2024-04-05T02:20:12.795+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:15:00+00:00, map_index=0, run_start_date=2024-04-05 02:20:10.866035+00:00, run_end_date=2024-04-05 02:20:12.282303+00:00, run_duration=1.416268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1026, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:20:08.732780+00:00, queued_by_job_id=1, pid=15029 2024-04-05T02:20:16.005627814Z [2024-04-05T02:20:16.004+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:20:16.006079161Z [2024-04-05T02:20:16.005+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:15:00+00:00, run_id=scheduled__2024-04-05T02:15:00+00:00, run_start_date=2024-04-05 02:20:00.942607+00:00, run_end_date=2024-04-05 02:20:16.005636+00:00, run_duration=15.063029, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:15:00+00:00, data_interval_end=2024-04-05 02:20:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T02:20:16.024547303Z [2024-04-05T02:20:16.023+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:20:00+00:00, run_after=2024-04-05T02:25:00+00:00 2024-04-05T02:20:16.091737792Z [2024-04-05T02:20:16.086+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:15:00+00:00 exited with status success for try_number 1 2024-04-05T02:20:16.093770085Z [2024-04-05T02:20:16.093+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:15:00+00:00, map_index=-1, run_start_date=2024-04-05 02:20:14.586274+00:00, run_end_date=2024-04-05 02:20:14.940084+00:00, run_duration=0.35381, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1027, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:20:12.720602+00:00, queued_by_job_id=1, pid=15045 2024-04-05T02:20:41.944319780Z [2024-04-05T02:20:41.943+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:21:00.090816175Z [2024-04-05T02:21:00.090+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:21:00.111884917Z [2024-04-05T02:21:00.111+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:21:00+00:00, run_after=2024-04-05T02:22:00+00:00 2024-04-05T02:21:00.126576171Z [2024-04-05T02:21:00.126+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:21:00+00:00, run_after=2024-04-05T02:22:00+00:00 2024-04-05T02:21:00.207599170Z [2024-04-05T02:21:00.207+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:21:00.207635851Z 2024-04-05T02:21:00.207639773Z 2024-04-05T02:21:00.207643136Z 2024-04-05T02:21:00.207654194Z [2024-04-05T02:21:00.207+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:21:00.207755257Z [2024-04-05T02:21:00.207+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:21:00.207850963Z [2024-04-05T02:21:00.207+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:21:00.208875440Z [2024-04-05T02:21:00.208+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:21:00.208886631Z 2024-04-05T02:21:00.208890199Z 2024-04-05T02:21:00.208893530Z 2024-04-05T02:21:00.212450413Z [2024-04-05T02:21:00.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:21:00.212480812Z [2024-04-05T02:21:00.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:21:00.212688561Z [2024-04-05T02:21:00.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:21:00.212741214Z [2024-04-05T02:21:00.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:21:00.212928905Z [2024-04-05T02:21:00.212+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:21:00.212988791Z [2024-04-05T02:21:00.212+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:21:00.538552077Z [2024-04-05T02:21:00.537+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status queued for try_number 1 2024-04-05T02:21:00.541315563Z [2024-04-05T02:21:00.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status queued for try_number 1 2024-04-05T02:21:00.541546598Z [2024-04-05T02:21:00.541+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status queued for try_number 1 2024-04-05T02:21:00.574830235Z [2024-04-05T02:21:00.574+0000] {scheduler_job.py:635} INFO - Setting external_id for to 80df1fea-19a5-49f1-be48-5158df5c3623 2024-04-05T02:21:00.574864771Z [2024-04-05T02:21:00.574+0000] {scheduler_job.py:635} INFO - Setting external_id for to b25f9cf5-1ca8-4305-8537-b9d5c8704243 2024-04-05T02:21:00.575040046Z [2024-04-05T02:21:00.574+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa88983d-b76e-44a7-b963-47f414c1359a 2024-04-05T02:21:03.091083370Z [2024-04-05T02:21:03.090+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:21:03.091744810Z [2024-04-05T02:21:03.091+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:20:00+00:00, run_id=scheduled__2024-04-05T02:20:00+00:00, run_start_date=2024-04-05 02:21:00.137374+00:00, run_end_date=2024-04-05 02:21:03.091105+00:00, run_duration=2.953731, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:20:00+00:00, data_interval_end=2024-04-05 02:21:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:21:03.111024998Z [2024-04-05T02:21:03.110+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:21:00+00:00, run_after=2024-04-05T02:22:00+00:00 2024-04-05T02:21:03.174467201Z [2024-04-05T02:21:03.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status success for try_number 1 2024-04-05T02:21:03.180040233Z [2024-04-05T02:21:03.179+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:20:00+00:00, map_index=-1, run_start_date=2024-04-05 02:21:01.329925+00:00, run_end_date=2024-04-05 02:21:02.126218+00:00, run_duration=0.796293, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1028, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:21:00.209812+00:00, queued_by_job_id=1, pid=15054 2024-04-05T02:21:05.659213183Z [2024-04-05T02:21:05.658+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:21:05.659516559Z [2024-04-05T02:21:05.659+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:20:00+00:00, run_id=scheduled__2024-04-05T02:20:00+00:00, run_start_date=2024-04-05 02:21:00.139909+00:00, run_end_date=2024-04-05 02:21:05.659075+00:00, run_duration=5.519166, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:20:00+00:00, data_interval_end=2024-04-05 02:21:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:21:05.669774993Z [2024-04-05T02:21:05.669+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:21:00+00:00, run_after=2024-04-05T02:22:00+00:00 2024-04-05T02:21:05.681608897Z [2024-04-05T02:21:05.680+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:21:05.682096692Z [2024-04-05T02:21:05.681+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:20:00+00:00, run_id=scheduled__2024-04-05T02:20:00+00:00, run_start_date=2024-04-05 02:21:00.138762+00:00, run_end_date=2024-04-05 02:21:05.681467+00:00, run_duration=5.542705, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:20:00+00:00, data_interval_end=2024-04-05 02:21:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:21:05.694928910Z [2024-04-05T02:21:05.694+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:21:00+00:00, run_after=2024-04-05T02:22:00+00:00 2024-04-05T02:21:05.731774110Z [2024-04-05T02:21:05.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status success for try_number 1 2024-04-05T02:21:05.731821557Z [2024-04-05T02:21:05.731+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status success for try_number 1 2024-04-05T02:21:05.739411763Z [2024-04-05T02:21:05.738+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:20:00+00:00, map_index=-1, run_start_date=2024-04-05 02:21:03.161047+00:00, run_end_date=2024-04-05 02:21:04.916173+00:00, run_duration=1.755126, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1029, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:21:00.209812+00:00, queued_by_job_id=1, pid=15067 2024-04-05T02:21:05.740804269Z [2024-04-05T02:21:05.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:20:00+00:00, map_index=-1, run_start_date=2024-04-05 02:21:03.479743+00:00, run_end_date=2024-04-05 02:21:04.952439+00:00, run_duration=1.472696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1030, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:21:00.209812+00:00, queued_by_job_id=1, pid=15075 2024-04-05T02:22:00.248715070Z [2024-04-05T02:22:00.248+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:22:00+00:00, run_after=2024-04-05T02:23:00+00:00 2024-04-05T02:22:00.264202833Z [2024-04-05T02:22:00.263+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:22:00+00:00, run_after=2024-04-05T02:23:00+00:00 2024-04-05T02:22:00.272252824Z [2024-04-05T02:22:00.271+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:22:00.280049545Z [2024-04-05T02:22:00.279+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:22:00.364400369Z [2024-04-05T02:22:00.363+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:22:00.364463761Z 2024-04-05T02:22:00.364471375Z 2024-04-05T02:22:00.364477015Z 2024-04-05T02:22:00.364482453Z 2024-04-05T02:22:00.364912846Z [2024-04-05T02:22:00.364+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:22:00.365404073Z [2024-04-05T02:22:00.365+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:22:00.365762870Z [2024-04-05T02:22:00.365+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:22:00.366100846Z [2024-04-05T02:22:00.365+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:22:00.367183001Z [2024-04-05T02:22:00.366+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:22:00.367195965Z 2024-04-05T02:22:00.367201178Z 2024-04-05T02:22:00.367205761Z 2024-04-05T02:22:00.367210167Z 2024-04-05T02:22:00.373499965Z [2024-04-05T02:22:00.373+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:22:00.373924754Z [2024-04-05T02:22:00.373+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:22:00.374288380Z [2024-04-05T02:22:00.374+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:22:00.374518673Z [2024-04-05T02:22:00.374+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:22:00.374934173Z [2024-04-05T02:22:00.374+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:22:00.375281412Z [2024-04-05T02:22:00.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:22:00.375824890Z [2024-04-05T02:22:00.375+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:21:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:22:00.376173059Z [2024-04-05T02:22:00.375+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:22:00.918099824Z [2024-04-05T02:22:00.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status queued for try_number 1 2024-04-05T02:22:00.918141421Z [2024-04-05T02:22:00.917+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:21:00+00:00 exited with status queued for try_number 1 2024-04-05T02:22:00.918184550Z [2024-04-05T02:22:00.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:21:00+00:00 exited with status queued for try_number 1 2024-04-05T02:22:00.918320536Z [2024-04-05T02:22:00.918+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:21:00+00:00 exited with status queued for try_number 1 2024-04-05T02:22:00.953672144Z [2024-04-05T02:22:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3d0c705c-1499-422d-97d6-b55c9b5c03c6 2024-04-05T02:22:00.953718399Z [2024-04-05T02:22:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to 30cad698-1fb6-4dc8-b5de-1d5424897be5 2024-04-05T02:22:00.953821629Z [2024-04-05T02:22:00.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to 57dbedd1-9c25-42d1-8bd3-878cd414eafd 2024-04-05T02:22:00.956674012Z [2024-04-05T02:22:00.956+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5cc63982-ee2d-4e91-97ab-e6da7841ffd3 2024-04-05T02:22:02.557442015Z [2024-04-05T02:22:02.557+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:22:02.557474137Z 2024-04-05T02:22:02.558170910Z [2024-04-05T02:22:02.557+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-05T02:22:02.558931564Z [2024-04-05T02:22:02.558+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:22:02.558944010Z 2024-04-05T02:22:02.564455018Z [2024-04-05T02:22:02.564+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240405022201_435911', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:22:02.564588173Z [2024-04-05T02:22:02.564+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240405022201_435911', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-05T02:22:02.706018584Z [2024-04-05T02:22:02.705+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240405022201_435911 exited with status queued for try_number 1 2024-04-05T02:22:02.715779553Z [2024-04-05T02:22:02.715+0000] {scheduler_job.py:635} INFO - Setting external_id for to a976134f-f71b-4213-81c5-85ecb12d978a 2024-04-05T02:22:03.983285436Z [2024-04-05T02:22:03.982+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:22:03.983860493Z [2024-04-05T02:22:03.983+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:20:00+00:00, run_id=scheduled__2024-04-05T02:20:00+00:00, run_start_date=2024-04-05 02:22:00.290519+00:00, run_end_date=2024-04-05 02:22:03.983175+00:00, run_duration=3.692656, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:20:00+00:00, data_interval_end=2024-04-05 02:22:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:22:03.994342889Z [2024-04-05T02:22:03.993+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:22:00+00:00, run_after=2024-04-05T02:24:00+00:00 2024-04-05T02:22:04.002919576Z [2024-04-05T02:22:04.002+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:22:04.003184120Z [2024-04-05T02:22:04.002+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:21:00+00:00, run_id=scheduled__2024-04-05T02:21:00+00:00, run_start_date=2024-04-05 02:22:00.291831+00:00, run_end_date=2024-04-05 02:22:04.002749+00:00, run_duration=3.710918, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:21:00+00:00, data_interval_end=2024-04-05 02:22:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:22:04.016251270Z [2024-04-05T02:22:04.015+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:22:00+00:00, run_after=2024-04-05T02:23:00+00:00 2024-04-05T02:22:04.108657858Z [2024-04-05T02:22:04.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status success for try_number 1 2024-04-05T02:22:04.108732184Z [2024-04-05T02:22:04.108+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:21:00+00:00 exited with status success for try_number 1 2024-04-05T02:22:04.120993266Z [2024-04-05T02:22:04.120+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:20:00+00:00, map_index=-1, run_start_date=2024-04-05 02:22:02.278096+00:00, run_end_date=2024-04-05 02:22:02.872670+00:00, run_duration=0.594574, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1031, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:22:00.369070+00:00, queued_by_job_id=1, pid=15106 2024-04-05T02:22:04.121335128Z [2024-04-05T02:22:04.121+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:21:00+00:00, map_index=-1, run_start_date=2024-04-05 02:22:02.448321+00:00, run_end_date=2024-04-05 02:22:03.228851+00:00, run_duration=0.78053, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1032, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:22:00.369070+00:00, queued_by_job_id=1, pid=15107 2024-04-05T02:22:04.433573550Z [2024-04-05T02:22:04.433+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240405022201_435911 exited with status success for try_number 1 2024-04-05T02:22:04.447062800Z [2024-04-05T02:22:04.446+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240405022201_435911, map_index=-1, run_start_date=2024-04-05 02:22:03.571263+00:00, run_end_date=2024-04-05 02:22:04.163898+00:00, run_duration=0.592635, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1033, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:22:02.559465+00:00, queued_by_job_id=1, pid=15121 2024-04-05T02:22:05.521200255Z [2024-04-05T02:22:05.520+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:22:05.521844898Z [2024-04-05T02:22:05.521+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-05 02:22:01.901188+00:00, run_id=scaleout_vdu_20240405022201_435911, run_start_date=2024-04-05 02:22:02.420608+00:00, run_end_date=2024-04-05 02:22:05.521295+00:00, run_duration=3.100687, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-05 02:22:01.901188+00:00, data_interval_end=2024-04-05 02:22:01.901188+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-05T02:22:05.526081867Z [2024-04-05T02:22:05.525+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-05T02:22:06.625849249Z [2024-04-05T02:22:06.625+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:22:06.626554835Z [2024-04-05T02:22:06.626+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:21:00+00:00, run_id=scheduled__2024-04-05T02:21:00+00:00, run_start_date=2024-04-05 02:22:00.292898+00:00, run_end_date=2024-04-05 02:22:06.625956+00:00, run_duration=6.333058, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:21:00+00:00, data_interval_end=2024-04-05 02:22:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:22:06.637963754Z [2024-04-05T02:22:06.637+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:22:00+00:00, run_after=2024-04-05T02:23:00+00:00 2024-04-05T02:22:06.646051300Z [2024-04-05T02:22:06.645+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:22:06.646463002Z [2024-04-05T02:22:06.646+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:21:00+00:00, run_id=scheduled__2024-04-05T02:21:00+00:00, run_start_date=2024-04-05 02:22:00.294095+00:00, run_end_date=2024-04-05 02:22:06.646072+00:00, run_duration=6.351977, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:21:00+00:00, data_interval_end=2024-04-05 02:22:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:22:06.656692828Z [2024-04-05T02:22:06.656+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:22:00+00:00, run_after=2024-04-05T02:23:00+00:00 2024-04-05T02:22:06.692897497Z [2024-04-05T02:22:06.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:21:00+00:00 exited with status success for try_number 1 2024-04-05T02:22:06.693047268Z [2024-04-05T02:22:06.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:21:00+00:00 exited with status success for try_number 1 2024-04-05T02:22:06.707919186Z [2024-04-05T02:22:06.707+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:21:00+00:00, map_index=-1, run_start_date=2024-04-05 02:22:04.286611+00:00, run_end_date=2024-04-05 02:22:06.354271+00:00, run_duration=2.06766, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1035, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:22:00.369070+00:00, queued_by_job_id=1, pid=15139 2024-04-05T02:22:06.708147391Z [2024-04-05T02:22:06.707+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:21:00+00:00, map_index=-1, run_start_date=2024-04-05 02:22:04.094284+00:00, run_end_date=2024-04-05 02:22:06.509683+00:00, run_duration=2.415399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1034, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:22:00.369070+00:00, queued_by_job_id=1, pid=15138 2024-04-05T02:23:00.197291604Z [2024-04-05T02:23:00.196+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:23:00+00:00, run_after=2024-04-05T02:24:00+00:00 2024-04-05T02:23:00.214098598Z [2024-04-05T02:23:00.213+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:23:00.229679726Z [2024-04-05T02:23:00.229+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:23:00+00:00, run_after=2024-04-05T02:24:00+00:00 2024-04-05T02:23:00.316867253Z [2024-04-05T02:23:00.316+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:23:00.316896771Z 2024-04-05T02:23:00.316901227Z 2024-04-05T02:23:00.316904696Z 2024-04-05T02:23:00.317173199Z [2024-04-05T02:23:00.316+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:23:00.317421895Z [2024-04-05T02:23:00.317+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:23:00.317682365Z [2024-04-05T02:23:00.317+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:23:00.318389086Z [2024-04-05T02:23:00.318+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:23:00.318400575Z 2024-04-05T02:23:00.318404169Z 2024-04-05T02:23:00.318407506Z 2024-04-05T02:23:00.323082507Z [2024-04-05T02:23:00.322+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:23:00.323388132Z [2024-04-05T02:23:00.323+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:23:00.323788623Z [2024-04-05T02:23:00.323+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:23:00.324185572Z [2024-04-05T02:23:00.323+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:23:00.324629843Z [2024-04-05T02:23:00.324+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:23:00.324950580Z [2024-04-05T02:23:00.324+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:23:00.661785060Z [2024-04-05T02:23:00.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:22:00+00:00 exited with status queued for try_number 1 2024-04-05T02:23:00.664624588Z [2024-04-05T02:23:00.661+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:22:00+00:00 exited with status queued for try_number 1 2024-04-05T02:23:00.664651555Z [2024-04-05T02:23:00.662+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:22:00+00:00 exited with status queued for try_number 1 2024-04-05T02:23:00.674463835Z [2024-04-05T02:23:00.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to 59719c38-7147-459a-bf5e-19609047bca3 2024-04-05T02:23:00.674545411Z [2024-04-05T02:23:00.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2385f9c0-90cd-4c43-9b41-eaccd89405f3 2024-04-05T02:23:00.674767395Z [2024-04-05T02:23:00.674+0000] {scheduler_job.py:635} INFO - Setting external_id for to de65d99d-7680-46aa-b556-b555008bc434 2024-04-05T02:23:03.717106507Z [2024-04-05T02:23:03.716+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:23:03.717594402Z [2024-04-05T02:23:03.717+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:22:00+00:00, run_id=scheduled__2024-04-05T02:22:00+00:00, run_start_date=2024-04-05 02:23:00.240883+00:00, run_end_date=2024-04-05 02:23:03.716981+00:00, run_duration=3.476098, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:22:00+00:00, data_interval_end=2024-04-05 02:23:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:23:03.729158033Z [2024-04-05T02:23:03.728+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:23:00+00:00, run_after=2024-04-05T02:24:00+00:00 2024-04-05T02:23:03.792414081Z [2024-04-05T02:23:03.791+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:22:00+00:00 exited with status success for try_number 1 2024-04-05T02:23:03.803246196Z [2024-04-05T02:23:03.802+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:22:00+00:00, map_index=-1, run_start_date=2024-04-05 02:23:01.997787+00:00, run_end_date=2024-04-05 02:23:02.579363+00:00, run_duration=0.581576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1036, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:23:00.319181+00:00, queued_by_job_id=1, pid=15171 2024-04-05T02:23:05.739871129Z [2024-04-05T02:23:05.739+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:23:05.740203304Z [2024-04-05T02:23:05.739+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:22:00+00:00, run_id=scheduled__2024-04-05T02:22:00+00:00, run_start_date=2024-04-05 02:23:00.242172+00:00, run_end_date=2024-04-05 02:23:05.739724+00:00, run_duration=5.497552, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:22:00+00:00, data_interval_end=2024-04-05 02:23:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:23:05.752824874Z [2024-04-05T02:23:05.752+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:23:00+00:00, run_after=2024-04-05T02:24:00+00:00 2024-04-05T02:23:05.765420934Z [2024-04-05T02:23:05.765+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:23:05.765817048Z [2024-04-05T02:23:05.765+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:22:00+00:00, run_id=scheduled__2024-04-05T02:22:00+00:00, run_start_date=2024-04-05 02:23:00.243310+00:00, run_end_date=2024-04-05 02:23:05.765342+00:00, run_duration=5.522032, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:22:00+00:00, data_interval_end=2024-04-05 02:23:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:23:05.779214695Z [2024-04-05T02:23:05.778+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:23:00+00:00, run_after=2024-04-05T02:24:00+00:00 2024-04-05T02:23:05.817082014Z [2024-04-05T02:23:05.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:22:00+00:00 exited with status success for try_number 1 2024-04-05T02:23:05.817137860Z [2024-04-05T02:23:05.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:22:00+00:00 exited with status success for try_number 1 2024-04-05T02:23:05.825166386Z [2024-04-05T02:23:05.824+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:22:00+00:00, map_index=-1, run_start_date=2024-04-05 02:23:03.361518+00:00, run_end_date=2024-04-05 02:23:05.264599+00:00, run_duration=1.903081, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1037, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:23:00.319181+00:00, queued_by_job_id=1, pid=15189 2024-04-05T02:23:05.825485712Z [2024-04-05T02:23:05.825+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:22:00+00:00, map_index=-1, run_start_date=2024-04-05 02:23:03.420001+00:00, run_end_date=2024-04-05 02:23:05.314926+00:00, run_duration=1.894925, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1038, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:23:00.319181+00:00, queued_by_job_id=1, pid=15190 2024-04-05T02:24:00.971227632Z [2024-04-05T02:24:00.970+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:24:00+00:00, run_after=2024-04-05T02:25:00+00:00 2024-04-05T02:24:00.982504580Z [2024-04-05T02:24:00.981+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:24:01.000886627Z [2024-04-05T02:24:01.000+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:24:00+00:00, run_after=2024-04-05T02:25:00+00:00 2024-04-05T02:24:01.012880354Z [2024-04-05T02:24:01.012+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:24:01.135095596Z [2024-04-05T02:24:01.134+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:24:01.135132399Z 2024-04-05T02:24:01.135137041Z 2024-04-05T02:24:01.135140564Z 2024-04-05T02:24:01.135144029Z 2024-04-05T02:24:01.135733505Z [2024-04-05T02:24:01.135+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:24:01.136036338Z [2024-04-05T02:24:01.135+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:24:01.136281434Z [2024-04-05T02:24:01.136+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:24:01.136650354Z [2024-04-05T02:24:01.136+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:24:01.137534287Z [2024-04-05T02:24:01.137+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:24:01.137546977Z 2024-04-05T02:24:01.137551447Z 2024-04-05T02:24:01.137555441Z 2024-04-05T02:24:01.137559393Z 2024-04-05T02:24:01.142946369Z [2024-04-05T02:24:01.142+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:22:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:24:01.143264369Z [2024-04-05T02:24:01.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:24:01.143847234Z [2024-04-05T02:24:01.143+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:24:01.144107059Z [2024-04-05T02:24:01.143+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:24:01.144453800Z [2024-04-05T02:24:01.144+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:24:01.147040476Z [2024-04-05T02:24:01.144+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:24:01.147506353Z [2024-04-05T02:24:01.146+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:23:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:24:01.147840238Z [2024-04-05T02:24:01.147+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:24:02.045372714Z [2024-04-05T02:24:02.043+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:22:00+00:00 exited with status queued for try_number 1 2024-04-05T02:24:02.045722607Z [2024-04-05T02:24:02.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:23:00+00:00 exited with status queued for try_number 1 2024-04-05T02:24:02.046014809Z [2024-04-05T02:24:02.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:23:00+00:00 exited with status queued for try_number 1 2024-04-05T02:24:02.046272930Z [2024-04-05T02:24:02.045+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:23:00+00:00 exited with status queued for try_number 1 2024-04-05T02:24:02.060852911Z [2024-04-05T02:24:02.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to f3dcd231-b9e8-4762-94ff-61d157fec182 2024-04-05T02:24:02.060959495Z [2024-04-05T02:24:02.060+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9e3face9-d80d-423d-9d33-35fa3a7af702 2024-04-05T02:24:02.061178265Z [2024-04-05T02:24:02.061+0000] {scheduler_job.py:635} INFO - Setting external_id for to 9d59a30b-6889-47cd-80ee-c499e2827e45 2024-04-05T02:24:02.061296451Z [2024-04-05T02:24:02.061+0000] {scheduler_job.py:635} INFO - Setting external_id for to e78a8545-5b39-4f80-9575-934afab387c2 2024-04-05T02:24:03.450789438Z [2024-04-05T02:24:03.450+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:24:03.451819411Z [2024-04-05T02:24:03.451+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:22:00+00:00, run_id=scheduled__2024-04-05T02:22:00+00:00, run_start_date=2024-04-05 02:24:01.028851+00:00, run_end_date=2024-04-05 02:24:03.450656+00:00, run_duration=2.421805, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:22:00+00:00, data_interval_end=2024-04-05 02:24:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:24:03.463815971Z [2024-04-05T02:24:03.463+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:24:00+00:00, run_after=2024-04-05T02:26:00+00:00 2024-04-05T02:24:03.539412651Z [2024-04-05T02:24:03.538+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:22:00+00:00 exited with status success for try_number 1 2024-04-05T02:24:03.539521577Z [2024-04-05T02:24:03.539+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:23:00+00:00 exited with status success for try_number 1 2024-04-05T02:24:03.547466872Z [2024-04-05T02:24:03.546+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:23:00+00:00, map_index=-1, run_start_date=2024-04-05 02:24:02.837179+00:00, run_end_date=2024-04-05 02:24:03.359360+00:00, run_duration=0.522181, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1040, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:24:01.138752+00:00, queued_by_job_id=1, pid=15229 2024-04-05T02:24:03.547873796Z [2024-04-05T02:24:03.547+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:22:00+00:00, map_index=-1, run_start_date=2024-04-05 02:24:02.214008+00:00, run_end_date=2024-04-05 02:24:02.699738+00:00, run_duration=0.48573, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1039, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:24:01.138752+00:00, queued_by_job_id=1, pid=15218 2024-04-05T02:24:04.597192537Z [2024-04-05T02:24:04.596+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:24:04.597729161Z [2024-04-05T02:24:04.597+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:23:00+00:00, run_id=scheduled__2024-04-05T02:23:00+00:00, run_start_date=2024-04-05 02:24:01.030554+00:00, run_end_date=2024-04-05 02:24:04.597343+00:00, run_duration=3.566789, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:23:00+00:00, data_interval_end=2024-04-05 02:24:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:24:04.608465296Z [2024-04-05T02:24:04.608+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:24:00+00:00, run_after=2024-04-05T02:25:00+00:00 2024-04-05T02:24:05.726937612Z [2024-04-05T02:24:05.726+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:24:05.727226020Z [2024-04-05T02:24:05.726+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:23:00+00:00, run_id=scheduled__2024-04-05T02:23:00+00:00, run_start_date=2024-04-05 02:24:01.032012+00:00, run_end_date=2024-04-05 02:24:05.726756+00:00, run_duration=4.694744, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:23:00+00:00, data_interval_end=2024-04-05 02:24:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:24:05.740834013Z [2024-04-05T02:24:05.740+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:24:00+00:00, run_after=2024-04-05T02:25:00+00:00 2024-04-05T02:24:06.844569335Z [2024-04-05T02:24:06.843+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:24:06.844842866Z [2024-04-05T02:24:06.844+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:23:00+00:00, run_id=scheduled__2024-04-05T02:23:00+00:00, run_start_date=2024-04-05 02:24:01.033302+00:00, run_end_date=2024-04-05 02:24:06.844383+00:00, run_duration=5.811081, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:23:00+00:00, data_interval_end=2024-04-05 02:24:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:24:06.854632378Z [2024-04-05T02:24:06.854+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:24:00+00:00, run_after=2024-04-05T02:25:00+00:00 2024-04-05T02:24:06.896325703Z [2024-04-05T02:24:06.895+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:23:00+00:00 exited with status success for try_number 1 2024-04-05T02:24:06.896684641Z [2024-04-05T02:24:06.896+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:23:00+00:00 exited with status success for try_number 1 2024-04-05T02:24:06.909274080Z [2024-04-05T02:24:06.908+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:23:00+00:00, map_index=-1, run_start_date=2024-04-05 02:24:03.965305+00:00, run_end_date=2024-04-05 02:24:05.665289+00:00, run_duration=1.699984, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1042, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:24:01.138752+00:00, queued_by_job_id=1, pid=15248 2024-04-05T02:24:06.909882158Z [2024-04-05T02:24:06.909+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:23:00+00:00, map_index=-1, run_start_date=2024-04-05 02:24:03.855479+00:00, run_end_date=2024-04-05 02:24:06.070148+00:00, run_duration=2.214669, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1041, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:24:01.138752+00:00, queued_by_job_id=1, pid=15247 2024-04-05T02:25:00.247031748Z [2024-04-05T02:25:00.246+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:25:00+00:00, run_after=2024-04-05T02:26:00+00:00 2024-04-05T02:25:00.261016141Z [2024-04-05T02:25:00.260+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:25:00+00:00, run_after=2024-04-05T02:26:00+00:00 2024-04-05T02:25:00.269389186Z [2024-04-05T02:25:00.269+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:25:00.281632737Z [2024-04-05T02:25:00.281+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:25:00+00:00, run_after=2024-04-05T02:30:00+00:00 2024-04-05T02:25:00.398583398Z [2024-04-05T02:25:00.398+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:25:00.398608878Z 2024-04-05T02:25:00.398615668Z 2024-04-05T02:25:00.398619002Z 2024-04-05T02:25:00.398622323Z 2024-04-05T02:25:00.398786468Z [2024-04-05T02:25:00.398+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:25:00.398971240Z [2024-04-05T02:25:00.398+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:25:00.399134938Z [2024-04-05T02:25:00.399+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:25:00.399283966Z [2024-04-05T02:25:00.399+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:25:00.399969870Z [2024-04-05T02:25:00.399+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:25:00.399982962Z 2024-04-05T02:25:00.399986707Z 2024-04-05T02:25:00.399990142Z 2024-04-05T02:25:00.399993801Z 2024-04-05T02:25:00.404281496Z [2024-04-05T02:25:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:25:00.404475749Z [2024-04-05T02:25:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:25:00.404786174Z [2024-04-05T02:25:00.404+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:25:00.404941240Z [2024-04-05T02:25:00.404+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:25:00.405204431Z [2024-04-05T02:25:00.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:25:00.405363468Z [2024-04-05T02:25:00.405+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:25:00.405626970Z [2024-04-05T02:25:00.405+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:25:00.405852101Z [2024-04-05T02:25:00.405+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:25:00.851067368Z [2024-04-05T02:25:00.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status queued for try_number 1 2024-04-05T02:25:00.851221996Z [2024-04-05T02:25:00.850+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:24:00+00:00 exited with status queued for try_number 1 2024-04-05T02:25:00.851370152Z [2024-04-05T02:25:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:24:00+00:00 exited with status queued for try_number 1 2024-04-05T02:25:00.851480771Z [2024-04-05T02:25:00.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:24:00+00:00 exited with status queued for try_number 1 2024-04-05T02:25:00.870575056Z [2024-04-05T02:25:00.868+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2728d3aa-42f7-495f-a3b8-8775caff7d13 2024-04-05T02:25:00.870724702Z [2024-04-05T02:25:00.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to 028eab4e-c8cf-48a9-ab17-7c304b46d987 2024-04-05T02:25:00.870886432Z [2024-04-05T02:25:00.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to 68700aae-96e9-47f4-b031-e70f7c60e3ca 2024-04-05T02:25:00.871038767Z [2024-04-05T02:25:00.870+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a45f96b-104e-4e23-8596-3d10d37f3e33 2024-04-05T02:25:02.854579466Z [2024-04-05T02:25:02.854+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:25:02.854885467Z [2024-04-05T02:25:02.854+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:24:00+00:00, run_id=scheduled__2024-04-05T02:24:00+00:00, run_start_date=2024-04-05 02:25:00.294196+00:00, run_end_date=2024-04-05 02:25:02.854432+00:00, run_duration=2.560236, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:24:00+00:00, data_interval_end=2024-04-05 02:25:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:25:02.867253723Z [2024-04-05T02:25:02.866+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:25:00+00:00, run_after=2024-04-05T02:26:00+00:00 2024-04-05T02:25:02.969496261Z [2024-04-05T02:25:02.969+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:24:00+00:00 exited with status success for try_number 1 2024-04-05T02:25:02.976860166Z [2024-04-05T02:25:02.976+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:24:00+00:00, map_index=-1, run_start_date=2024-04-05 02:25:01.613772+00:00, run_end_date=2024-04-05 02:25:02.374705+00:00, run_duration=0.760933, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1043, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:25:00.400883+00:00, queued_by_job_id=1, pid=15281 2024-04-05T02:25:04.097626144Z [2024-04-05T02:25:04.097+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:25:04.097656577Z 2024-04-05T02:25:04.097918103Z [2024-04-05T02:25:04.097+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:25:04.098461758Z [2024-04-05T02:25:04.098+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:25:04.098480201Z 2024-04-05T02:25:04.102298989Z [2024-04-05T02:25:04.101+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:25:04.102545732Z [2024-04-05T02:25:04.102+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:25:04.167486463Z [2024-04-05T02:25:04.166+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status queued for try_number 1 2024-04-05T02:25:04.167629368Z [2024-04-05T02:25:04.167+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status success for try_number 1 2024-04-05T02:25:04.176921946Z [2024-04-05T02:25:04.176+0000] {scheduler_job.py:635} INFO - Setting external_id for to ac9d4752-ee95-4f04-aa4e-a85284d24718 2024-04-05T02:25:04.177223628Z [2024-04-05T02:25:04.176+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:20:00+00:00, map_index=-1, run_start_date=2024-04-05 02:25:03.363122+00:00, run_end_date=2024-04-05 02:25:03.779681+00:00, run_duration=0.416559, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1045, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:25:00.400883+00:00, queued_by_job_id=1, pid=15306 2024-04-05T02:25:05.395536796Z [2024-04-05T02:25:05.394+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:25:05.396320165Z [2024-04-05T02:25:05.395+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:24:00+00:00, run_id=scheduled__2024-04-05T02:24:00+00:00, run_start_date=2024-04-05 02:25:00.295340+00:00, run_end_date=2024-04-05 02:25:05.395770+00:00, run_duration=5.10043, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:24:00+00:00, data_interval_end=2024-04-05 02:25:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:25:05.415738360Z [2024-04-05T02:25:05.415+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:25:00+00:00, run_after=2024-04-05T02:26:00+00:00 2024-04-05T02:25:05.428007704Z [2024-04-05T02:25:05.427+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:25:05.429107454Z [2024-04-05T02:25:05.428+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:24:00+00:00, run_id=scheduled__2024-04-05T02:24:00+00:00, run_start_date=2024-04-05 02:25:00.296488+00:00, run_end_date=2024-04-05 02:25:05.428489+00:00, run_duration=5.132001, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:24:00+00:00, data_interval_end=2024-04-05 02:25:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:25:05.455321410Z [2024-04-05T02:25:05.454+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:25:00+00:00, run_after=2024-04-05T02:26:00+00:00 2024-04-05T02:25:05.543878589Z [2024-04-05T02:25:05.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:24:00+00:00 exited with status success for try_number 1 2024-04-05T02:25:05.544362549Z [2024-04-05T02:25:05.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:24:00+00:00 exited with status success for try_number 1 2024-04-05T02:25:05.554865070Z [2024-04-05T02:25:05.554+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:24:00+00:00, map_index=-1, run_start_date=2024-04-05 02:25:03.438075+00:00, run_end_date=2024-04-05 02:25:04.800007+00:00, run_duration=1.361932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1046, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:25:00.400883+00:00, queued_by_job_id=1, pid=15307 2024-04-05T02:25:05.555485291Z [2024-04-05T02:25:05.555+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:24:00+00:00, map_index=-1, run_start_date=2024-04-05 02:25:03.297523+00:00, run_end_date=2024-04-05 02:25:05.087980+00:00, run_duration=1.790457, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1044, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:25:00.400883+00:00, queued_by_job_id=1, pid=15305 2024-04-05T02:25:07.698349715Z [2024-04-05T02:25:07.697+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:25:07.698407333Z 2024-04-05T02:25:07.698676568Z [2024-04-05T02:25:07.698+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:25:07.700087114Z [2024-04-05T02:25:07.699+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:25:07.700124233Z 2024-04-05T02:25:07.704817604Z [2024-04-05T02:25:07.704+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:20:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:25:07.705338016Z [2024-04-05T02:25:07.705+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:25:07.772442957Z [2024-04-05T02:25:07.771+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status queued for try_number 1 2024-04-05T02:25:07.772550757Z [2024-04-05T02:25:07.772+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status success for try_number 1 2024-04-05T02:25:07.780211135Z [2024-04-05T02:25:07.779+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4dd2a07a-8526-49ef-b41c-a325c177bee8 2024-04-05T02:25:07.780342804Z [2024-04-05T02:25:07.780+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T02:20:00+00:00, map_index=-1, run_start_date=2024-04-05 02:25:06.013303+00:00, run_end_date=2024-04-05 02:25:06.468417+00:00, run_duration=0.455114, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1047, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:25:04.098807+00:00, queued_by_job_id=1, pid=15330 2024-04-05T02:25:12.543321537Z [2024-04-05T02:25:12.542+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:25:12.543353706Z 2024-04-05T02:25:12.543628437Z [2024-04-05T02:25:12.543+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:25:12.544314391Z [2024-04-05T02:25:12.544+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:25:12.544327359Z 2024-04-05T02:25:12.548224219Z [2024-04-05T02:25:12.547+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:20:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:25:12.548464818Z [2024-04-05T02:25:12.548+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:25:12.644314897Z [2024-04-05T02:25:12.643+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status queued for try_number 1 2024-04-05T02:25:12.644346373Z [2024-04-05T02:25:12.644+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status success for try_number 1 2024-04-05T02:25:12.653078290Z [2024-04-05T02:25:12.652+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7648c3b9-bd98-4e4c-9dd5-be9b1f278714 2024-04-05T02:25:12.653148614Z [2024-04-05T02:25:12.653+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:20:00+00:00, map_index=0, run_start_date=2024-04-05 02:25:09.648366+00:00, run_end_date=2024-04-05 02:25:11.402644+00:00, run_duration=1.754278, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1048, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:25:07.700934+00:00, queued_by_job_id=1, pid=15348 2024-04-05T02:25:15.376274862Z [2024-04-05T02:25:15.375+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:25:15.376940488Z [2024-04-05T02:25:15.376+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:20:00+00:00, run_id=scheduled__2024-04-05T02:20:00+00:00, run_start_date=2024-04-05 02:25:00.292878+00:00, run_end_date=2024-04-05 02:25:15.376141+00:00, run_duration=15.083263, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:20:00+00:00, data_interval_end=2024-04-05 02:25:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T02:25:15.388758086Z [2024-04-05T02:25:15.388+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:25:00+00:00, run_after=2024-04-05T02:30:00+00:00 2024-04-05T02:25:15.434682617Z [2024-04-05T02:25:15.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:20:00+00:00 exited with status success for try_number 1 2024-04-05T02:25:15.442678924Z [2024-04-05T02:25:15.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:20:00+00:00, map_index=-1, run_start_date=2024-04-05 02:25:14.362270+00:00, run_end_date=2024-04-05 02:25:14.767967+00:00, run_duration=0.405697, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1049, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:25:12.545026+00:00, queued_by_job_id=1, pid=15364 2024-04-05T02:25:42.010498538Z [2024-04-05T02:25:42.010+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:26:00.575242111Z [2024-04-05T02:26:00.574+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:26:00+00:00, run_after=2024-04-05T02:27:00+00:00 2024-04-05T02:26:00.593193920Z [2024-04-05T02:26:00.591+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:26:00.618314071Z [2024-04-05T02:26:00.617+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:26:00.642114036Z [2024-04-05T02:26:00.641+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:26:00+00:00, run_after=2024-04-05T02:27:00+00:00 2024-04-05T02:26:00.781519925Z [2024-04-05T02:26:00.781+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:26:00.781550064Z 2024-04-05T02:26:00.781556224Z 2024-04-05T02:26:00.781564757Z 2024-04-05T02:26:00.781569899Z 2024-04-05T02:26:00.781723177Z [2024-04-05T02:26:00.781+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:26:00.781966262Z [2024-04-05T02:26:00.781+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:26:00.782136211Z [2024-04-05T02:26:00.782+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:26:00.782291681Z [2024-04-05T02:26:00.782+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:26:00.782935411Z [2024-04-05T02:26:00.782+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:26:00.782948830Z 2024-04-05T02:26:00.782952924Z 2024-04-05T02:26:00.782956320Z 2024-04-05T02:26:00.782959563Z 2024-04-05T02:26:00.790761453Z [2024-04-05T02:26:00.790+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:24:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:26:00.793440523Z [2024-04-05T02:26:00.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:26:00.794579808Z [2024-04-05T02:26:00.794+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:26:00.795962452Z [2024-04-05T02:26:00.794+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:26:00.798953170Z [2024-04-05T02:26:00.798+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:26:00.799207918Z [2024-04-05T02:26:00.798+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:26:00.799516608Z [2024-04-05T02:26:00.799+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:26:00.800413835Z [2024-04-05T02:26:00.800+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:26:01.482048647Z [2024-04-05T02:26:01.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:24:00+00:00 exited with status queued for try_number 1 2024-04-05T02:26:01.482280955Z [2024-04-05T02:26:01.481+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status queued for try_number 1 2024-04-05T02:26:01.482575752Z [2024-04-05T02:26:01.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status queued for try_number 1 2024-04-05T02:26:01.482780998Z [2024-04-05T02:26:01.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status queued for try_number 1 2024-04-05T02:26:01.500743812Z [2024-04-05T02:26:01.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c156891-0304-417a-9598-63bb952b0080 2024-04-05T02:26:01.501084314Z [2024-04-05T02:26:01.500+0000] {scheduler_job.py:635} INFO - Setting external_id for to ab2fa6d9-048e-4e49-93a0-567145f3f5e1 2024-04-05T02:26:01.501418062Z [2024-04-05T02:26:01.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6b9dc34-f3a6-4f6f-ba5b-9c62e49f6871 2024-04-05T02:26:01.502139440Z [2024-04-05T02:26:01.501+0000] {scheduler_job.py:635} INFO - Setting external_id for to ae88354a-1778-412f-aa79-d38cf795d2f6 2024-04-05T02:26:03.836226083Z [2024-04-05T02:26:03.835+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:26:03.836683970Z [2024-04-05T02:26:03.836+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:24:00+00:00, run_id=scheduled__2024-04-05T02:24:00+00:00, run_start_date=2024-04-05 02:26:00.668006+00:00, run_end_date=2024-04-05 02:26:03.836137+00:00, run_duration=3.168131, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:24:00+00:00, data_interval_end=2024-04-05 02:26:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:26:03.850927327Z [2024-04-05T02:26:03.850+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:26:00+00:00, run_after=2024-04-05T02:28:00+00:00 2024-04-05T02:26:03.863027089Z [2024-04-05T02:26:03.862+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:26:03.863379172Z [2024-04-05T02:26:03.863+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:25:00+00:00, run_id=scheduled__2024-04-05T02:25:00+00:00, run_start_date=2024-04-05 02:26:00.670727+00:00, run_end_date=2024-04-05 02:26:03.862924+00:00, run_duration=3.192197, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:25:00+00:00, data_interval_end=2024-04-05 02:26:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:26:03.880236798Z [2024-04-05T02:26:03.879+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:26:00+00:00, run_after=2024-04-05T02:27:00+00:00 2024-04-05T02:26:03.964831904Z [2024-04-05T02:26:03.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:24:00+00:00 exited with status success for try_number 1 2024-04-05T02:26:03.964991837Z [2024-04-05T02:26:03.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status success for try_number 1 2024-04-05T02:26:03.977530545Z [2024-04-05T02:26:03.977+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:25:00+00:00, map_index=-1, run_start_date=2024-04-05 02:26:02.842279+00:00, run_end_date=2024-04-05 02:26:03.504675+00:00, run_duration=0.662396, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1050, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:26:00.783920+00:00, queued_by_job_id=1, pid=15374 2024-04-05T02:26:03.977662324Z [2024-04-05T02:26:03.977+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:24:00+00:00, map_index=-1, run_start_date=2024-04-05 02:26:03.104315+00:00, run_end_date=2024-04-05 02:26:03.636827+00:00, run_duration=0.532512, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1051, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:26:00.783920+00:00, queued_by_job_id=1, pid=15375 2024-04-05T02:26:07.246155958Z [2024-04-05T02:26:07.245+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:26:07.246846729Z [2024-04-05T02:26:07.246+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:25:00+00:00, run_id=scheduled__2024-04-05T02:25:00+00:00, run_start_date=2024-04-05 02:26:00.674506+00:00, run_end_date=2024-04-05 02:26:07.246440+00:00, run_duration=6.571934, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:25:00+00:00, data_interval_end=2024-04-05 02:26:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:26:07.255966359Z [2024-04-05T02:26:07.255+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:26:00+00:00, run_after=2024-04-05T02:27:00+00:00 2024-04-05T02:26:07.297478746Z [2024-04-05T02:26:07.297+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status success for try_number 1 2024-04-05T02:26:07.304199487Z [2024-04-05T02:26:07.303+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:25:00+00:00, map_index=-1, run_start_date=2024-04-05 02:26:04.206724+00:00, run_end_date=2024-04-05 02:26:06.294610+00:00, run_duration=2.087886, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1052, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:26:00.783920+00:00, queued_by_job_id=1, pid=15398 2024-04-05T02:26:08.346105538Z [2024-04-05T02:26:08.345+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:26:08.346708674Z [2024-04-05T02:26:08.346+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:25:00+00:00, run_id=scheduled__2024-04-05T02:25:00+00:00, run_start_date=2024-04-05 02:26:00.676624+00:00, run_end_date=2024-04-05 02:26:08.346248+00:00, run_duration=7.669624, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:25:00+00:00, data_interval_end=2024-04-05 02:26:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:26:08.372574138Z [2024-04-05T02:26:08.371+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:26:00+00:00, run_after=2024-04-05T02:27:00+00:00 2024-04-05T02:26:08.415272134Z [2024-04-05T02:26:08.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status success for try_number 1 2024-04-05T02:26:08.423324453Z [2024-04-05T02:26:08.422+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:25:00+00:00, map_index=-1, run_start_date=2024-04-05 02:26:04.382899+00:00, run_end_date=2024-04-05 02:26:07.662009+00:00, run_duration=3.27911, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1053, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:26:00.783920+00:00, queued_by_job_id=1, pid=15399 2024-04-05T02:27:00.996452084Z [2024-04-05T02:27:00.995+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:27:00+00:00, run_after=2024-04-05T02:28:00+00:00 2024-04-05T02:27:01.025732131Z [2024-04-05T02:27:01.025+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:27:00+00:00, run_after=2024-04-05T02:28:00+00:00 2024-04-05T02:27:01.036094558Z [2024-04-05T02:27:01.035+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:27:01.163151348Z [2024-04-05T02:27:01.162+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:27:01.163185314Z 2024-04-05T02:27:01.163190621Z 2024-04-05T02:27:01.163195803Z 2024-04-05T02:27:01.167680033Z [2024-04-05T02:27:01.163+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:27:01.167715942Z [2024-04-05T02:27:01.164+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:27:01.167738523Z [2024-04-05T02:27:01.164+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:27:01.167743449Z [2024-04-05T02:27:01.165+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:27:01.167747174Z 2024-04-05T02:27:01.167750531Z 2024-04-05T02:27:01.167753943Z 2024-04-05T02:27:01.179792324Z [2024-04-05T02:27:01.175+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:27:01.179817316Z [2024-04-05T02:27:01.176+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:27:01.187657894Z [2024-04-05T02:27:01.183+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:27:01.187685406Z [2024-04-05T02:27:01.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:27:01.187689278Z [2024-04-05T02:27:01.184+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:27:01.187692915Z [2024-04-05T02:27:01.184+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:27:01.894170594Z [2024-04-05T02:27:01.893+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:26:00+00:00 exited with status queued for try_number 1 2024-04-05T02:27:01.894606450Z [2024-04-05T02:27:01.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:26:00+00:00 exited with status queued for try_number 1 2024-04-05T02:27:01.894850661Z [2024-04-05T02:27:01.894+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:26:00+00:00 exited with status queued for try_number 1 2024-04-05T02:27:01.908271203Z [2024-04-05T02:27:01.907+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84610b2a-e68f-4d57-b08f-1484c8386723 2024-04-05T02:27:01.908793325Z [2024-04-05T02:27:01.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7a7d0d19-899d-4098-933c-f17d0749cb80 2024-04-05T02:27:01.909109293Z [2024-04-05T02:27:01.908+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5116cac3-0597-406c-ab67-60cb3f720626 2024-04-05T02:27:04.207396428Z [2024-04-05T02:27:04.206+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:27:04.207845414Z [2024-04-05T02:27:04.207+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:26:00+00:00, run_id=scheduled__2024-04-05T02:26:00+00:00, run_start_date=2024-04-05 02:27:01.060153+00:00, run_end_date=2024-04-05 02:27:04.207335+00:00, run_duration=3.147182, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:26:00+00:00, data_interval_end=2024-04-05 02:27:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:27:04.219752376Z [2024-04-05T02:27:04.219+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:27:00+00:00, run_after=2024-04-05T02:28:00+00:00 2024-04-05T02:27:04.284312630Z [2024-04-05T02:27:04.283+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:26:00+00:00 exited with status success for try_number 1 2024-04-05T02:27:04.291653284Z [2024-04-05T02:27:04.291+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:26:00+00:00, map_index=-1, run_start_date=2024-04-05 02:27:02.402320+00:00, run_end_date=2024-04-05 02:27:03.081655+00:00, run_duration=0.679335, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1054, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:27:01.166548+00:00, queued_by_job_id=1, pid=15431 2024-04-05T02:27:07.072432905Z [2024-04-05T02:27:07.071+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:27:07.072712775Z [2024-04-05T02:27:07.072+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:26:00+00:00, run_id=scheduled__2024-04-05T02:26:00+00:00, run_start_date=2024-04-05 02:27:01.062300+00:00, run_end_date=2024-04-05 02:27:07.072308+00:00, run_duration=6.010008, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:26:00+00:00, data_interval_end=2024-04-05 02:27:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:27:07.089273506Z [2024-04-05T02:27:07.088+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:27:00+00:00, run_after=2024-04-05T02:28:00+00:00 2024-04-05T02:27:07.098391676Z [2024-04-05T02:27:07.097+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:27:07.098768180Z [2024-04-05T02:27:07.098+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:26:00+00:00, run_id=scheduled__2024-04-05T02:26:00+00:00, run_start_date=2024-04-05 02:27:01.063862+00:00, run_end_date=2024-04-05 02:27:07.098263+00:00, run_duration=6.034401, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:26:00+00:00, data_interval_end=2024-04-05 02:27:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:27:07.111688523Z [2024-04-05T02:27:07.111+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:27:00+00:00, run_after=2024-04-05T02:28:00+00:00 2024-04-05T02:27:07.148757450Z [2024-04-05T02:27:07.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:26:00+00:00 exited with status success for try_number 1 2024-04-05T02:27:07.149137278Z [2024-04-05T02:27:07.148+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:26:00+00:00 exited with status success for try_number 1 2024-04-05T02:27:07.156479458Z [2024-04-05T02:27:07.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:26:00+00:00, map_index=-1, run_start_date=2024-04-05 02:27:03.865389+00:00, run_end_date=2024-04-05 02:27:06.666596+00:00, run_duration=2.801207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1056, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:27:01.166548+00:00, queued_by_job_id=1, pid=15450 2024-04-05T02:27:07.156905129Z [2024-04-05T02:27:07.156+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:26:00+00:00, map_index=-1, run_start_date=2024-04-05 02:27:03.733763+00:00, run_end_date=2024-04-05 02:27:06.828538+00:00, run_duration=3.094775, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1055, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:27:01.166548+00:00, queued_by_job_id=1, pid=15449 2024-04-05T02:28:00.266095952Z [2024-04-05T02:28:00.265+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:28:00.275828865Z [2024-04-05T02:28:00.275+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:28:00.290048365Z [2024-04-05T02:28:00.289+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:28:00+00:00, run_after=2024-04-05T02:29:00+00:00 2024-04-05T02:28:00.304468194Z [2024-04-05T02:28:00.304+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:28:00+00:00, run_after=2024-04-05T02:29:00+00:00 2024-04-05T02:28:00.405035135Z [2024-04-05T02:28:00.404+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:28:00.405058718Z 2024-04-05T02:28:00.405079864Z 2024-04-05T02:28:00.405083224Z 2024-04-05T02:28:00.405086223Z 2024-04-05T02:28:00.405342423Z [2024-04-05T02:28:00.405+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:28:00.405571581Z [2024-04-05T02:28:00.405+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:28:00.405736183Z [2024-04-05T02:28:00.405+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:28:00.405910570Z [2024-04-05T02:28:00.405+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:28:00.407983085Z [2024-04-05T02:28:00.407+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:28:00.408018664Z 2024-04-05T02:28:00.408022742Z 2024-04-05T02:28:00.408026201Z 2024-04-05T02:28:00.408029617Z 2024-04-05T02:28:00.424874726Z [2024-04-05T02:28:00.424+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:26:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:28:00.425231106Z [2024-04-05T02:28:00.424+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:28:00.425556224Z [2024-04-05T02:28:00.425+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:28:00.425731137Z [2024-04-05T02:28:00.425+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:28:00.426020497Z [2024-04-05T02:28:00.425+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:28:00.426326945Z [2024-04-05T02:28:00.426+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:28:00.426594723Z [2024-04-05T02:28:00.426+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:27:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:28:00.426764969Z [2024-04-05T02:28:00.426+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:28:01.088071544Z [2024-04-05T02:28:01.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:26:00+00:00 exited with status queued for try_number 1 2024-04-05T02:28:01.088349247Z [2024-04-05T02:28:01.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:27:00+00:00 exited with status queued for try_number 1 2024-04-05T02:28:01.088489165Z [2024-04-05T02:28:01.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:27:00+00:00 exited with status queued for try_number 1 2024-04-05T02:28:01.088599986Z [2024-04-05T02:28:01.088+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:27:00+00:00 exited with status queued for try_number 1 2024-04-05T02:28:01.129555632Z [2024-04-05T02:28:01.129+0000] {scheduler_job.py:635} INFO - Setting external_id for to b8b1351a-ce18-4b2c-a8ac-6440e699c3cf 2024-04-05T02:28:01.129794491Z [2024-04-05T02:28:01.129+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4fea9506-2dd7-4952-bb4f-b773e08f856b 2024-04-05T02:28:01.130003089Z [2024-04-05T02:28:01.129+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1621f476-8c96-4058-99be-c5deb3b58780 2024-04-05T02:28:01.130203445Z [2024-04-05T02:28:01.130+0000] {scheduler_job.py:635} INFO - Setting external_id for to fec6ad39-1ba6-497a-bbf0-3cbf7f8c878f 2024-04-05T02:28:02.945563299Z [2024-04-05T02:28:02.943+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:28:02.945591640Z 2024-04-05T02:28:02.945927234Z [2024-04-05T02:28:02.945+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-05T02:28:02.946701568Z [2024-04-05T02:28:02.946+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:28:02.946714541Z 2024-04-05T02:28:02.950612224Z [2024-04-05T02:28:02.950+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240405022801_296837', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:28:02.952432032Z [2024-04-05T02:28:02.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240405022801_296837', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-05T02:28:03.121961308Z [2024-04-05T02:28:03.118+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240405022801_296837 exited with status queued for try_number 1 2024-04-05T02:28:03.129314935Z [2024-04-05T02:28:03.128+0000] {scheduler_job.py:635} INFO - Setting external_id for to bc092c81-a609-4789-b470-25cdc743859d 2024-04-05T02:28:04.506302240Z [2024-04-05T02:28:04.505+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:28:04.506439173Z [2024-04-05T02:28:04.506+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:26:00+00:00, run_id=scheduled__2024-04-05T02:26:00+00:00, run_start_date=2024-04-05 02:28:00.321444+00:00, run_end_date=2024-04-05 02:28:04.506161+00:00, run_duration=4.184717, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:26:00+00:00, data_interval_end=2024-04-05 02:28:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:28:04.514593280Z [2024-04-05T02:28:04.514+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:28:00+00:00, run_after=2024-04-05T02:30:00+00:00 2024-04-05T02:28:04.523672870Z [2024-04-05T02:28:04.523+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:28:04.523744161Z [2024-04-05T02:28:04.523+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:27:00+00:00, run_id=scheduled__2024-04-05T02:27:00+00:00, run_start_date=2024-04-05 02:28:00.322969+00:00, run_end_date=2024-04-05 02:28:04.523486+00:00, run_duration=4.200517, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:27:00+00:00, data_interval_end=2024-04-05 02:28:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:28:04.536837652Z [2024-04-05T02:28:04.536+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:28:00+00:00, run_after=2024-04-05T02:29:00+00:00 2024-04-05T02:28:04.602681525Z [2024-04-05T02:28:04.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:26:00+00:00 exited with status success for try_number 1 2024-04-05T02:28:04.607187145Z [2024-04-05T02:28:04.606+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:27:00+00:00 exited with status success for try_number 1 2024-04-05T02:28:04.623063132Z [2024-04-05T02:28:04.622+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:27:00+00:00, map_index=-1, run_start_date=2024-04-05 02:28:02.549146+00:00, run_end_date=2024-04-05 02:28:03.255131+00:00, run_duration=0.705985, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1057, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:28:00.409051+00:00, queued_by_job_id=1, pid=15483 2024-04-05T02:28:04.623211107Z [2024-04-05T02:28:04.623+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:26:00+00:00, map_index=-1, run_start_date=2024-04-05 02:28:02.762741+00:00, run_end_date=2024-04-05 02:28:03.387785+00:00, run_duration=0.625044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1058, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:28:00.409051+00:00, queued_by_job_id=1, pid=15484 2024-04-05T02:28:05.665151144Z [2024-04-05T02:28:05.664+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:28:05.665657456Z [2024-04-05T02:28:05.665+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-05 02:28:02.374035+00:00, run_id=scaleout_vdu_20240405022801_296837, run_start_date=2024-04-05 02:28:02.801544+00:00, run_end_date=2024-04-05 02:28:05.665307+00:00, run_duration=2.863763, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-05 02:28:02.374035+00:00, data_interval_end=2024-04-05 02:28:02.374035+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-05T02:28:05.670187179Z [2024-04-05T02:28:05.669+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-05T02:28:05.722367075Z [2024-04-05T02:28:05.721+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240405022801_296837 exited with status success for try_number 1 2024-04-05T02:28:05.728127336Z [2024-04-05T02:28:05.727+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240405022801_296837, map_index=-1, run_start_date=2024-04-05 02:28:04.202099+00:00, run_end_date=2024-04-05 02:28:04.612664+00:00, run_duration=0.410565, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1059, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:28:02.947389+00:00, queued_by_job_id=1, pid=15497 2024-04-05T02:28:06.585612461Z [2024-04-05T02:28:06.585+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:28:06.585911583Z [2024-04-05T02:28:06.585+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:27:00+00:00, run_id=scheduled__2024-04-05T02:27:00+00:00, run_start_date=2024-04-05 02:28:00.324507+00:00, run_end_date=2024-04-05 02:28:06.585577+00:00, run_duration=6.26107, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:27:00+00:00, data_interval_end=2024-04-05 02:28:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:28:06.595466835Z [2024-04-05T02:28:06.595+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:28:00+00:00, run_after=2024-04-05T02:29:00+00:00 2024-04-05T02:28:07.676124011Z [2024-04-05T02:28:07.675+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:28:07.676477824Z [2024-04-05T02:28:07.676+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:27:00+00:00, run_id=scheduled__2024-04-05T02:27:00+00:00, run_start_date=2024-04-05 02:28:00.325978+00:00, run_end_date=2024-04-05 02:28:07.676012+00:00, run_duration=7.350034, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:27:00+00:00, data_interval_end=2024-04-05 02:28:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:28:07.686126640Z [2024-04-05T02:28:07.685+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:28:00+00:00, run_after=2024-04-05T02:29:00+00:00 2024-04-05T02:28:07.716583153Z [2024-04-05T02:28:07.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:27:00+00:00 exited with status success for try_number 1 2024-04-05T02:28:07.716803280Z [2024-04-05T02:28:07.716+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:27:00+00:00 exited with status success for try_number 1 2024-04-05T02:28:07.725732579Z [2024-04-05T02:28:07.725+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:27:00+00:00, map_index=-1, run_start_date=2024-04-05 02:28:05.081609+00:00, run_end_date=2024-04-05 02:28:06.489208+00:00, run_duration=1.407599, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1061, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:28:00.409051+00:00, queued_by_job_id=1, pid=15520 2024-04-05T02:28:07.726053543Z [2024-04-05T02:28:07.725+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:27:00+00:00, map_index=-1, run_start_date=2024-04-05 02:28:04.637921+00:00, run_end_date=2024-04-05 02:28:06.491366+00:00, run_duration=1.853445, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1060, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:28:00.409051+00:00, queued_by_job_id=1, pid=15509 2024-04-05T02:29:00.426836911Z [2024-04-05T02:29:00.426+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:29:00.447129337Z [2024-04-05T02:29:00.446+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:29:00+00:00, run_after=2024-04-05T02:30:00+00:00 2024-04-05T02:29:00.483595400Z [2024-04-05T02:29:00.483+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:29:00+00:00, run_after=2024-04-05T02:30:00+00:00 2024-04-05T02:29:00.557127586Z [2024-04-05T02:29:00.556+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:29:00.557157483Z 2024-04-05T02:29:00.557161194Z 2024-04-05T02:29:00.557164848Z 2024-04-05T02:29:00.557433114Z [2024-04-05T02:29:00.557+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:29:00.557673636Z [2024-04-05T02:29:00.557+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:29:00.557858266Z [2024-04-05T02:29:00.557+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:29:00.558417808Z [2024-04-05T02:29:00.558+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:29:00.558429759Z 2024-04-05T02:29:00.558433238Z 2024-04-05T02:29:00.558436583Z 2024-04-05T02:29:00.561722139Z [2024-04-05T02:29:00.561+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:29:00.561872099Z [2024-04-05T02:29:00.561+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:29:00.562151165Z [2024-04-05T02:29:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:29:00.562320826Z [2024-04-05T02:29:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:29:00.562545360Z [2024-04-05T02:29:00.562+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:29:00.562794903Z [2024-04-05T02:29:00.562+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:29:01.033433723Z [2024-04-05T02:29:01.029+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:28:00+00:00 exited with status queued for try_number 1 2024-04-05T02:29:01.035204337Z [2024-04-05T02:29:01.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:28:00+00:00 exited with status queued for try_number 1 2024-04-05T02:29:01.035375368Z [2024-04-05T02:29:01.035+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:28:00+00:00 exited with status queued for try_number 1 2024-04-05T02:29:01.063973753Z [2024-04-05T02:29:01.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fd4a6d2-59ff-4798-834f-b767dc1ca5b0 2024-04-05T02:29:01.068786027Z [2024-04-05T02:29:01.063+0000] {scheduler_job.py:635} INFO - Setting external_id for to afb06798-42d3-4896-968c-bdb367bd6445 2024-04-05T02:29:01.070133383Z [2024-04-05T02:29:01.069+0000] {scheduler_job.py:635} INFO - Setting external_id for to bd6b78ef-2228-451e-b968-83d7104e1a74 2024-04-05T02:29:03.494640285Z [2024-04-05T02:29:03.494+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:29:03.495267274Z [2024-04-05T02:29:03.494+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:28:00+00:00, run_id=scheduled__2024-04-05T02:28:00+00:00, run_start_date=2024-04-05 02:29:00.497652+00:00, run_end_date=2024-04-05 02:29:03.494622+00:00, run_duration=2.99697, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:28:00+00:00, data_interval_end=2024-04-05 02:29:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:29:03.513752207Z [2024-04-05T02:29:03.513+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:29:00+00:00, run_after=2024-04-05T02:30:00+00:00 2024-04-05T02:29:03.596825793Z [2024-04-05T02:29:03.596+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:28:00+00:00 exited with status success for try_number 1 2024-04-05T02:29:03.606580620Z [2024-04-05T02:29:03.605+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:28:00+00:00, map_index=-1, run_start_date=2024-04-05 02:29:02.001519+00:00, run_end_date=2024-04-05 02:29:02.560033+00:00, run_duration=0.558514, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1062, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:29:00.559249+00:00, queued_by_job_id=1, pid=15547 2024-04-05T02:29:05.783005934Z [2024-04-05T02:29:05.782+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:29:05.783485805Z [2024-04-05T02:29:05.783+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:28:00+00:00, run_id=scheduled__2024-04-05T02:28:00+00:00, run_start_date=2024-04-05 02:29:00.499669+00:00, run_end_date=2024-04-05 02:29:05.782944+00:00, run_duration=5.283275, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:28:00+00:00, data_interval_end=2024-04-05 02:29:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:29:05.803979360Z [2024-04-05T02:29:05.803+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:29:00+00:00, run_after=2024-04-05T02:30:00+00:00 2024-04-05T02:29:05.870177039Z [2024-04-05T02:29:05.869+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:28:00+00:00 exited with status success for try_number 1 2024-04-05T02:29:05.881330993Z [2024-04-05T02:29:05.880+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:28:00+00:00, map_index=-1, run_start_date=2024-04-05 02:29:03.679479+00:00, run_end_date=2024-04-05 02:29:05.401694+00:00, run_duration=1.722215, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1064, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:29:00.559249+00:00, queued_by_job_id=1, pid=15566 2024-04-05T02:29:06.937010262Z [2024-04-05T02:29:06.936+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:29:06.937407394Z [2024-04-05T02:29:06.937+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:28:00+00:00, run_id=scheduled__2024-04-05T02:28:00+00:00, run_start_date=2024-04-05 02:29:00.501311+00:00, run_end_date=2024-04-05 02:29:06.936878+00:00, run_duration=6.435567, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:28:00+00:00, data_interval_end=2024-04-05 02:29:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:29:06.953193411Z [2024-04-05T02:29:06.952+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:29:00+00:00, run_after=2024-04-05T02:30:00+00:00 2024-04-05T02:29:06.992904310Z [2024-04-05T02:29:06.992+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:28:00+00:00 exited with status success for try_number 1 2024-04-05T02:29:06.999995186Z [2024-04-05T02:29:06.999+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:28:00+00:00, map_index=-1, run_start_date=2024-04-05 02:29:03.453000+00:00, run_end_date=2024-04-05 02:29:06.292718+00:00, run_duration=2.839718, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1063, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:29:00.559249+00:00, queued_by_job_id=1, pid=15565 2024-04-05T02:30:00.417865460Z [2024-04-05T02:30:00.417+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:30:00.431270215Z [2024-04-05T02:30:00.430+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:30:00+00:00, run_after=2024-04-05T02:31:00+00:00 2024-04-05T02:30:00.443488507Z [2024-04-05T02:30:00.443+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:30:00+00:00, run_after=2024-04-05T02:31:00+00:00 2024-04-05T02:30:00.449655542Z [2024-04-05T02:30:00.449+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:30:00.462134769Z [2024-04-05T02:30:00.461+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:30:00+00:00, run_after=2024-04-05T02:35:00+00:00 2024-04-05T02:30:00.580703250Z [2024-04-05T02:30:00.580+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T02:30:00.580729445Z 2024-04-05T02:30:00.580733075Z 2024-04-05T02:30:00.580741470Z 2024-04-05T02:30:00.580744871Z 2024-04-05T02:30:00.580748075Z 2024-04-05T02:30:00.580764872Z [2024-04-05T02:30:00.580+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:30:00.580955158Z [2024-04-05T02:30:00.580+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:30:00.581064250Z [2024-04-05T02:30:00.580+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:30:00.582105584Z [2024-04-05T02:30:00.581+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:30:00.582156111Z [2024-04-05T02:30:00.582+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:30:00.582844690Z [2024-04-05T02:30:00.582+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:30:00.582855829Z 2024-04-05T02:30:00.582860141Z 2024-04-05T02:30:00.582864085Z 2024-04-05T02:30:00.582867554Z 2024-04-05T02:30:00.582870751Z 2024-04-05T02:30:00.587623043Z [2024-04-05T02:30:00.587+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:30:00.587780674Z [2024-04-05T02:30:00.587+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:30:00.588088684Z [2024-04-05T02:30:00.587+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:28:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:30:00.588199845Z [2024-04-05T02:30:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:30:00.588518646Z [2024-04-05T02:30:00.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:30:00.588614204Z [2024-04-05T02:30:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:30:00.588765938Z [2024-04-05T02:30:00.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:30:00.588833798Z [2024-04-05T02:30:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:30:00.589034568Z [2024-04-05T02:30:00.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:29:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:30:00.589157403Z [2024-04-05T02:30:00.589+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:30:01.120237730Z [2024-04-05T02:30:01.119+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status queued for try_number 1 2024-04-05T02:30:01.122758819Z [2024-04-05T02:30:01.120+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:28:00+00:00 exited with status queued for try_number 1 2024-04-05T02:30:01.122849512Z [2024-04-05T02:30:01.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:29:00+00:00 exited with status queued for try_number 1 2024-04-05T02:30:01.123171149Z [2024-04-05T02:30:01.122+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:29:00+00:00 exited with status queued for try_number 1 2024-04-05T02:30:01.123372792Z [2024-04-05T02:30:01.123+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:29:00+00:00 exited with status queued for try_number 1 2024-04-05T02:30:01.147469250Z [2024-04-05T02:30:01.145+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50946469-47e4-4ddf-8348-4f34da3e5964 2024-04-05T02:30:01.148416585Z [2024-04-05T02:30:01.147+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6946bb9b-2ca5-49be-9ed1-d0b53cedeacd 2024-04-05T02:30:01.148888842Z [2024-04-05T02:30:01.148+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5d678493-2dce-463d-9603-47fb4efa4039 2024-04-05T02:30:01.149037254Z [2024-04-05T02:30:01.148+0000] {scheduler_job.py:635} INFO - Setting external_id for to a93783de-1477-4b75-a96a-ebd6fdf238d1 2024-04-05T02:30:01.149158471Z [2024-04-05T02:30:01.149+0000] {scheduler_job.py:635} INFO - Setting external_id for to d050f3e4-0d96-44a9-9164-1cb100eadbe9 2024-04-05T02:30:02.567081193Z [2024-04-05T02:30:02.566+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:30:02.567109617Z 2024-04-05T02:30:02.567398752Z [2024-04-05T02:30:02.567+0000] {scheduler_job.py:425} INFO - DAG scaleout_vdu has 0/16 running and queued tasks 2024-04-05T02:30:02.569405730Z [2024-04-05T02:30:02.568+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:30:02.569426494Z 2024-04-05T02:30:02.583207787Z [2024-04-05T02:30:02.582+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='scaleout_vdu', task_id='main_task', run_id='scaleout_vdu_20240405023001_274164', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:30:02.583709297Z [2024-04-05T02:30:02.583+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240405023001_274164', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-05T02:30:02.732967859Z [2024-04-05T02:30:02.732+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240405023001_274164 exited with status queued for try_number 1 2024-04-05T02:30:02.749269999Z [2024-04-05T02:30:02.748+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1d5fb539-285f-46d3-9d4d-ecad47f3c832 2024-04-05T02:30:03.412551390Z [2024-04-05T02:30:03.412+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:30:03.412724535Z [2024-04-05T02:30:03.412+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:29:00+00:00, run_id=scheduled__2024-04-05T02:29:00+00:00, run_start_date=2024-04-05 02:30:00.485624+00:00, run_end_date=2024-04-05 02:30:03.412439+00:00, run_duration=2.926815, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:29:00+00:00, data_interval_end=2024-04-05 02:30:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:30:03.425458565Z [2024-04-05T02:30:03.425+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:30:00+00:00, run_after=2024-04-05T02:31:00+00:00 2024-04-05T02:30:03.667461034Z [2024-04-05T02:30:03.667+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:29:00+00:00 exited with status success for try_number 1 2024-04-05T02:30:03.675925500Z [2024-04-05T02:30:03.675+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:29:00+00:00, map_index=-1, run_start_date=2024-04-05 02:30:02.494311+00:00, run_end_date=2024-04-05 02:30:03.264751+00:00, run_duration=0.77044, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1065, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:30:00.584224+00:00, queued_by_job_id=1, pid=15599 2024-04-05T02:30:03.900444399Z [2024-04-05T02:30:03.899+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:30:03.902931707Z [2024-04-05T02:30:03.902+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:28:00+00:00, run_id=scheduled__2024-04-05T02:28:00+00:00, run_start_date=2024-04-05 02:30:00.483331+00:00, run_end_date=2024-04-05 02:30:03.902291+00:00, run_duration=3.41896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:28:00+00:00, data_interval_end=2024-04-05 02:30:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:30:03.927257120Z [2024-04-05T02:30:03.926+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:30:00+00:00, run_after=2024-04-05T02:32:00+00:00 2024-04-05T02:30:04.093106353Z [2024-04-05T02:30:04.091+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:28:00+00:00 exited with status success for try_number 1 2024-04-05T02:30:04.110752201Z [2024-04-05T02:30:04.109+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:28:00+00:00, map_index=-1, run_start_date=2024-04-05 02:30:02.571862+00:00, run_end_date=2024-04-05 02:30:03.589254+00:00, run_duration=1.017392, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1066, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:30:00.584224+00:00, queued_by_job_id=1, pid=15601 2024-04-05T02:30:05.200303885Z [2024-04-05T02:30:05.199+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:30:05.200651058Z [2024-04-05T02:30:05.200+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=scaleout_vdu, execution_date=2024-04-05 02:30:01.821467+00:00, run_id=scaleout_vdu_20240405023001_274164, run_start_date=2024-04-05 02:30:02.348114+00:00, run_end_date=2024-04-05 02:30:05.200296+00:00, run_duration=2.852182, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-05 02:30:01.821467+00:00, data_interval_end=2024-04-05 02:30:01.821467+00:00, dag_hash=fe9051a2be22a71df9995650740fbd7e 2024-04-05T02:30:05.204732563Z [2024-04-05T02:30:05.204+0000] {dag.py:3452} INFO - Setting next_dagrun for scaleout_vdu to None, run_after=None 2024-04-05T02:30:05.300167140Z [2024-04-05T02:30:05.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of scaleout_vdu.main_task run_id=scaleout_vdu_20240405023001_274164 exited with status success for try_number 1 2024-04-05T02:30:05.310389033Z [2024-04-05T02:30:05.309+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=scaleout_vdu, task_id=main_task, run_id=scaleout_vdu_20240405023001_274164, map_index=-1, run_start_date=2024-04-05 02:30:03.876304+00:00, run_end_date=2024-04-05 02:30:04.534611+00:00, run_duration=0.658307, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1067, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:30:02.572551+00:00, queued_by_job_id=1, pid=15614 2024-04-05T02:30:06.500202244Z [2024-04-05T02:30:06.499+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:30:06.500225287Z 2024-04-05T02:30:06.500371558Z [2024-04-05T02:30:06.500+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:30:06.502138801Z [2024-04-05T02:30:06.501+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:30:06.502164317Z 2024-04-05T02:30:06.505442201Z [2024-04-05T02:30:06.505+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:30:06.505585502Z [2024-04-05T02:30:06.505+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:30:06.585466457Z [2024-04-05T02:30:06.584+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status queued for try_number 1 2024-04-05T02:30:06.588184144Z [2024-04-05T02:30:06.587+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status success for try_number 1 2024-04-05T02:30:06.599172265Z [2024-04-05T02:30:06.598+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62fb5bf4-c75f-4322-99f9-b99a634e14ab 2024-04-05T02:30:06.599755727Z [2024-04-05T02:30:06.599+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:25:00+00:00, map_index=-1, run_start_date=2024-04-05 02:30:04.722860+00:00, run_end_date=2024-04-05 02:30:05.251097+00:00, run_duration=0.528237, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1069, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:30:00.584224+00:00, queued_by_job_id=1, pid=15632 2024-04-05T02:30:06.662138603Z [2024-04-05T02:30:06.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:30:06.662839990Z [2024-04-05T02:30:06.662+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:29:00+00:00, run_id=scheduled__2024-04-05T02:29:00+00:00, run_start_date=2024-04-05 02:30:00.492454+00:00, run_end_date=2024-04-05 02:30:06.662300+00:00, run_duration=6.169846, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:29:00+00:00, data_interval_end=2024-04-05 02:30:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:30:06.680444641Z [2024-04-05T02:30:06.679+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:30:00+00:00, run_after=2024-04-05T02:31:00+00:00 2024-04-05T02:30:06.766806376Z [2024-04-05T02:30:06.766+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:29:00+00:00 exited with status success for try_number 1 2024-04-05T02:30:06.786358872Z [2024-04-05T02:30:06.785+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:29:00+00:00, map_index=-1, run_start_date=2024-04-05 02:30:04.468398+00:00, run_end_date=2024-04-05 02:30:06.437856+00:00, run_duration=1.969458, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1068, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:30:00.584224+00:00, queued_by_job_id=1, pid=15631 2024-04-05T02:30:07.839633520Z [2024-04-05T02:30:07.839+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:30:07.840204670Z [2024-04-05T02:30:07.839+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:29:00+00:00, run_id=scheduled__2024-04-05T02:29:00+00:00, run_start_date=2024-04-05 02:30:00.489208+00:00, run_end_date=2024-04-05 02:30:07.839724+00:00, run_duration=7.350516, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:29:00+00:00, data_interval_end=2024-04-05 02:30:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:30:07.855020791Z [2024-04-05T02:30:07.854+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:30:00+00:00, run_after=2024-04-05T02:31:00+00:00 2024-04-05T02:30:07.917250138Z [2024-04-05T02:30:07.914+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:29:00+00:00 exited with status success for try_number 1 2024-04-05T02:30:07.927713986Z [2024-04-05T02:30:07.927+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:29:00+00:00, map_index=-1, run_start_date=2024-04-05 02:30:05.196108+00:00, run_end_date=2024-04-05 02:30:06.680238+00:00, run_duration=1.48413, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1070, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:30:00.584224+00:00, queued_by_job_id=1, pid=15648 2024-04-05T02:30:09.922851970Z [2024-04-05T02:30:09.922+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:30:09.922880156Z 2024-04-05T02:30:09.923395422Z [2024-04-05T02:30:09.923+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:30:09.924513563Z [2024-04-05T02:30:09.924+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:30:09.924546180Z 2024-04-05T02:30:09.928472870Z [2024-04-05T02:30:09.928+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:25:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:30:09.928873994Z [2024-04-05T02:30:09.928+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:30:10.013079020Z [2024-04-05T02:30:10.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status queued for try_number 1 2024-04-05T02:30:10.013408211Z [2024-04-05T02:30:10.012+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status success for try_number 1 2024-04-05T02:30:10.023265916Z [2024-04-05T02:30:10.022+0000] {scheduler_job.py:635} INFO - Setting external_id for to f141a565-bac6-4cf7-bbd5-f70d9b610204 2024-04-05T02:30:10.024402591Z [2024-04-05T02:30:10.024+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T02:25:00+00:00, map_index=-1, run_start_date=2024-04-05 02:30:08.376007+00:00, run_end_date=2024-04-05 02:30:08.808181+00:00, run_duration=0.432174, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1071, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:30:06.502556+00:00, queued_by_job_id=1, pid=15661 2024-04-05T02:30:13.871796859Z [2024-04-05T02:30:13.871+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:30:13.871835147Z 2024-04-05T02:30:13.871841048Z [2024-04-05T02:30:13.871+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:30:13.872426873Z [2024-04-05T02:30:13.872+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:30:13.872448982Z 2024-04-05T02:30:13.874798050Z [2024-04-05T02:30:13.874+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:25:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:30:13.874968594Z [2024-04-05T02:30:13.874+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:30:13.930750415Z [2024-04-05T02:30:13.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status queued for try_number 1 2024-04-05T02:30:13.930990604Z [2024-04-05T02:30:13.930+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status success for try_number 1 2024-04-05T02:30:13.937024358Z [2024-04-05T02:30:13.936+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0b7ae32a-001c-4845-8b9f-05d23abb17cc 2024-04-05T02:30:13.937144809Z [2024-04-05T02:30:13.936+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:25:00+00:00, map_index=0, run_start_date=2024-04-05 02:30:12.258685+00:00, run_end_date=2024-04-05 02:30:13.492357+00:00, run_duration=1.233672, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1072, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:30:09.925324+00:00, queued_by_job_id=1, pid=15681 2024-04-05T02:30:16.187455509Z [2024-04-05T02:30:16.186+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:30:16.188573989Z [2024-04-05T02:30:16.188+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:25:00+00:00, run_id=scheduled__2024-04-05T02:25:00+00:00, run_start_date=2024-04-05 02:30:00.481494+00:00, run_end_date=2024-04-05 02:30:16.187429+00:00, run_duration=15.705935, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:25:00+00:00, data_interval_end=2024-04-05 02:30:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T02:30:16.210106822Z [2024-04-05T02:30:16.204+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:30:00+00:00, run_after=2024-04-05T02:35:00+00:00 2024-04-05T02:30:16.294953349Z [2024-04-05T02:30:16.293+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:25:00+00:00 exited with status success for try_number 1 2024-04-05T02:30:16.302741161Z [2024-04-05T02:30:16.301+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:25:00+00:00, map_index=-1, run_start_date=2024-04-05 02:30:15.543333+00:00, run_end_date=2024-04-05 02:30:15.938720+00:00, run_duration=0.395387, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1073, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:30:13.872803+00:00, queued_by_job_id=1, pid=15694 2024-04-05T02:30:42.061559691Z [2024-04-05T02:30:42.061+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:31:00.551818873Z [2024-04-05T02:31:00.550+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:31:00+00:00, run_after=2024-04-05T02:32:00+00:00 2024-04-05T02:31:00.572196266Z [2024-04-05T02:31:00.571+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:31:00+00:00, run_after=2024-04-05T02:32:00+00:00 2024-04-05T02:31:00.581152319Z [2024-04-05T02:31:00.580+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:31:00.666478146Z [2024-04-05T02:31:00.666+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:31:00.666502490Z 2024-04-05T02:31:00.666506157Z 2024-04-05T02:31:00.666509361Z 2024-04-05T02:31:00.666711408Z [2024-04-05T02:31:00.666+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:31:00.666980084Z [2024-04-05T02:31:00.666+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:31:00.667233935Z [2024-04-05T02:31:00.667+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:31:00.668337244Z [2024-04-05T02:31:00.668+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:31:00.668347741Z 2024-04-05T02:31:00.668351158Z 2024-04-05T02:31:00.668354456Z 2024-04-05T02:31:00.673515527Z [2024-04-05T02:31:00.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:31:00.673718607Z [2024-04-05T02:31:00.673+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:31:00.674189461Z [2024-04-05T02:31:00.673+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:31:00.674465941Z [2024-04-05T02:31:00.674+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:31:00.674810667Z [2024-04-05T02:31:00.674+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:31:00.674994445Z [2024-04-05T02:31:00.674+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:31:01.065620571Z [2024-04-05T02:31:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status queued for try_number 1 2024-04-05T02:31:01.065678080Z [2024-04-05T02:31:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status queued for try_number 1 2024-04-05T02:31:01.065858136Z [2024-04-05T02:31:01.065+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status queued for try_number 1 2024-04-05T02:31:01.084029617Z [2024-04-05T02:31:01.083+0000] {scheduler_job.py:635} INFO - Setting external_id for to da5023d2-5435-457a-be24-e7b93ced58dd 2024-04-05T02:31:01.084248294Z [2024-04-05T02:31:01.084+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1053f5ac-b81e-47ae-ba50-3e921991500b 2024-04-05T02:31:01.084414006Z [2024-04-05T02:31:01.084+0000] {scheduler_job.py:635} INFO - Setting external_id for to ea4224cc-600b-4596-ba0c-a668138e9da0 2024-04-05T02:31:03.162594460Z [2024-04-05T02:31:03.162+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:31:03.163674994Z [2024-04-05T02:31:03.163+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:30:00+00:00, run_id=scheduled__2024-04-05T02:30:00+00:00, run_start_date=2024-04-05 02:31:00.592160+00:00, run_end_date=2024-04-05 02:31:03.163196+00:00, run_duration=2.571036, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:30:00+00:00, data_interval_end=2024-04-05 02:31:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:31:03.175080062Z [2024-04-05T02:31:03.174+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:31:00+00:00, run_after=2024-04-05T02:32:00+00:00 2024-04-05T02:31:03.278773125Z [2024-04-05T02:31:03.278+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status success for try_number 1 2024-04-05T02:31:03.288213935Z [2024-04-05T02:31:03.287+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:30:00+00:00, map_index=-1, run_start_date=2024-04-05 02:31:01.996181+00:00, run_end_date=2024-04-05 02:31:02.521824+00:00, run_duration=0.525643, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1074, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:31:00.669615+00:00, queued_by_job_id=1, pid=15703 2024-04-05T02:31:06.745621973Z [2024-04-05T02:31:06.745+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:31:06.746000000Z [2024-04-05T02:31:06.745+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:30:00+00:00, run_id=scheduled__2024-04-05T02:30:00+00:00, run_start_date=2024-04-05 02:31:00.593477+00:00, run_end_date=2024-04-05 02:31:06.745470+00:00, run_duration=6.151993, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:30:00+00:00, data_interval_end=2024-04-05 02:31:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:31:06.759792410Z [2024-04-05T02:31:06.759+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:31:00+00:00, run_after=2024-04-05T02:32:00+00:00 2024-04-05T02:31:06.769436242Z [2024-04-05T02:31:06.768+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:31:06.769870448Z [2024-04-05T02:31:06.769+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:30:00+00:00, run_id=scheduled__2024-04-05T02:30:00+00:00, run_start_date=2024-04-05 02:31:00.594617+00:00, run_end_date=2024-04-05 02:31:06.769285+00:00, run_duration=6.174668, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:30:00+00:00, data_interval_end=2024-04-05 02:31:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:31:06.786061811Z [2024-04-05T02:31:06.785+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:31:00+00:00, run_after=2024-04-05T02:32:00+00:00 2024-04-05T02:31:06.828847446Z [2024-04-05T02:31:06.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status success for try_number 1 2024-04-05T02:31:06.829104411Z [2024-04-05T02:31:06.828+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status success for try_number 1 2024-04-05T02:31:06.838958559Z [2024-04-05T02:31:06.838+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:30:00+00:00, map_index=-1, run_start_date=2024-04-05 02:31:03.782028+00:00, run_end_date=2024-04-05 02:31:05.890165+00:00, run_duration=2.108137, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1076, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:31:00.669615+00:00, queued_by_job_id=1, pid=15727 2024-04-05T02:31:06.839407612Z [2024-04-05T02:31:06.839+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:30:00+00:00, map_index=-1, run_start_date=2024-04-05 02:31:03.357601+00:00, run_end_date=2024-04-05 02:31:05.641502+00:00, run_duration=2.283901, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1075, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:31:00.669615+00:00, queued_by_job_id=1, pid=15716 2024-04-05T02:32:00.282467129Z [2024-04-05T02:32:00.282+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:32:00.297736478Z [2024-04-05T02:32:00.297+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:32:00+00:00, run_after=2024-04-05T02:33:00+00:00 2024-04-05T02:32:00.310258299Z [2024-04-05T02:32:00.309+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:32:00+00:00, run_after=2024-04-05T02:33:00+00:00 2024-04-05T02:32:00.316898352Z [2024-04-05T02:32:00.316+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:32:00.411658835Z [2024-04-05T02:32:00.411+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:32:00.411688999Z 2024-04-05T02:32:00.411699259Z 2024-04-05T02:32:00.411704822Z 2024-04-05T02:32:00.411710214Z 2024-04-05T02:32:00.412014370Z [2024-04-05T02:32:00.411+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:32:00.412266061Z [2024-04-05T02:32:00.412+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:32:00.412497908Z [2024-04-05T02:32:00.412+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:32:00.412737769Z [2024-04-05T02:32:00.412+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:32:00.413757528Z [2024-04-05T02:32:00.413+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:32:00.413775828Z 2024-04-05T02:32:00.413780786Z 2024-04-05T02:32:00.413785087Z 2024-04-05T02:32:00.413789770Z 2024-04-05T02:32:00.418728752Z [2024-04-05T02:32:00.418+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:32:00.419027879Z [2024-04-05T02:32:00.418+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:32:00.419365205Z [2024-04-05T02:32:00.419+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:32:00.419630209Z [2024-04-05T02:32:00.419+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:32:00.419986288Z [2024-04-05T02:32:00.419+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:32:00.420259579Z [2024-04-05T02:32:00.420+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:32:00.420579939Z [2024-04-05T02:32:00.420+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:31:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:32:00.420803246Z [2024-04-05T02:32:00.420+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:32:01.084597801Z [2024-04-05T02:32:01.083+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status queued for try_number 1 2024-04-05T02:32:01.084671787Z [2024-04-05T02:32:01.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:31:00+00:00 exited with status queued for try_number 1 2024-04-05T02:32:01.084745510Z [2024-04-05T02:32:01.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:31:00+00:00 exited with status queued for try_number 1 2024-04-05T02:32:01.084788802Z [2024-04-05T02:32:01.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:31:00+00:00 exited with status queued for try_number 1 2024-04-05T02:32:01.111397970Z [2024-04-05T02:32:01.110+0000] {scheduler_job.py:635} INFO - Setting external_id for to f0886b6e-5de6-4104-ab35-2d170ccc174b 2024-04-05T02:32:01.111443967Z [2024-04-05T02:32:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to b59f2e7d-5847-4b56-84ff-cbdc5e7ed5aa 2024-04-05T02:32:01.111611644Z [2024-04-05T02:32:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4c26024b-f4af-498c-b3d2-40220142abd4 2024-04-05T02:32:01.111693005Z [2024-04-05T02:32:01.111+0000] {scheduler_job.py:635} INFO - Setting external_id for to 95b79bc9-5f63-4d75-a0e2-44172cfb35d7 2024-04-05T02:32:02.578780735Z [2024-04-05T02:32:02.577+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:32:02.580503573Z [2024-04-05T02:32:02.580+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:30:00+00:00, run_id=scheduled__2024-04-05T02:30:00+00:00, run_start_date=2024-04-05 02:32:00.334740+00:00, run_end_date=2024-04-05 02:32:02.579824+00:00, run_duration=2.245084, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:30:00+00:00, data_interval_end=2024-04-05 02:32:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:32:02.608828228Z [2024-04-05T02:32:02.608+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:32:00+00:00, run_after=2024-04-05T02:34:00+00:00 2024-04-05T02:32:02.652235166Z [2024-04-05T02:32:02.647+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:32:02.652261999Z [2024-04-05T02:32:02.648+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:31:00+00:00, run_id=scheduled__2024-04-05T02:31:00+00:00, run_start_date=2024-04-05 02:32:00.337250+00:00, run_end_date=2024-04-05 02:32:02.648386+00:00, run_duration=2.311136, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:31:00+00:00, data_interval_end=2024-04-05 02:32:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:32:02.679398268Z [2024-04-05T02:32:02.678+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:32:00+00:00, run_after=2024-04-05T02:33:00+00:00 2024-04-05T02:32:02.757190859Z [2024-04-05T02:32:02.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status success for try_number 1 2024-04-05T02:32:02.768989833Z [2024-04-05T02:32:02.768+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:30:00+00:00, map_index=-1, run_start_date=2024-04-05 02:32:01.545816+00:00, run_end_date=2024-04-05 02:32:02.100563+00:00, run_duration=0.554747, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1077, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:32:00.415257+00:00, queued_by_job_id=1, pid=15755 2024-04-05T02:32:03.699051247Z [2024-04-05T02:32:03.698+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:31:00+00:00 exited with status success for try_number 1 2024-04-05T02:32:03.705338241Z [2024-04-05T02:32:03.704+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:31:00+00:00, map_index=-1, run_start_date=2024-04-05 02:32:02.017464+00:00, run_end_date=2024-04-05 02:32:02.471667+00:00, run_duration=0.454203, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1078, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:32:00.415257+00:00, queued_by_job_id=1, pid=15761 2024-04-05T02:32:05.662155857Z [2024-04-05T02:32:05.661+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:32:05.662793259Z [2024-04-05T02:32:05.662+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:31:00+00:00, run_id=scheduled__2024-04-05T02:31:00+00:00, run_start_date=2024-04-05 02:32:00.339661+00:00, run_end_date=2024-04-05 02:32:05.662146+00:00, run_duration=5.322485, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:31:00+00:00, data_interval_end=2024-04-05 02:32:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:32:05.675546667Z [2024-04-05T02:32:05.675+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:32:00+00:00, run_after=2024-04-05T02:33:00+00:00 2024-04-05T02:32:05.685043135Z [2024-04-05T02:32:05.684+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:32:05.685417768Z [2024-04-05T02:32:05.685+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:31:00+00:00, run_id=scheduled__2024-04-05T02:31:00+00:00, run_start_date=2024-04-05 02:32:00.338531+00:00, run_end_date=2024-04-05 02:32:05.684941+00:00, run_duration=5.34641, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:31:00+00:00, data_interval_end=2024-04-05 02:32:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:32:05.695523198Z [2024-04-05T02:32:05.695+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:32:00+00:00, run_after=2024-04-05T02:33:00+00:00 2024-04-05T02:32:05.729276224Z [2024-04-05T02:32:05.728+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:31:00+00:00 exited with status success for try_number 1 2024-04-05T02:32:05.729445523Z [2024-04-05T02:32:05.729+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:31:00+00:00 exited with status success for try_number 1 2024-04-05T02:32:05.740060026Z [2024-04-05T02:32:05.739+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:31:00+00:00, map_index=-1, run_start_date=2024-04-05 02:32:03.472990+00:00, run_end_date=2024-04-05 02:32:04.849393+00:00, run_duration=1.376403, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1079, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:32:00.415257+00:00, queued_by_job_id=1, pid=15779 2024-04-05T02:32:05.740471595Z [2024-04-05T02:32:05.740+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:31:00+00:00, map_index=-1, run_start_date=2024-04-05 02:32:03.529706+00:00, run_end_date=2024-04-05 02:32:05.398773+00:00, run_duration=1.869067, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1080, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:32:00.415257+00:00, queued_by_job_id=1, pid=15780 2024-04-05T02:33:01.095427824Z [2024-04-05T02:33:01.094+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:33:01.120699847Z [2024-04-05T02:33:01.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:33:00+00:00, run_after=2024-04-05T02:34:00+00:00 2024-04-05T02:33:01.147459120Z [2024-04-05T02:33:01.147+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:33:00+00:00, run_after=2024-04-05T02:34:00+00:00 2024-04-05T02:33:01.234144181Z [2024-04-05T02:33:01.233+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:33:01.234169613Z 2024-04-05T02:33:01.234173570Z 2024-04-05T02:33:01.234177275Z 2024-04-05T02:33:01.234180821Z [2024-04-05T02:33:01.233+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:33:01.234189873Z [2024-04-05T02:33:01.234+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:33:01.234299886Z [2024-04-05T02:33:01.234+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:33:01.234919347Z [2024-04-05T02:33:01.234+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:33:01.234925538Z 2024-04-05T02:33:01.234929342Z 2024-04-05T02:33:01.234932906Z 2024-04-05T02:33:01.240746666Z [2024-04-05T02:33:01.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:33:01.240768497Z [2024-04-05T02:33:01.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:33:01.241043350Z [2024-04-05T02:33:01.240+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:33:01.241071944Z [2024-04-05T02:33:01.240+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:33:01.241280829Z [2024-04-05T02:33:01.241+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:33:01.241378496Z [2024-04-05T02:33:01.241+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:33:01.657234070Z [2024-04-05T02:33:01.656+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:32:00+00:00 exited with status queued for try_number 1 2024-04-05T02:33:01.657318030Z [2024-04-05T02:33:01.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:32:00+00:00 exited with status queued for try_number 1 2024-04-05T02:33:01.657476122Z [2024-04-05T02:33:01.657+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:32:00+00:00 exited with status queued for try_number 1 2024-04-05T02:33:01.669499301Z [2024-04-05T02:33:01.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4aac5a89-af35-482e-ab79-8dd79e4f3898 2024-04-05T02:33:01.669750352Z [2024-04-05T02:33:01.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6ded9e38-5185-445a-b5a5-df993d377218 2024-04-05T02:33:01.670020369Z [2024-04-05T02:33:01.669+0000] {scheduler_job.py:635} INFO - Setting external_id for to a88ac168-59af-47b4-a1a2-a6ef7ae514b8 2024-04-05T02:33:03.194769608Z [2024-04-05T02:33:03.194+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:33:03.197765682Z [2024-04-05T02:33:03.197+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:32:00+00:00, run_id=scheduled__2024-04-05T02:32:00+00:00, run_start_date=2024-04-05 02:33:01.162195+00:00, run_end_date=2024-04-05 02:33:03.194803+00:00, run_duration=2.032608, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:32:00+00:00, data_interval_end=2024-04-05 02:33:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:33:03.210811166Z [2024-04-05T02:33:03.210+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:33:00+00:00, run_after=2024-04-05T02:34:00+00:00 2024-04-05T02:33:03.275872959Z [2024-04-05T02:33:03.275+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:32:00+00:00 exited with status success for try_number 1 2024-04-05T02:33:03.284276578Z [2024-04-05T02:33:03.283+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:32:00+00:00, map_index=-1, run_start_date=2024-04-05 02:33:02.549852+00:00, run_end_date=2024-04-05 02:33:03.089415+00:00, run_duration=0.539563, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1081, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:33:01.236221+00:00, queued_by_job_id=1, pid=15813 2024-04-05T02:33:05.944407621Z [2024-04-05T02:33:05.943+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:33:05.944686893Z [2024-04-05T02:33:05.944+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:32:00+00:00, run_id=scheduled__2024-04-05T02:32:00+00:00, run_start_date=2024-04-05 02:33:01.164095+00:00, run_end_date=2024-04-05 02:33:05.944234+00:00, run_duration=4.780139, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:32:00+00:00, data_interval_end=2024-04-05 02:33:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:33:05.961719251Z [2024-04-05T02:33:05.961+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:33:00+00:00, run_after=2024-04-05T02:34:00+00:00 2024-04-05T02:33:05.973184328Z [2024-04-05T02:33:05.972+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:33:05.973536502Z [2024-04-05T02:33:05.973+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:32:00+00:00, run_id=scheduled__2024-04-05T02:32:00+00:00, run_start_date=2024-04-05 02:33:01.165398+00:00, run_end_date=2024-04-05 02:33:05.973123+00:00, run_duration=4.807725, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:32:00+00:00, data_interval_end=2024-04-05 02:33:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:33:05.990287239Z [2024-04-05T02:33:05.989+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:33:00+00:00, run_after=2024-04-05T02:34:00+00:00 2024-04-05T02:33:06.033815631Z [2024-04-05T02:33:06.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:32:00+00:00 exited with status success for try_number 1 2024-04-05T02:33:06.034148794Z [2024-04-05T02:33:06.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:32:00+00:00 exited with status success for try_number 1 2024-04-05T02:33:06.045899713Z [2024-04-05T02:33:06.045+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:32:00+00:00, map_index=-1, run_start_date=2024-04-05 02:33:03.427769+00:00, run_end_date=2024-04-05 02:33:05.058128+00:00, run_duration=1.630359, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1082, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:33:01.236221+00:00, queued_by_job_id=1, pid=15830 2024-04-05T02:33:06.046372798Z [2024-04-05T02:33:06.046+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:32:00+00:00, map_index=-1, run_start_date=2024-04-05 02:33:03.611046+00:00, run_end_date=2024-04-05 02:33:05.172728+00:00, run_duration=1.561682, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1083, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:33:01.236221+00:00, queued_by_job_id=1, pid=15831 2024-04-05T02:34:01.054171061Z [2024-04-05T02:34:01.053+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:34:01.075545722Z [2024-04-05T02:34:01.075+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:34:00+00:00, run_after=2024-04-05T02:35:00+00:00 2024-04-05T02:34:01.096149966Z [2024-04-05T02:34:01.095+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:34:00+00:00, run_after=2024-04-05T02:35:00+00:00 2024-04-05T02:34:01.106921512Z [2024-04-05T02:34:01.106+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:34:01.291263293Z [2024-04-05T02:34:01.290+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:34:01.291296526Z 2024-04-05T02:34:01.291303961Z 2024-04-05T02:34:01.291316046Z 2024-04-05T02:34:01.291321916Z 2024-04-05T02:34:01.291702380Z [2024-04-05T02:34:01.291+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:34:01.292146858Z [2024-04-05T02:34:01.291+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:34:01.292530807Z [2024-04-05T02:34:01.292+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:34:01.292861633Z [2024-04-05T02:34:01.292+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:34:01.294146838Z [2024-04-05T02:34:01.293+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:34:01.294166019Z 2024-04-05T02:34:01.294173648Z 2024-04-05T02:34:01.294179661Z 2024-04-05T02:34:01.294185632Z 2024-04-05T02:34:01.303081690Z [2024-04-05T02:34:01.302+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:32:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:34:01.303666481Z [2024-04-05T02:34:01.303+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:34:01.304324858Z [2024-04-05T02:34:01.303+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:34:01.304800046Z [2024-04-05T02:34:01.304+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:34:01.305611032Z [2024-04-05T02:34:01.305+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:34:01.305992284Z [2024-04-05T02:34:01.305+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:34:01.306498221Z [2024-04-05T02:34:01.306+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:33:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:34:01.306891163Z [2024-04-05T02:34:01.306+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:34:01.767709398Z [2024-04-05T02:34:01.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:32:00+00:00 exited with status queued for try_number 1 2024-04-05T02:34:01.767735148Z [2024-04-05T02:34:01.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:33:00+00:00 exited with status queued for try_number 1 2024-04-05T02:34:01.767739200Z [2024-04-05T02:34:01.764+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:33:00+00:00 exited with status queued for try_number 1 2024-04-05T02:34:01.767742829Z [2024-04-05T02:34:01.765+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:33:00+00:00 exited with status queued for try_number 1 2024-04-05T02:34:01.855802015Z [2024-04-05T02:34:01.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to 94576f29-839c-4d63-ba6e-31d9c0051a81 2024-04-05T02:34:01.855831571Z [2024-04-05T02:34:01.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to 19575f76-48c7-471f-b6ae-f329940238e4 2024-04-05T02:34:01.855850013Z [2024-04-05T02:34:01.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92532aa0-9e6c-49b3-ba4e-fe8de861af33 2024-04-05T02:34:01.855853509Z [2024-04-05T02:34:01.852+0000] {scheduler_job.py:635} INFO - Setting external_id for to 099b8d96-b208-416f-a4cb-4a7e45d13735 2024-04-05T02:34:04.232163674Z [2024-04-05T02:34:04.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:34:04.232882125Z [2024-04-05T02:34:04.232+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:32:00+00:00, run_id=scheduled__2024-04-05T02:32:00+00:00, run_start_date=2024-04-05 02:34:01.127783+00:00, run_end_date=2024-04-05 02:34:04.232042+00:00, run_duration=3.104259, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:32:00+00:00, data_interval_end=2024-04-05 02:34:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:34:04.248459252Z [2024-04-05T02:34:04.247+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:34:00+00:00, run_after=2024-04-05T02:36:00+00:00 2024-04-05T02:34:04.261423052Z [2024-04-05T02:34:04.260+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:34:04.261587197Z [2024-04-05T02:34:04.261+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:33:00+00:00, run_id=scheduled__2024-04-05T02:33:00+00:00, run_start_date=2024-04-05 02:34:01.130120+00:00, run_end_date=2024-04-05 02:34:04.261273+00:00, run_duration=3.131153, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:33:00+00:00, data_interval_end=2024-04-05 02:34:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:34:04.271912329Z [2024-04-05T02:34:04.271+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:34:00+00:00, run_after=2024-04-05T02:35:00+00:00 2024-04-05T02:34:04.335657359Z [2024-04-05T02:34:04.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:32:00+00:00 exited with status success for try_number 1 2024-04-05T02:34:04.335802179Z [2024-04-05T02:34:04.335+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:33:00+00:00 exited with status success for try_number 1 2024-04-05T02:34:04.343967096Z [2024-04-05T02:34:04.343+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:33:00+00:00, map_index=-1, run_start_date=2024-04-05 02:34:02.805188+00:00, run_end_date=2024-04-05 02:34:03.295973+00:00, run_duration=0.490785, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1085, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:34:01.297279+00:00, queued_by_job_id=1, pid=15865 2024-04-05T02:34:04.344382923Z [2024-04-05T02:34:04.344+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:32:00+00:00, map_index=-1, run_start_date=2024-04-05 02:34:02.561042+00:00, run_end_date=2024-04-05 02:34:03.145848+00:00, run_duration=0.584806, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1084, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:34:01.297279+00:00, queued_by_job_id=1, pid=15864 2024-04-05T02:34:07.297761956Z [2024-04-05T02:34:07.297+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:34:07.298019979Z [2024-04-05T02:34:07.297+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:33:00+00:00, run_id=scheduled__2024-04-05T02:33:00+00:00, run_start_date=2024-04-05 02:34:01.131823+00:00, run_end_date=2024-04-05 02:34:07.297694+00:00, run_duration=6.165871, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:33:00+00:00, data_interval_end=2024-04-05 02:34:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:34:07.308291685Z [2024-04-05T02:34:07.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:34:00+00:00, run_after=2024-04-05T02:35:00+00:00 2024-04-05T02:34:07.316638591Z [2024-04-05T02:34:07.316+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:34:07.317034001Z [2024-04-05T02:34:07.316+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:33:00+00:00, run_id=scheduled__2024-04-05T02:33:00+00:00, run_start_date=2024-04-05 02:34:01.133123+00:00, run_end_date=2024-04-05 02:34:07.316631+00:00, run_duration=6.183508, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:33:00+00:00, data_interval_end=2024-04-05 02:34:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:34:07.327071938Z [2024-04-05T02:34:07.326+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:34:00+00:00, run_after=2024-04-05T02:35:00+00:00 2024-04-05T02:34:07.365449843Z [2024-04-05T02:34:07.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:33:00+00:00 exited with status success for try_number 1 2024-04-05T02:34:07.365490735Z [2024-04-05T02:34:07.365+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:33:00+00:00 exited with status success for try_number 1 2024-04-05T02:34:07.373072795Z [2024-04-05T02:34:07.372+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:33:00+00:00, map_index=-1, run_start_date=2024-04-05 02:34:04.136561+00:00, run_end_date=2024-04-05 02:34:06.654266+00:00, run_duration=2.517705, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1087, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:34:01.297279+00:00, queued_by_job_id=1, pid=15889 2024-04-05T02:34:07.373421596Z [2024-04-05T02:34:07.373+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:33:00+00:00, map_index=-1, run_start_date=2024-04-05 02:34:04.001354+00:00, run_end_date=2024-04-05 02:34:06.336284+00:00, run_duration=2.33493, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1086, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:34:01.297279+00:00, queued_by_job_id=1, pid=15888 2024-04-05T02:35:00.919480956Z [2024-04-05T02:35:00.919+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:35:00+00:00, run_after=2024-04-05T02:36:00+00:00 2024-04-05T02:35:00.933269628Z [2024-04-05T02:35:00.932+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:35:00+00:00, run_after=2024-04-05T02:40:00+00:00 2024-04-05T02:35:00.945809039Z [2024-04-05T02:35:00.945+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:35:00+00:00, run_after=2024-04-05T02:36:00+00:00 2024-04-05T02:35:00.953570650Z [2024-04-05T02:35:00.953+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:35:01.044220389Z [2024-04-05T02:35:01.043+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:35:01.044248111Z 2024-04-05T02:35:01.044252793Z 2024-04-05T02:35:01.044256124Z 2024-04-05T02:35:01.044259354Z 2024-04-05T02:35:01.044319767Z [2024-04-05T02:35:01.044+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:35:01.044508084Z [2024-04-05T02:35:01.044+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:35:01.044652612Z [2024-04-05T02:35:01.044+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:35:01.044789333Z [2024-04-05T02:35:01.044+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:35:01.045758289Z [2024-04-05T02:35:01.045+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:35:01.045764828Z 2024-04-05T02:35:01.045768190Z 2024-04-05T02:35:01.045771584Z 2024-04-05T02:35:01.045792154Z 2024-04-05T02:35:01.052006156Z [2024-04-05T02:35:01.051+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:35:01.052227824Z [2024-04-05T02:35:01.051+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:35:01.052671430Z [2024-04-05T02:35:01.052+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:35:01.052963098Z [2024-04-05T02:35:01.052+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:35:01.053472801Z [2024-04-05T02:35:01.053+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:35:01.053569700Z [2024-04-05T02:35:01.053+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:35:01.053929219Z [2024-04-05T02:35:01.053+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:35:01.054113664Z [2024-04-05T02:35:01.053+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:35:01.616970766Z [2024-04-05T02:35:01.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status queued for try_number 1 2024-04-05T02:35:01.617048021Z [2024-04-05T02:35:01.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:34:00+00:00 exited with status queued for try_number 1 2024-04-05T02:35:01.617081238Z [2024-04-05T02:35:01.616+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:34:00+00:00 exited with status queued for try_number 1 2024-04-05T02:35:01.617174567Z [2024-04-05T02:35:01.617+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:34:00+00:00 exited with status queued for try_number 1 2024-04-05T02:35:01.635504449Z [2024-04-05T02:35:01.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 757f3f98-dde5-4cfd-97c8-2f987b7e3698 2024-04-05T02:35:01.635590094Z [2024-04-05T02:35:01.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3c9b29c0-f0fd-4db3-8522-9386318ebca0 2024-04-05T02:35:01.635716428Z [2024-04-05T02:35:01.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to d6a37881-7edb-4238-853d-55359c53e266 2024-04-05T02:35:01.635823075Z [2024-04-05T02:35:01.635+0000] {scheduler_job.py:635} INFO - Setting external_id for to 62d8b4e8-1b69-4f87-afbb-886fd01f35b7 2024-04-05T02:35:03.142656434Z [2024-04-05T02:35:03.142+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:35:03.143195930Z [2024-04-05T02:35:03.142+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:34:00+00:00, run_id=scheduled__2024-04-05T02:34:00+00:00, run_start_date=2024-04-05 02:35:00.965396+00:00, run_end_date=2024-04-05 02:35:03.142552+00:00, run_duration=2.177156, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:34:00+00:00, data_interval_end=2024-04-05 02:35:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:35:03.161660378Z [2024-04-05T02:35:03.161+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:35:00+00:00, run_after=2024-04-05T02:36:00+00:00 2024-04-05T02:35:03.376825292Z [2024-04-05T02:35:03.376+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:34:00+00:00 exited with status success for try_number 1 2024-04-05T02:35:03.393724263Z [2024-04-05T02:35:03.393+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:34:00+00:00, map_index=-1, run_start_date=2024-04-05 02:35:02.553953+00:00, run_end_date=2024-04-05 02:35:03.108326+00:00, run_duration=0.554373, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1088, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:35:01.047711+00:00, queued_by_job_id=1, pid=15923 2024-04-05T02:35:04.789473246Z [2024-04-05T02:35:04.789+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:35:04.789545495Z 2024-04-05T02:35:04.789731276Z [2024-04-05T02:35:04.789+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:35:04.790409327Z [2024-04-05T02:35:04.790+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:35:04.790425819Z 2024-04-05T02:35:04.793346597Z [2024-04-05T02:35:04.793+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:35:04.793648392Z [2024-04-05T02:35:04.793+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:35:04.866884997Z [2024-04-05T02:35:04.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status queued for try_number 1 2024-04-05T02:35:04.867112213Z [2024-04-05T02:35:04.866+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status success for try_number 1 2024-04-05T02:35:04.875653729Z [2024-04-05T02:35:04.875+0000] {scheduler_job.py:635} INFO - Setting external_id for to 60561ee2-adf1-46c8-b81b-6aab8f7f654a 2024-04-05T02:35:04.875965951Z [2024-04-05T02:35:04.875+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:30:00+00:00, map_index=-1, run_start_date=2024-04-05 02:35:04.156783+00:00, run_end_date=2024-04-05 02:35:04.673538+00:00, run_duration=0.516755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1090, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:35:01.047711+00:00, queued_by_job_id=1, pid=15942 2024-04-05T02:35:06.527006706Z [2024-04-05T02:35:06.526+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:35:06.527189008Z [2024-04-05T02:35:06.526+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:34:00+00:00, run_id=scheduled__2024-04-05T02:34:00+00:00, run_start_date=2024-04-05 02:35:00.966577+00:00, run_end_date=2024-04-05 02:35:06.526897+00:00, run_duration=5.56032, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:34:00+00:00, data_interval_end=2024-04-05 02:35:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:35:06.537623943Z [2024-04-05T02:35:06.537+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:35:00+00:00, run_after=2024-04-05T02:36:00+00:00 2024-04-05T02:35:06.614416796Z [2024-04-05T02:35:06.613+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:34:00+00:00 exited with status success for try_number 1 2024-04-05T02:35:06.623699950Z [2024-04-05T02:35:06.623+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:34:00+00:00, map_index=-1, run_start_date=2024-04-05 02:35:04.008473+00:00, run_end_date=2024-04-05 02:35:05.517120+00:00, run_duration=1.508647, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1089, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:35:01.047711+00:00, queued_by_job_id=1, pid=15941 2024-04-05T02:35:07.674801915Z [2024-04-05T02:35:07.674+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:35:07.675160966Z [2024-04-05T02:35:07.674+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:34:00+00:00, run_id=scheduled__2024-04-05T02:34:00+00:00, run_start_date=2024-04-05 02:35:00.967845+00:00, run_end_date=2024-04-05 02:35:07.674734+00:00, run_duration=6.706889, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:34:00+00:00, data_interval_end=2024-04-05 02:35:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:35:07.695030214Z [2024-04-05T02:35:07.694+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:35:00+00:00, run_after=2024-04-05T02:36:00+00:00 2024-04-05T02:35:07.744759565Z [2024-04-05T02:35:07.744+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:35:07.744802995Z 2024-04-05T02:35:07.745015315Z [2024-04-05T02:35:07.744+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:35:07.746050018Z [2024-04-05T02:35:07.745+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:35:07.746137848Z 2024-04-05T02:35:07.750050630Z [2024-04-05T02:35:07.749+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:30:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:35:07.750354073Z [2024-04-05T02:35:07.750+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:35:07.814025884Z [2024-04-05T02:35:07.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status queued for try_number 1 2024-04-05T02:35:07.816946332Z [2024-04-05T02:35:07.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:34:00+00:00 exited with status success for try_number 1 2024-04-05T02:35:07.817405317Z [2024-04-05T02:35:07.816+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status success for try_number 1 2024-04-05T02:35:07.835826645Z [2024-04-05T02:35:07.833+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T02:30:00+00:00, map_index=-1, run_start_date=2024-04-05 02:35:06.754940+00:00, run_end_date=2024-04-05 02:35:07.113024+00:00, run_duration=0.358084, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1092, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:35:04.790884+00:00, queued_by_job_id=1, pid=15971 2024-04-05T02:35:07.835897322Z [2024-04-05T02:35:07.834+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:34:00+00:00, map_index=-1, run_start_date=2024-04-05 02:35:04.620593+00:00, run_end_date=2024-04-05 02:35:07.210668+00:00, run_duration=2.590075, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1091, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:35:01.047711+00:00, queued_by_job_id=1, pid=15958 2024-04-05T02:35:07.835904102Z [2024-04-05T02:35:07.834+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6871b0f-bd7f-4019-abcf-352096cf10ad 2024-04-05T02:35:11.256280804Z [2024-04-05T02:35:11.255+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:35:11.256315424Z 2024-04-05T02:35:11.256408762Z [2024-04-05T02:35:11.256+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:35:11.257100566Z [2024-04-05T02:35:11.256+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:35:11.257113643Z 2024-04-05T02:35:11.259788897Z [2024-04-05T02:35:11.259+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:30:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:35:11.259904522Z [2024-04-05T02:35:11.259+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:35:11.342762385Z [2024-04-05T02:35:11.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status queued for try_number 1 2024-04-05T02:35:11.342918599Z [2024-04-05T02:35:11.342+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status success for try_number 1 2024-04-05T02:35:11.349908974Z [2024-04-05T02:35:11.349+0000] {scheduler_job.py:635} INFO - Setting external_id for to 45499ab1-4627-4fb3-8053-959cf960befa 2024-04-05T02:35:11.350096908Z [2024-04-05T02:35:11.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:30:00+00:00, map_index=0, run_start_date=2024-04-05 02:35:09.530623+00:00, run_end_date=2024-04-05 02:35:10.698937+00:00, run_duration=1.168314, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1093, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:35:07.746680+00:00, queued_by_job_id=1, pid=15989 2024-04-05T02:35:14.112398393Z [2024-04-05T02:35:14.111+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:35:14.112620312Z [2024-04-05T02:35:14.112+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:30:00+00:00, run_id=scheduled__2024-04-05T02:30:00+00:00, run_start_date=2024-04-05 02:35:00.964103+00:00, run_end_date=2024-04-05 02:35:14.112288+00:00, run_duration=13.148185, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:30:00+00:00, data_interval_end=2024-04-05 02:35:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T02:35:14.120539747Z [2024-04-05T02:35:14.120+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:35:00+00:00, run_after=2024-04-05T02:40:00+00:00 2024-04-05T02:35:14.153013611Z [2024-04-05T02:35:14.152+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:30:00+00:00 exited with status success for try_number 1 2024-04-05T02:35:14.158380342Z [2024-04-05T02:35:14.157+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:30:00+00:00, map_index=-1, run_start_date=2024-04-05 02:35:13.279937+00:00, run_end_date=2024-04-05 02:35:13.666717+00:00, run_duration=0.38678, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1094, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:35:11.257462+00:00, queued_by_job_id=1, pid=16005 2024-04-05T02:35:42.130906306Z [2024-04-05T02:35:42.130+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:36:00.787445663Z [2024-04-05T02:36:00.786+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:36:00+00:00, run_after=2024-04-05T02:37:00+00:00 2024-04-05T02:36:00.796391133Z [2024-04-05T02:36:00.795+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:36:00.813975383Z [2024-04-05T02:36:00.813+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:36:00+00:00, run_after=2024-04-05T02:37:00+00:00 2024-04-05T02:36:00.824238056Z [2024-04-05T02:36:00.823+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:36:00.953570757Z [2024-04-05T02:36:00.953+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:36:00.953611268Z 2024-04-05T02:36:00.953619552Z 2024-04-05T02:36:00.953626019Z 2024-04-05T02:36:00.953632058Z 2024-04-05T02:36:00.954584922Z [2024-04-05T02:36:00.954+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:36:00.954922233Z [2024-04-05T02:36:00.954+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:36:00.955249131Z [2024-04-05T02:36:00.954+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:36:00.955471333Z [2024-04-05T02:36:00.955+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:36:00.956530925Z [2024-04-05T02:36:00.956+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:36:00.956549277Z 2024-04-05T02:36:00.956554602Z 2024-04-05T02:36:00.956558974Z 2024-04-05T02:36:00.956563202Z 2024-04-05T02:36:00.963992326Z [2024-04-05T02:36:00.963+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:34:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:36:00.964421081Z [2024-04-05T02:36:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:36:00.964968571Z [2024-04-05T02:36:00.964+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:36:00.965170666Z [2024-04-05T02:36:00.964+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:36:00.965523628Z [2024-04-05T02:36:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:36:00.965755640Z [2024-04-05T02:36:00.965+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:36:00.966126183Z [2024-04-05T02:36:00.965+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:36:00.966315272Z [2024-04-05T02:36:00.966+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:36:01.724246074Z [2024-04-05T02:36:01.723+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:34:00+00:00 exited with status queued for try_number 1 2024-04-05T02:36:01.724553754Z [2024-04-05T02:36:01.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status queued for try_number 1 2024-04-05T02:36:01.724765657Z [2024-04-05T02:36:01.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status queued for try_number 1 2024-04-05T02:36:01.724967928Z [2024-04-05T02:36:01.724+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status queued for try_number 1 2024-04-05T02:36:01.763922936Z [2024-04-05T02:36:01.759+0000] {scheduler_job.py:635} INFO - Setting external_id for to d77ae5a6-5d73-47db-8d85-21b89bc2b686 2024-04-05T02:36:01.763964287Z [2024-04-05T02:36:01.759+0000] {scheduler_job.py:635} INFO - Setting external_id for to fb14e4cc-eef4-448a-ac50-b1d1833f27bc 2024-04-05T02:36:01.763968948Z [2024-04-05T02:36:01.760+0000] {scheduler_job.py:635} INFO - Setting external_id for to d5d5927a-6302-4865-a2c7-cc799bb9eded 2024-04-05T02:36:01.763972305Z [2024-04-05T02:36:01.760+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6fae8b16-49a3-4f48-b07e-a8c40a46f028 2024-04-05T02:36:03.208259648Z [2024-04-05T02:36:03.207+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:36:03.208520997Z [2024-04-05T02:36:03.208+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:34:00+00:00, run_id=scheduled__2024-04-05T02:34:00+00:00, run_start_date=2024-04-05 02:36:00.867054+00:00, run_end_date=2024-04-05 02:36:03.208146+00:00, run_duration=2.341092, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:34:00+00:00, data_interval_end=2024-04-05 02:36:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:36:03.227750175Z [2024-04-05T02:36:03.227+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:36:00+00:00, run_after=2024-04-05T02:38:00+00:00 2024-04-05T02:36:03.330929088Z [2024-04-05T02:36:03.330+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:34:00+00:00 exited with status success for try_number 1 2024-04-05T02:36:03.341685705Z [2024-04-05T02:36:03.341+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:34:00+00:00, map_index=-1, run_start_date=2024-04-05 02:36:02.539738+00:00, run_end_date=2024-04-05 02:36:03.034623+00:00, run_duration=0.494885, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1095, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:36:00.958503+00:00, queued_by_job_id=1, pid=16015 2024-04-05T02:36:04.386271754Z [2024-04-05T02:36:04.385+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:36:04.386925040Z [2024-04-05T02:36:04.386+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:35:00+00:00, run_id=scheduled__2024-04-05T02:35:00+00:00, run_start_date=2024-04-05 02:36:00.870631+00:00, run_end_date=2024-04-05 02:36:04.386312+00:00, run_duration=3.515681, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:35:00+00:00, data_interval_end=2024-04-05 02:36:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:36:04.405692995Z [2024-04-05T02:36:04.405+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:36:00+00:00, run_after=2024-04-05T02:37:00+00:00 2024-04-05T02:36:04.462069392Z [2024-04-05T02:36:04.461+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status success for try_number 1 2024-04-05T02:36:04.469211998Z [2024-04-05T02:36:04.468+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:35:00+00:00, map_index=-1, run_start_date=2024-04-05 02:36:02.741967+00:00, run_end_date=2024-04-05 02:36:03.288095+00:00, run_duration=0.546128, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1096, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:36:00.958503+00:00, queued_by_job_id=1, pid=16017 2024-04-05T02:36:06.760858449Z [2024-04-05T02:36:06.760+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:36:06.761227660Z [2024-04-05T02:36:06.760+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:35:00+00:00, run_id=scheduled__2024-04-05T02:35:00+00:00, run_start_date=2024-04-05 02:36:00.872224+00:00, run_end_date=2024-04-05 02:36:06.760741+00:00, run_duration=5.888517, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:35:00+00:00, data_interval_end=2024-04-05 02:36:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:36:06.770533141Z [2024-04-05T02:36:06.770+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:36:00+00:00, run_after=2024-04-05T02:37:00+00:00 2024-04-05T02:36:06.778244043Z [2024-04-05T02:36:06.777+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:36:06.778474680Z [2024-04-05T02:36:06.778+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:35:00+00:00, run_id=scheduled__2024-04-05T02:35:00+00:00, run_start_date=2024-04-05 02:36:00.873591+00:00, run_end_date=2024-04-05 02:36:06.778103+00:00, run_duration=5.904512, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:35:00+00:00, data_interval_end=2024-04-05 02:36:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:36:06.788394596Z [2024-04-05T02:36:06.788+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:36:00+00:00, run_after=2024-04-05T02:37:00+00:00 2024-04-05T02:36:06.820861821Z [2024-04-05T02:36:06.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status success for try_number 1 2024-04-05T02:36:06.820886820Z [2024-04-05T02:36:06.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status success for try_number 1 2024-04-05T02:36:06.829313548Z [2024-04-05T02:36:06.828+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:35:00+00:00, map_index=-1, run_start_date=2024-04-05 02:36:03.732775+00:00, run_end_date=2024-04-05 02:36:06.286174+00:00, run_duration=2.553399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1097, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:36:00.958503+00:00, queued_by_job_id=1, pid=16039 2024-04-05T02:36:06.829536218Z [2024-04-05T02:36:06.829+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:35:00+00:00, map_index=-1, run_start_date=2024-04-05 02:36:03.770288+00:00, run_end_date=2024-04-05 02:36:06.383023+00:00, run_duration=2.612735, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1098, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:36:00.958503+00:00, queued_by_job_id=1, pid=16040 2024-04-05T02:36:54.545679334Z [2024-04-05T02:36:54.545+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:36:54.545714865Z 2024-04-05T02:36:54.545889673Z [2024-04-05T02:36:54.545+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-04-05T02:36:54.546635296Z [2024-04-05T02:36:54.546+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:36:54.546642801Z 2024-04-05T02:36:54.549406952Z [2024-04-05T02:36:54.549+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240405023653_055926', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:36:54.549666238Z [2024-04-05T02:36:54.549+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240405023653_055926', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-05T02:36:54.610118651Z [2024-04-05T02:36:54.609+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240405023653_055926 exited with status queued for try_number 1 2024-04-05T02:36:54.617022113Z [2024-04-05T02:36:54.616+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb0dede3-2363-4d2e-83c7-08ccf3a92a08 2024-04-05T02:36:56.648253618Z [2024-04-05T02:36:56.647+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:36:56.648811756Z [2024-04-05T02:36:56.648+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-04-05 02:36:54.029559+00:00, run_id=vdu_alarm_20240405023653_055926, run_start_date=2024-04-05 02:36:54.500334+00:00, run_end_date=2024-04-05 02:36:56.648159+00:00, run_duration=2.147825, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-05 02:36:54.029559+00:00, data_interval_end=2024-04-05 02:36:54.029559+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-04-05T02:36:56.653771157Z [2024-04-05T02:36:56.653+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-04-05T02:36:56.700764007Z [2024-04-05T02:36:56.700+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240405023653_055926 exited with status success for try_number 1 2024-04-05T02:36:56.711729384Z [2024-04-05T02:36:56.711+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240405023653_055926, map_index=-1, run_start_date=2024-04-05 02:36:55.197052+00:00, run_end_date=2024-04-05 02:36:55.559942+00:00, run_duration=0.36289, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1099, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:36:54.547112+00:00, queued_by_job_id=1, pid=16065 2024-04-05T02:37:00.525819532Z [2024-04-05T02:37:00.525+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:37:00+00:00, run_after=2024-04-05T02:38:00+00:00 2024-04-05T02:37:00.558344401Z [2024-04-05T02:37:00.557+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:37:00+00:00, run_after=2024-04-05T02:38:00+00:00 2024-04-05T02:37:00.569533924Z [2024-04-05T02:37:00.569+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:37:00.668519740Z [2024-04-05T02:37:00.668+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:37:00.668548384Z 2024-04-05T02:37:00.668552404Z 2024-04-05T02:37:00.668555661Z 2024-04-05T02:37:00.668682841Z [2024-04-05T02:37:00.668+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:37:00.668882919Z [2024-04-05T02:37:00.668+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:37:00.669077453Z [2024-04-05T02:37:00.668+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:37:00.670026278Z [2024-04-05T02:37:00.669+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:37:00.670039727Z 2024-04-05T02:37:00.670057154Z 2024-04-05T02:37:00.670060390Z 2024-04-05T02:37:00.676609039Z [2024-04-05T02:37:00.676+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:37:00.676950145Z [2024-04-05T02:37:00.676+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:37:00.677362969Z [2024-04-05T02:37:00.677+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:37:00.677567093Z [2024-04-05T02:37:00.677+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:37:00.677954707Z [2024-04-05T02:37:00.677+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:37:00.678128226Z [2024-04-05T02:37:00.677+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:37:01.216754247Z [2024-04-05T02:37:01.215+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:36:00+00:00 exited with status queued for try_number 1 2024-04-05T02:37:01.216938797Z [2024-04-05T02:37:01.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:36:00+00:00 exited with status queued for try_number 1 2024-04-05T02:37:01.217147037Z [2024-04-05T02:37:01.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:36:00+00:00 exited with status queued for try_number 1 2024-04-05T02:37:01.259841237Z [2024-04-05T02:37:01.256+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3b0623ad-a011-4165-873c-aa90a9785e12 2024-04-05T02:37:01.259873646Z [2024-04-05T02:37:01.257+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7fb3eedb-d0de-4037-9780-d5203e05ae06 2024-04-05T02:37:01.259879973Z [2024-04-05T02:37:01.257+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8ddac1d2-0790-46e2-b554-1b5d201c8597 2024-04-05T02:37:03.954377119Z [2024-04-05T02:37:03.953+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:37:03.956440950Z [2024-04-05T02:37:03.955+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:36:00+00:00, run_id=scheduled__2024-04-05T02:36:00+00:00, run_start_date=2024-04-05 02:37:00.585878+00:00, run_end_date=2024-04-05 02:37:03.954283+00:00, run_duration=3.368405, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:36:00+00:00, data_interval_end=2024-04-05 02:37:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:37:03.976495474Z [2024-04-05T02:37:03.976+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:37:00+00:00, run_after=2024-04-05T02:38:00+00:00 2024-04-05T02:37:04.069899167Z [2024-04-05T02:37:04.068+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:36:00+00:00 exited with status success for try_number 1 2024-04-05T02:37:04.083650482Z [2024-04-05T02:37:04.083+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:36:00+00:00, map_index=-1, run_start_date=2024-04-05 02:37:02.315407+00:00, run_end_date=2024-04-05 02:37:02.933807+00:00, run_duration=0.6184, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1100, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:37:00.671892+00:00, queued_by_job_id=1, pid=16079 2024-04-05T02:37:07.517391443Z [2024-04-05T02:37:07.516+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:37:07.517843779Z [2024-04-05T02:37:07.517+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:36:00+00:00, run_id=scheduled__2024-04-05T02:36:00+00:00, run_start_date=2024-04-05 02:37:00.587347+00:00, run_end_date=2024-04-05 02:37:07.517493+00:00, run_duration=6.930146, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:36:00+00:00, data_interval_end=2024-04-05 02:37:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:37:07.529025063Z [2024-04-05T02:37:07.528+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:37:00+00:00, run_after=2024-04-05T02:38:00+00:00 2024-04-05T02:37:07.569702914Z [2024-04-05T02:37:07.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:36:00+00:00 exited with status success for try_number 1 2024-04-05T02:37:07.574696106Z [2024-04-05T02:37:07.574+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:36:00+00:00, map_index=-1, run_start_date=2024-04-05 02:37:03.846753+00:00, run_end_date=2024-04-05 02:37:07.041404+00:00, run_duration=3.194651, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1101, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:37:00.671892+00:00, queued_by_job_id=1, pid=16092 2024-04-05T02:37:09.724775734Z [2024-04-05T02:37:09.724+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:37:09.725212371Z [2024-04-05T02:37:09.725+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:36:00+00:00, run_id=scheduled__2024-04-05T02:36:00+00:00, run_start_date=2024-04-05 02:37:00.588976+00:00, run_end_date=2024-04-05 02:37:09.724920+00:00, run_duration=9.135944, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:36:00+00:00, data_interval_end=2024-04-05 02:37:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:37:09.733655481Z [2024-04-05T02:37:09.733+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:37:00+00:00, run_after=2024-04-05T02:38:00+00:00 2024-04-05T02:37:09.760950361Z [2024-04-05T02:37:09.760+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:36:00+00:00 exited with status success for try_number 1 2024-04-05T02:37:09.766419713Z [2024-04-05T02:37:09.766+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:36:00+00:00, map_index=-1, run_start_date=2024-04-05 02:37:04.252561+00:00, run_end_date=2024-04-05 02:37:08.795921+00:00, run_duration=4.54336, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1102, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:37:00.671892+00:00, queued_by_job_id=1, pid=16103 2024-04-05T02:38:00.335987086Z [2024-04-05T02:38:00.335+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:38:00+00:00, run_after=2024-04-05T02:39:00+00:00 2024-04-05T02:38:00.346323049Z [2024-04-05T02:38:00.345+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:38:00.384982372Z [2024-04-05T02:38:00.384+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:38:00+00:00, run_after=2024-04-05T02:39:00+00:00 2024-04-05T02:38:00.406849146Z [2024-04-05T02:38:00.406+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:38:00.491720710Z [2024-04-05T02:38:00.491+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:38:00.491752779Z 2024-04-05T02:38:00.491757523Z 2024-04-05T02:38:00.491761027Z 2024-04-05T02:38:00.491764496Z 2024-04-05T02:38:00.491794561Z [2024-04-05T02:38:00.491+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:38:00.491973482Z [2024-04-05T02:38:00.491+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:38:00.492040963Z [2024-04-05T02:38:00.491+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:38:00.492125548Z [2024-04-05T02:38:00.492+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:38:00.492722550Z [2024-04-05T02:38:00.492+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:38:00.492735196Z 2024-04-05T02:38:00.492738884Z 2024-04-05T02:38:00.492742180Z 2024-04-05T02:38:00.492745526Z 2024-04-05T02:38:00.502283441Z [2024-04-05T02:38:00.501+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:36:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:38:00.502374518Z [2024-04-05T02:38:00.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:38:00.502543397Z [2024-04-05T02:38:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:38:00.502632968Z [2024-04-05T02:38:00.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:38:00.502968638Z [2024-04-05T02:38:00.502+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:38:00.503071318Z [2024-04-05T02:38:00.502+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:38:00.503234896Z [2024-04-05T02:38:00.503+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:37:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:38:00.503328565Z [2024-04-05T02:38:00.503+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:38:01.824706385Z [2024-04-05T02:38:01.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:36:00+00:00 exited with status queued for try_number 1 2024-04-05T02:38:01.824732196Z [2024-04-05T02:38:01.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:37:00+00:00 exited with status queued for try_number 1 2024-04-05T02:38:01.824736122Z [2024-04-05T02:38:01.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:37:00+00:00 exited with status queued for try_number 1 2024-04-05T02:38:01.824739790Z [2024-04-05T02:38:01.821+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:37:00+00:00 exited with status queued for try_number 1 2024-04-05T02:38:01.923351294Z [2024-04-05T02:38:01.922+0000] {scheduler_job.py:635} INFO - Setting external_id for to 67c4fdbc-edc3-417a-bdf5-40d5820b38a1 2024-04-05T02:38:01.923775373Z [2024-04-05T02:38:01.923+0000] {scheduler_job.py:635} INFO - Setting external_id for to c6682e31-19ec-43e9-9737-e2134ecc1f8e 2024-04-05T02:38:01.924062838Z [2024-04-05T02:38:01.923+0000] {scheduler_job.py:635} INFO - Setting external_id for to ed47ddf9-9dbc-44d5-93b6-fe5028e4a849 2024-04-05T02:38:01.925432033Z [2024-04-05T02:38:01.925+0000] {scheduler_job.py:635} INFO - Setting external_id for to 89f8ef71-ba82-46eb-9554-91facbd8d140 2024-04-05T02:38:03.498550111Z [2024-04-05T02:38:03.497+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:38:03.499670840Z [2024-04-05T02:38:03.499+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:37:00+00:00, run_id=scheduled__2024-04-05T02:37:00+00:00, run_start_date=2024-04-05 02:38:00.429235+00:00, run_end_date=2024-04-05 02:38:03.499035+00:00, run_duration=3.0698, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:37:00+00:00, data_interval_end=2024-04-05 02:38:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:38:03.529229323Z [2024-04-05T02:38:03.528+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:38:00+00:00, run_after=2024-04-05T02:39:00+00:00 2024-04-05T02:38:03.619766696Z [2024-04-05T02:38:03.619+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:37:00+00:00 exited with status success for try_number 1 2024-04-05T02:38:03.637412798Z [2024-04-05T02:38:03.636+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:37:00+00:00, map_index=-1, run_start_date=2024-04-05 02:38:02.539399+00:00, run_end_date=2024-04-05 02:38:02.984063+00:00, run_duration=0.444664, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1103, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:38:00.493744+00:00, queued_by_job_id=1, pid=16132 2024-04-05T02:38:04.701215952Z [2024-04-05T02:38:04.700+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:38:04.701821528Z [2024-04-05T02:38:04.701+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:36:00+00:00, run_id=scheduled__2024-04-05T02:36:00+00:00, run_start_date=2024-04-05 02:38:00.427960+00:00, run_end_date=2024-04-05 02:38:04.701380+00:00, run_duration=4.27342, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:36:00+00:00, data_interval_end=2024-04-05 02:38:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:38:04.710599137Z [2024-04-05T02:38:04.710+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:38:00+00:00, run_after=2024-04-05T02:40:00+00:00 2024-04-05T02:38:04.757194815Z [2024-04-05T02:38:04.756+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:36:00+00:00 exited with status success for try_number 1 2024-04-05T02:38:04.764871696Z [2024-04-05T02:38:04.764+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:36:00+00:00, map_index=-1, run_start_date=2024-04-05 02:38:02.844005+00:00, run_end_date=2024-04-05 02:38:03.490364+00:00, run_duration=0.646359, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1104, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:38:00.493744+00:00, queued_by_job_id=1, pid=16138 2024-04-05T02:38:07.395036337Z [2024-04-05T02:38:07.394+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:38:07.395381515Z [2024-04-05T02:38:07.395+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:37:00+00:00, run_id=scheduled__2024-04-05T02:37:00+00:00, run_start_date=2024-04-05 02:38:00.430241+00:00, run_end_date=2024-04-05 02:38:07.394961+00:00, run_duration=6.96472, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:37:00+00:00, data_interval_end=2024-04-05 02:38:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:38:07.407863639Z [2024-04-05T02:38:07.407+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:38:00+00:00, run_after=2024-04-05T02:39:00+00:00 2024-04-05T02:38:07.464056638Z [2024-04-05T02:38:07.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:37:00+00:00 exited with status success for try_number 1 2024-04-05T02:38:07.475176088Z [2024-04-05T02:38:07.474+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:37:00+00:00, map_index=-1, run_start_date=2024-04-05 02:38:03.654776+00:00, run_end_date=2024-04-05 02:38:06.407749+00:00, run_duration=2.752973, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1105, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:38:00.493744+00:00, queued_by_job_id=1, pid=16150 2024-04-05T02:38:08.524160013Z [2024-04-05T02:38:08.523+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:38:08.524434826Z [2024-04-05T02:38:08.524+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:37:00+00:00, run_id=scheduled__2024-04-05T02:37:00+00:00, run_start_date=2024-04-05 02:38:00.431182+00:00, run_end_date=2024-04-05 02:38:08.524061+00:00, run_duration=8.092879, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:37:00+00:00, data_interval_end=2024-04-05 02:38:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:38:08.533717508Z [2024-04-05T02:38:08.533+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:38:00+00:00, run_after=2024-04-05T02:39:00+00:00 2024-04-05T02:38:08.562166332Z [2024-04-05T02:38:08.561+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:37:00+00:00 exited with status success for try_number 1 2024-04-05T02:38:08.569271958Z [2024-04-05T02:38:08.568+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:37:00+00:00, map_index=-1, run_start_date=2024-04-05 02:38:04.417116+00:00, run_end_date=2024-04-05 02:38:08.208984+00:00, run_duration=3.791868, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1106, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:38:00.493744+00:00, queued_by_job_id=1, pid=16161 2024-04-05T02:39:00.254724333Z [2024-04-05T02:39:00.254+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:39:00+00:00, run_after=2024-04-05T02:40:00+00:00 2024-04-05T02:39:00.292553175Z [2024-04-05T02:39:00.292+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:39:00.333838840Z [2024-04-05T02:39:00.333+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:39:00+00:00, run_after=2024-04-05T02:40:00+00:00 2024-04-05T02:39:00.441990215Z [2024-04-05T02:39:00.441+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:39:00.442013840Z 2024-04-05T02:39:00.442017929Z 2024-04-05T02:39:00.442021443Z 2024-04-05T02:39:00.442067135Z [2024-04-05T02:39:00.441+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:39:00.442107032Z [2024-04-05T02:39:00.441+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:39:00.442193476Z [2024-04-05T02:39:00.442+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:39:00.442755737Z [2024-04-05T02:39:00.442+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:39:00.442766352Z 2024-04-05T02:39:00.442769624Z 2024-04-05T02:39:00.442772633Z 2024-04-05T02:39:00.446137175Z [2024-04-05T02:39:00.445+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:39:00.446196088Z [2024-04-05T02:39:00.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:39:00.446404015Z [2024-04-05T02:39:00.446+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:39:00.446455059Z [2024-04-05T02:39:00.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:39:00.446635954Z [2024-04-05T02:39:00.446+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:39:00.446701927Z [2024-04-05T02:39:00.446+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:39:01.373123890Z [2024-04-05T02:39:01.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:38:00+00:00 exited with status queued for try_number 1 2024-04-05T02:39:01.373152432Z [2024-04-05T02:39:01.372+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:38:00+00:00 exited with status queued for try_number 1 2024-04-05T02:39:01.376155585Z [2024-04-05T02:39:01.373+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:38:00+00:00 exited with status queued for try_number 1 2024-04-05T02:39:01.423577644Z [2024-04-05T02:39:01.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to fa1f0113-6fc5-4d5e-8009-8ec6da58a248 2024-04-05T02:39:01.428930025Z [2024-04-05T02:39:01.423+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7d001e1-eb00-48ca-9f79-6755e6afcbf8 2024-04-05T02:39:01.429338459Z [2024-04-05T02:39:01.429+0000] {scheduler_job.py:635} INFO - Setting external_id for to f663d24d-7354-4706-a05b-faafe54dd328 2024-04-05T02:39:04.457309120Z [2024-04-05T02:39:04.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:39:04.458258925Z [2024-04-05T02:39:04.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:38:00+00:00, run_id=scheduled__2024-04-05T02:38:00+00:00, run_start_date=2024-04-05 02:39:00.361135+00:00, run_end_date=2024-04-05 02:39:04.457660+00:00, run_duration=4.096525, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:38:00+00:00, data_interval_end=2024-04-05 02:39:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:39:04.471111567Z [2024-04-05T02:39:04.470+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:39:00+00:00, run_after=2024-04-05T02:40:00+00:00 2024-04-05T02:39:04.540546695Z [2024-04-05T02:39:04.540+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:38:00+00:00 exited with status success for try_number 1 2024-04-05T02:39:04.552262641Z [2024-04-05T02:39:04.551+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:38:00+00:00, map_index=-1, run_start_date=2024-04-05 02:39:02.529540+00:00, run_end_date=2024-04-05 02:39:03.264620+00:00, run_duration=0.73508, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1107, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:39:00.443403+00:00, queued_by_job_id=1, pid=16188 2024-04-05T02:39:07.591413263Z [2024-04-05T02:39:07.590+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:39:07.592022230Z [2024-04-05T02:39:07.591+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:38:00+00:00, run_id=scheduled__2024-04-05T02:38:00+00:00, run_start_date=2024-04-05 02:39:00.362476+00:00, run_end_date=2024-04-05 02:39:07.591436+00:00, run_duration=7.22896, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:38:00+00:00, data_interval_end=2024-04-05 02:39:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:39:07.608450949Z [2024-04-05T02:39:07.607+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:39:00+00:00, run_after=2024-04-05T02:40:00+00:00 2024-04-05T02:39:07.659882253Z [2024-04-05T02:39:07.659+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:38:00+00:00 exited with status success for try_number 1 2024-04-05T02:39:07.666603060Z [2024-04-05T02:39:07.666+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:38:00+00:00, map_index=-1, run_start_date=2024-04-05 02:39:04.131767+00:00, run_end_date=2024-04-05 02:39:07.112461+00:00, run_duration=2.980694, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1108, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:39:00.443403+00:00, queued_by_job_id=1, pid=16201 2024-04-05T02:39:09.587801605Z [2024-04-05T02:39:09.587+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:39:09.588119781Z [2024-04-05T02:39:09.587+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:38:00+00:00, run_id=scheduled__2024-04-05T02:38:00+00:00, run_start_date=2024-04-05 02:39:00.363615+00:00, run_end_date=2024-04-05 02:39:09.587752+00:00, run_duration=9.224137, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:38:00+00:00, data_interval_end=2024-04-05 02:39:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:39:09.597760111Z [2024-04-05T02:39:09.597+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:39:00+00:00, run_after=2024-04-05T02:40:00+00:00 2024-04-05T02:39:09.650177081Z [2024-04-05T02:39:09.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:38:00+00:00 exited with status success for try_number 1 2024-04-05T02:39:09.660453614Z [2024-04-05T02:39:09.659+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:38:00+00:00, map_index=-1, run_start_date=2024-04-05 02:39:04.586887+00:00, run_end_date=2024-04-05 02:39:09.328500+00:00, run_duration=4.741613, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1109, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:39:00.443403+00:00, queued_by_job_id=1, pid=16212 2024-04-05T02:40:00.393511342Z [2024-04-05T02:40:00.392+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:40:00.405418895Z [2024-04-05T02:40:00.405+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:40:00.418704566Z [2024-04-05T02:40:00.418+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:40:00+00:00, run_after=2024-04-05T02:41:00+00:00 2024-04-05T02:40:00.433738433Z [2024-04-05T02:40:00.433+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:40:00+00:00, run_after=2024-04-05T02:41:00+00:00 2024-04-05T02:40:00.447924395Z [2024-04-05T02:40:00.447+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:40:00+00:00, run_after=2024-04-05T02:45:00+00:00 2024-04-05T02:40:00.580609245Z [2024-04-05T02:40:00.580+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T02:40:00.580644401Z 2024-04-05T02:40:00.580649880Z 2024-04-05T02:40:00.580660949Z 2024-04-05T02:40:00.580666956Z 2024-04-05T02:40:00.580670183Z 2024-04-05T02:40:00.580705946Z [2024-04-05T02:40:00.580+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:40:00.581011827Z [2024-04-05T02:40:00.580+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:40:00.581112211Z [2024-04-05T02:40:00.580+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:40:00.581282785Z [2024-04-05T02:40:00.581+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:40:00.581364022Z [2024-04-05T02:40:00.581+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:40:00.582012661Z [2024-04-05T02:40:00.581+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:40:00.582024467Z 2024-04-05T02:40:00.582028901Z 2024-04-05T02:40:00.582032445Z 2024-04-05T02:40:00.582035923Z 2024-04-05T02:40:00.582039437Z 2024-04-05T02:40:00.586293367Z [2024-04-05T02:40:00.585+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:40:00.587206129Z [2024-04-05T02:40:00.586+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:40:00.587697324Z [2024-04-05T02:40:00.587+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:38:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:40:00.587926240Z [2024-04-05T02:40:00.587+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:40:00.588236159Z [2024-04-05T02:40:00.588+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:40:00.588446533Z [2024-04-05T02:40:00.588+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:40:00.594172860Z [2024-04-05T02:40:00.593+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:40:00.594497451Z [2024-04-05T02:40:00.594+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:40:00.594887279Z [2024-04-05T02:40:00.594+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:39:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:40:00.595130444Z [2024-04-05T02:40:00.594+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:40:01.300764654Z [2024-04-05T02:40:01.300+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status queued for try_number 1 2024-04-05T02:40:01.301654660Z [2024-04-05T02:40:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:38:00+00:00 exited with status queued for try_number 1 2024-04-05T02:40:01.301734816Z [2024-04-05T02:40:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:39:00+00:00 exited with status queued for try_number 1 2024-04-05T02:40:01.301930749Z [2024-04-05T02:40:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:39:00+00:00 exited with status queued for try_number 1 2024-04-05T02:40:01.302162737Z [2024-04-05T02:40:01.301+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:39:00+00:00 exited with status queued for try_number 1 2024-04-05T02:40:01.317892703Z [2024-04-05T02:40:01.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to fde20a21-d0b4-4ba7-9a86-5fdf241c1019 2024-04-05T02:40:01.317958919Z [2024-04-05T02:40:01.317+0000] {scheduler_job.py:635} INFO - Setting external_id for to 28e9bb9a-d33c-4a2a-9b0a-bbd1f98cadab 2024-04-05T02:40:01.318168257Z [2024-04-05T02:40:01.318+0000] {scheduler_job.py:635} INFO - Setting external_id for to 856f671f-ff21-4bfd-954f-0ac404be7d37 2024-04-05T02:40:01.318331284Z [2024-04-05T02:40:01.318+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ba90da2-3a78-47fe-87fb-1234a03c09e9 2024-04-05T02:40:01.318509191Z [2024-04-05T02:40:01.318+0000] {scheduler_job.py:635} INFO - Setting external_id for to c7a1dedc-e22f-4cdd-a984-e8fac87da432 2024-04-05T02:40:03.917665176Z [2024-04-05T02:40:03.917+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:40:03.918142913Z [2024-04-05T02:40:03.917+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:38:00+00:00, run_id=scheduled__2024-04-05T02:38:00+00:00, run_start_date=2024-04-05 02:40:00.462405+00:00, run_end_date=2024-04-05 02:40:03.917693+00:00, run_duration=3.455288, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:38:00+00:00, data_interval_end=2024-04-05 02:40:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:40:03.937731502Z [2024-04-05T02:40:03.937+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:40:00+00:00, run_after=2024-04-05T02:42:00+00:00 2024-04-05T02:40:03.961460312Z [2024-04-05T02:40:03.960+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:40:03.961802200Z [2024-04-05T02:40:03.961+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:39:00+00:00, run_id=scheduled__2024-04-05T02:39:00+00:00, run_start_date=2024-04-05 02:40:00.463450+00:00, run_end_date=2024-04-05 02:40:03.961487+00:00, run_duration=3.498037, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:39:00+00:00, data_interval_end=2024-04-05 02:40:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:40:03.986427604Z [2024-04-05T02:40:03.985+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:40:00+00:00, run_after=2024-04-05T02:41:00+00:00 2024-04-05T02:40:04.172779128Z [2024-04-05T02:40:04.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:38:00+00:00 exited with status success for try_number 1 2024-04-05T02:40:04.174160747Z [2024-04-05T02:40:04.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:39:00+00:00 exited with status success for try_number 1 2024-04-05T02:40:04.187386272Z [2024-04-05T02:40:04.186+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:38:00+00:00, map_index=-1, run_start_date=2024-04-05 02:40:02.339111+00:00, run_end_date=2024-04-05 02:40:03.231590+00:00, run_duration=0.892479, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1110, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:40:00.583051+00:00, queued_by_job_id=1, pid=16241 2024-04-05T02:40:04.188588883Z [2024-04-05T02:40:04.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:39:00+00:00, map_index=-1, run_start_date=2024-04-05 02:40:02.924475+00:00, run_end_date=2024-04-05 02:40:03.521429+00:00, run_duration=0.596954, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1111, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:40:00.583051+00:00, queued_by_job_id=1, pid=16243 2024-04-05T02:40:05.631486162Z [2024-04-05T02:40:05.630+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:40:05.631794131Z [2024-04-05T02:40:05.631+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:39:00+00:00, run_id=scheduled__2024-04-05T02:39:00+00:00, run_start_date=2024-04-05 02:40:00.464582+00:00, run_end_date=2024-04-05 02:40:05.631006+00:00, run_duration=5.166424, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:39:00+00:00, data_interval_end=2024-04-05 02:40:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:40:05.649918946Z [2024-04-05T02:40:05.649+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:40:00+00:00, run_after=2024-04-05T02:41:00+00:00 2024-04-05T02:40:05.701106991Z [2024-04-05T02:40:05.700+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:40:05.701141216Z 2024-04-05T02:40:05.701389917Z [2024-04-05T02:40:05.701+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:40:05.702160681Z [2024-04-05T02:40:05.701+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:40:05.702175373Z 2024-04-05T02:40:05.707509920Z [2024-04-05T02:40:05.707+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:40:05.710643442Z [2024-04-05T02:40:05.707+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:40:05.879776661Z [2024-04-05T02:40:05.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status queued for try_number 1 2024-04-05T02:40:05.879873250Z [2024-04-05T02:40:05.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status success for try_number 1 2024-04-05T02:40:05.880182817Z [2024-04-05T02:40:05.879+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:39:00+00:00 exited with status success for try_number 1 2024-04-05T02:40:05.922349320Z [2024-04-05T02:40:05.919+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1be2e42b-5b22-4ece-817f-9a4b5d283e7c 2024-04-05T02:40:05.922377523Z [2024-04-05T02:40:05.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:35:00+00:00, map_index=-1, run_start_date=2024-04-05 02:40:04.760040+00:00, run_end_date=2024-04-05 02:40:05.212279+00:00, run_duration=0.452239, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1114, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:40:00.583051+00:00, queued_by_job_id=1, pid=16283 2024-04-05T02:40:05.922381854Z [2024-04-05T02:40:05.919+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:39:00+00:00, map_index=-1, run_start_date=2024-04-05 02:40:04.229279+00:00, run_end_date=2024-04-05 02:40:05.569637+00:00, run_duration=1.340358, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1113, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:40:00.583051+00:00, queued_by_job_id=1, pid=16267 2024-04-05T02:40:05.971199596Z [2024-04-05T02:40:05.970+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:40:05.971823892Z [2024-04-05T02:40:05.971+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:39:00+00:00, run_id=scheduled__2024-04-05T02:39:00+00:00, run_start_date=2024-04-05 02:40:00.465969+00:00, run_end_date=2024-04-05 02:40:05.971364+00:00, run_duration=5.505395, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:39:00+00:00, data_interval_end=2024-04-05 02:40:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:40:05.983199314Z [2024-04-05T02:40:05.982+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:40:00+00:00, run_after=2024-04-05T02:41:00+00:00 2024-04-05T02:40:06.788328569Z [2024-04-05T02:40:06.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:39:00+00:00 exited with status success for try_number 1 2024-04-05T02:40:06.795708446Z [2024-04-05T02:40:06.795+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:39:00+00:00, map_index=-1, run_start_date=2024-04-05 02:40:03.903109+00:00, run_end_date=2024-04-05 02:40:05.872758+00:00, run_duration=1.969649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1112, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:40:00.583051+00:00, queued_by_job_id=1, pid=16266 2024-04-05T02:40:09.146891663Z [2024-04-05T02:40:09.146+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:40:09.146930364Z 2024-04-05T02:40:09.147084799Z [2024-04-05T02:40:09.146+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:40:09.148017662Z [2024-04-05T02:40:09.147+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:40:09.148037425Z 2024-04-05T02:40:09.152697173Z [2024-04-05T02:40:09.152+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:35:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:40:09.153040884Z [2024-04-05T02:40:09.152+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:40:09.213621816Z [2024-04-05T02:40:09.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status queued for try_number 1 2024-04-05T02:40:09.214123437Z [2024-04-05T02:40:09.213+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status success for try_number 1 2024-04-05T02:40:09.225880600Z [2024-04-05T02:40:09.225+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6179c393-e296-4398-8d87-4f71b5e2867e 2024-04-05T02:40:09.226332432Z [2024-04-05T02:40:09.226+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T02:35:00+00:00, map_index=-1, run_start_date=2024-04-05 02:40:07.649559+00:00, run_end_date=2024-04-05 02:40:08.097956+00:00, run_duration=0.448397, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1115, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:40:05.702706+00:00, queued_by_job_id=1, pid=16296 2024-04-05T02:40:11.880846625Z [2024-04-05T02:40:11.880+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:40:11.880885359Z 2024-04-05T02:40:11.881168215Z [2024-04-05T02:40:11.880+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:40:11.882321949Z [2024-04-05T02:40:11.882+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:40:11.882341161Z 2024-04-05T02:40:11.885933444Z [2024-04-05T02:40:11.885+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:35:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:40:11.886463663Z [2024-04-05T02:40:11.885+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:40:11.944793469Z [2024-04-05T02:40:11.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status queued for try_number 1 2024-04-05T02:40:11.945212763Z [2024-04-05T02:40:11.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status success for try_number 1 2024-04-05T02:40:11.954206828Z [2024-04-05T02:40:11.953+0000] {scheduler_job.py:635} INFO - Setting external_id for to c67c9487-0b50-4427-ae9c-7c4216cbe90f 2024-04-05T02:40:11.954756946Z [2024-04-05T02:40:11.954+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:35:00+00:00, map_index=0, run_start_date=2024-04-05 02:40:11.191122+00:00, run_end_date=2024-04-05 02:40:11.617806+00:00, run_duration=0.426684, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1116, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:40:09.148558+00:00, queued_by_job_id=1, pid=16314 2024-04-05T02:40:14.712224474Z [2024-04-05T02:40:14.711+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:40:14.712719351Z [2024-04-05T02:40:14.712+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:35:00+00:00, run_id=scheduled__2024-04-05T02:35:00+00:00, run_start_date=2024-04-05 02:40:00.461153+00:00, run_end_date=2024-04-05 02:40:14.712114+00:00, run_duration=14.250961, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:35:00+00:00, data_interval_end=2024-04-05 02:40:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T02:40:14.721869290Z [2024-04-05T02:40:14.721+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:40:00+00:00, run_after=2024-04-05T02:45:00+00:00 2024-04-05T02:40:14.756278913Z [2024-04-05T02:40:14.755+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:35:00+00:00 exited with status success for try_number 1 2024-04-05T02:40:14.761895658Z [2024-04-05T02:40:14.761+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:35:00+00:00, map_index=-1, run_start_date=2024-04-05 02:40:13.844006+00:00, run_end_date=2024-04-05 02:40:14.188139+00:00, run_duration=0.344133, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1117, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:40:11.882837+00:00, queued_by_job_id=1, pid=16325 2024-04-05T02:40:42.186536029Z [2024-04-05T02:40:42.186+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:40:54.891698377Z [2024-04-05T02:40:54.891+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:40:54.891738668Z 2024-04-05T02:40:54.892030882Z [2024-04-05T02:40:54.891+0000] {scheduler_job.py:425} INFO - DAG vdu_alarm has 0/16 running and queued tasks 2024-04-05T02:40:54.893051323Z [2024-04-05T02:40:54.892+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:40:54.893070200Z 2024-04-05T02:40:54.896166616Z [2024-04-05T02:40:54.895+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vdu_alarm', task_id='main_task', run_id='vdu_alarm_20240405024053_718358', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:40:54.896415680Z [2024-04-05T02:40:54.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240405024053_718358', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-05T02:40:54.945223021Z [2024-04-05T02:40:54.944+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240405024053_718358 exited with status queued for try_number 1 2024-04-05T02:40:54.949934328Z [2024-04-05T02:40:54.949+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1baeeccf-2fb9-49e5-acf9-5e9ebcbe9ef0 2024-04-05T02:40:56.399690344Z [2024-04-05T02:40:56.395+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:40:56.399732279Z [2024-04-05T02:40:56.396+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vdu_alarm, execution_date=2024-04-05 02:40:54.097778+00:00, run_id=vdu_alarm_20240405024053_718358, run_start_date=2024-04-05 02:40:54.856062+00:00, run_end_date=2024-04-05 02:40:56.396236+00:00, run_duration=1.540174, state=success, external_trigger=True, run_type=manual, data_interval_start=2024-04-05 02:40:54.097778+00:00, data_interval_end=2024-04-05 02:40:54.097778+00:00, dag_hash=4c7a7f623757a362f63c388cf0edb231 2024-04-05T02:40:56.400770786Z [2024-04-05T02:40:56.399+0000] {dag.py:3452} INFO - Setting next_dagrun for vdu_alarm to None, run_after=None 2024-04-05T02:40:56.432261032Z [2024-04-05T02:40:56.431+0000] {scheduler_job.py:602} INFO - Executor reports execution of vdu_alarm.main_task run_id=vdu_alarm_20240405024053_718358 exited with status success for try_number 1 2024-04-05T02:40:56.440203174Z [2024-04-05T02:40:56.439+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vdu_alarm, task_id=main_task, run_id=vdu_alarm_20240405024053_718358, map_index=-1, run_start_date=2024-04-05 02:40:55.543034+00:00, run_end_date=2024-04-05 02:40:55.859448+00:00, run_duration=0.316414, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1118, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:40:54.893643+00:00, queued_by_job_id=1, pid=16327 2024-04-05T02:41:00.356903774Z [2024-04-05T02:41:00.356+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:41:00+00:00, run_after=2024-04-05T02:42:00+00:00 2024-04-05T02:41:00.370447873Z [2024-04-05T02:41:00.370+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:41:00.387069366Z [2024-04-05T02:41:00.386+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:41:00+00:00, run_after=2024-04-05T02:42:00+00:00 2024-04-05T02:41:00.458232836Z [2024-04-05T02:41:00.457+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:41:00.458264720Z 2024-04-05T02:41:00.458269843Z 2024-04-05T02:41:00.458274234Z 2024-04-05T02:41:00.458605635Z [2024-04-05T02:41:00.458+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:41:00.458798269Z [2024-04-05T02:41:00.458+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:41:00.459031063Z [2024-04-05T02:41:00.458+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:41:00.459948847Z [2024-04-05T02:41:00.459+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:41:00.459973508Z 2024-04-05T02:41:00.459977361Z 2024-04-05T02:41:00.459980697Z 2024-04-05T02:41:00.463782062Z [2024-04-05T02:41:00.463+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:41:00.463969027Z [2024-04-05T02:41:00.463+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:41:00.464281160Z [2024-04-05T02:41:00.464+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:41:00.464450245Z [2024-04-05T02:41:00.464+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:41:00.464670000Z [2024-04-05T02:41:00.464+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:41:00.464887182Z [2024-04-05T02:41:00.464+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:41:00.788562483Z [2024-04-05T02:41:00.787+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status queued for try_number 1 2024-04-05T02:41:00.788708146Z [2024-04-05T02:41:00.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status queued for try_number 1 2024-04-05T02:41:00.788839799Z [2024-04-05T02:41:00.788+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status queued for try_number 1 2024-04-05T02:41:00.803659152Z [2024-04-05T02:41:00.803+0000] {scheduler_job.py:635} INFO - Setting external_id for to e3cf3109-f2a0-4f2d-90cf-3056e47f2ffc 2024-04-05T02:41:00.808116951Z [2024-04-05T02:41:00.807+0000] {scheduler_job.py:635} INFO - Setting external_id for to 889f928e-251f-407e-888d-10d590510b62 2024-04-05T02:41:00.808356767Z [2024-04-05T02:41:00.808+0000] {scheduler_job.py:635} INFO - Setting external_id for to ad648974-169d-46d9-acd6-80bc824b7ea5 2024-04-05T02:41:03.361707672Z [2024-04-05T02:41:03.361+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:41:03.363527312Z [2024-04-05T02:41:03.363+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:40:00+00:00, run_id=scheduled__2024-04-05T02:40:00+00:00, run_start_date=2024-04-05 02:41:00.398576+00:00, run_end_date=2024-04-05 02:41:03.362118+00:00, run_duration=2.963542, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:40:00+00:00, data_interval_end=2024-04-05 02:41:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:41:03.391389090Z [2024-04-05T02:41:03.390+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:41:00+00:00, run_after=2024-04-05T02:42:00+00:00 2024-04-05T02:41:03.468617525Z [2024-04-05T02:41:03.468+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status success for try_number 1 2024-04-05T02:41:03.478853350Z [2024-04-05T02:41:03.478+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:40:00+00:00, map_index=-1, run_start_date=2024-04-05 02:41:02.316052+00:00, run_end_date=2024-04-05 02:41:02.988888+00:00, run_duration=0.672836, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1119, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:41:00.460964+00:00, queued_by_job_id=1, pid=16342 2024-04-05T02:41:05.901655287Z [2024-04-05T02:41:05.901+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:41:05.905656531Z [2024-04-05T02:41:05.905+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:40:00+00:00, run_id=scheduled__2024-04-05T02:40:00+00:00, run_start_date=2024-04-05 02:41:00.400055+00:00, run_end_date=2024-04-05 02:41:05.901597+00:00, run_duration=5.501542, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:40:00+00:00, data_interval_end=2024-04-05 02:41:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:41:05.922051922Z [2024-04-05T02:41:05.921+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:41:00+00:00, run_after=2024-04-05T02:42:00+00:00 2024-04-05T02:41:05.978009175Z [2024-04-05T02:41:05.977+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status success for try_number 1 2024-04-05T02:41:05.985141765Z [2024-04-05T02:41:05.984+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:40:00+00:00, map_index=-1, run_start_date=2024-04-05 02:41:03.803560+00:00, run_end_date=2024-04-05 02:41:05.813481+00:00, run_duration=2.009921, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1121, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:41:00.460964+00:00, queued_by_job_id=1, pid=16365 2024-04-05T02:41:07.036642163Z [2024-04-05T02:41:07.036+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:41:07.037107843Z [2024-04-05T02:41:07.036+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:40:00+00:00, run_id=scheduled__2024-04-05T02:40:00+00:00, run_start_date=2024-04-05 02:41:00.401353+00:00, run_end_date=2024-04-05 02:41:07.036548+00:00, run_duration=6.635195, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:40:00+00:00, data_interval_end=2024-04-05 02:41:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:41:07.049566219Z [2024-04-05T02:41:07.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:41:00+00:00, run_after=2024-04-05T02:42:00+00:00 2024-04-05T02:41:07.085079769Z [2024-04-05T02:41:07.084+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status success for try_number 1 2024-04-05T02:41:07.090782097Z [2024-04-05T02:41:07.090+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:40:00+00:00, map_index=-1, run_start_date=2024-04-05 02:41:03.437747+00:00, run_end_date=2024-04-05 02:41:05.919633+00:00, run_duration=2.481886, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1120, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:41:00.460964+00:00, queued_by_job_id=1, pid=16354 2024-04-05T02:42:00.715548349Z [2024-04-05T02:42:00.715+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:42:00.743305346Z [2024-04-05T02:42:00.742+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:42:00+00:00, run_after=2024-04-05T02:43:00+00:00 2024-04-05T02:42:00.767530813Z [2024-04-05T02:42:00.766+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:42:00+00:00, run_after=2024-04-05T02:43:00+00:00 2024-04-05T02:42:00.780588304Z [2024-04-05T02:42:00.780+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:42:00.914582466Z [2024-04-05T02:42:00.914+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:42:00.914612439Z 2024-04-05T02:42:00.914624453Z 2024-04-05T02:42:00.914629108Z 2024-04-05T02:42:00.914633996Z 2024-04-05T02:42:00.914945667Z [2024-04-05T02:42:00.914+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:42:00.916052191Z [2024-04-05T02:42:00.915+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:42:00.916414993Z [2024-04-05T02:42:00.916+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:42:00.916791853Z [2024-04-05T02:42:00.916+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:42:00.917802038Z [2024-04-05T02:42:00.917+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:42:00.917820261Z 2024-04-05T02:42:00.917825838Z 2024-04-05T02:42:00.917830533Z 2024-04-05T02:42:00.917835267Z 2024-04-05T02:42:00.924930743Z [2024-04-05T02:42:00.924+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:42:00.925304823Z [2024-04-05T02:42:00.925+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:42:00.925731672Z [2024-04-05T02:42:00.925+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:42:00.926018678Z [2024-04-05T02:42:00.925+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:42:00.926524762Z [2024-04-05T02:42:00.926+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:42:00.926783391Z [2024-04-05T02:42:00.926+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:42:00.927200632Z [2024-04-05T02:42:00.926+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:41:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:42:00.927537757Z [2024-04-05T02:42:00.927+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:42:01.713281307Z [2024-04-05T02:42:01.712+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status queued for try_number 1 2024-04-05T02:42:01.713446961Z [2024-04-05T02:42:01.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:41:00+00:00 exited with status queued for try_number 1 2024-04-05T02:42:01.713621556Z [2024-04-05T02:42:01.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:41:00+00:00 exited with status queued for try_number 1 2024-04-05T02:42:01.713737195Z [2024-04-05T02:42:01.713+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:41:00+00:00 exited with status queued for try_number 1 2024-04-05T02:42:01.741544753Z [2024-04-05T02:42:01.740+0000] {scheduler_job.py:635} INFO - Setting external_id for to b9875f58-91a9-4d94-be01-7b6d0291800b 2024-04-05T02:42:01.741742455Z [2024-04-05T02:42:01.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 7869efeb-5e24-4304-92b5-5a5a8df6275d 2024-04-05T02:42:01.741943463Z [2024-04-05T02:42:01.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2c0616e0-2607-4763-b899-369011a7d3ed 2024-04-05T02:42:01.742218671Z [2024-04-05T02:42:01.741+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1a3f8025-7b68-4ea9-9d52-bdd9f02d43e1 2024-04-05T02:42:04.366675050Z [2024-04-05T02:42:04.366+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:42:04.367092188Z [2024-04-05T02:42:04.366+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:40:00+00:00, run_id=scheduled__2024-04-05T02:40:00+00:00, run_start_date=2024-04-05 02:42:00.799954+00:00, run_end_date=2024-04-05 02:42:04.366553+00:00, run_duration=3.566599, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:40:00+00:00, data_interval_end=2024-04-05 02:42:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:42:04.378369062Z [2024-04-05T02:42:04.377+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:42:00+00:00, run_after=2024-04-05T02:44:00+00:00 2024-04-05T02:42:04.400578396Z [2024-04-05T02:42:04.400+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:42:04.400994851Z [2024-04-05T02:42:04.400+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:41:00+00:00, run_id=scheduled__2024-04-05T02:41:00+00:00, run_start_date=2024-04-05 02:42:00.802459+00:00, run_end_date=2024-04-05 02:42:04.400457+00:00, run_duration=3.597998, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:41:00+00:00, data_interval_end=2024-04-05 02:42:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:42:04.415993540Z [2024-04-05T02:42:04.415+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:42:00+00:00, run_after=2024-04-05T02:43:00+00:00 2024-04-05T02:42:04.483394936Z [2024-04-05T02:42:04.482+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status success for try_number 1 2024-04-05T02:42:04.487537788Z [2024-04-05T02:42:04.483+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:41:00+00:00 exited with status success for try_number 1 2024-04-05T02:42:04.505005246Z [2024-04-05T02:42:04.503+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:41:00+00:00, map_index=-1, run_start_date=2024-04-05 02:42:02.641967+00:00, run_end_date=2024-04-05 02:42:03.184174+00:00, run_duration=0.542207, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1123, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:42:00.919341+00:00, queued_by_job_id=1, pid=16394 2024-04-05T02:42:04.505626687Z [2024-04-05T02:42:04.505+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:40:00+00:00, map_index=-1, run_start_date=2024-04-05 02:42:02.554479+00:00, run_end_date=2024-04-05 02:42:03.149195+00:00, run_duration=0.594716, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1122, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:42:00.919341+00:00, queued_by_job_id=1, pid=16393 2024-04-05T02:42:06.643366593Z [2024-04-05T02:42:06.642+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:42:06.643472706Z [2024-04-05T02:42:06.643+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:41:00+00:00, run_id=scheduled__2024-04-05T02:41:00+00:00, run_start_date=2024-04-05 02:42:00.807277+00:00, run_end_date=2024-04-05 02:42:06.643083+00:00, run_duration=5.835806, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:41:00+00:00, data_interval_end=2024-04-05 02:42:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:42:06.654311848Z [2024-04-05T02:42:06.653+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:42:00+00:00, run_after=2024-04-05T02:43:00+00:00 2024-04-05T02:42:06.707349810Z [2024-04-05T02:42:06.706+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:41:00+00:00 exited with status success for try_number 1 2024-04-05T02:42:06.713194315Z [2024-04-05T02:42:06.712+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:41:00+00:00, map_index=-1, run_start_date=2024-04-05 02:42:04.103520+00:00, run_end_date=2024-04-05 02:42:06.365373+00:00, run_duration=2.261853, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1124, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:42:00.919341+00:00, queued_by_job_id=1, pid=16412 2024-04-05T02:42:07.338960602Z [2024-04-05T02:42:07.338+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:42:07.339291252Z [2024-04-05T02:42:07.339+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:41:00+00:00, run_id=scheduled__2024-04-05T02:41:00+00:00, run_start_date=2024-04-05 02:42:00.804973+00:00, run_end_date=2024-04-05 02:42:07.338842+00:00, run_duration=6.533869, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:41:00+00:00, data_interval_end=2024-04-05 02:42:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:42:07.349433478Z [2024-04-05T02:42:07.349+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:42:00+00:00, run_after=2024-04-05T02:43:00+00:00 2024-04-05T02:42:07.385641969Z [2024-04-05T02:42:07.385+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:41:00+00:00 exited with status success for try_number 1 2024-04-05T02:42:07.391619677Z [2024-04-05T02:42:07.391+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:41:00+00:00, map_index=-1, run_start_date=2024-04-05 02:42:04.554068+00:00, run_end_date=2024-04-05 02:42:06.903681+00:00, run_duration=2.349613, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1125, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:42:00.919341+00:00, queued_by_job_id=1, pid=16423 2024-04-05T02:43:00.068875408Z [2024-04-05T02:43:00.068+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:43:00+00:00, run_after=2024-04-05T02:44:00+00:00 2024-04-05T02:43:00.085158064Z [2024-04-05T02:43:00.084+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:43:00.109720935Z [2024-04-05T02:43:00.109+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:43:00+00:00, run_after=2024-04-05T02:44:00+00:00 2024-04-05T02:43:00.184013462Z [2024-04-05T02:43:00.183+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:43:00.184039292Z 2024-04-05T02:43:00.184044237Z 2024-04-05T02:43:00.184048117Z 2024-04-05T02:43:00.184263734Z [2024-04-05T02:43:00.184+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:43:00.184526878Z [2024-04-05T02:43:00.184+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:43:00.184918839Z [2024-04-05T02:43:00.184+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:43:00.186482902Z [2024-04-05T02:43:00.186+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:43:00.186510280Z 2024-04-05T02:43:00.186514534Z 2024-04-05T02:43:00.186518700Z 2024-04-05T02:43:00.192461315Z [2024-04-05T02:43:00.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:43:00.192608290Z [2024-04-05T02:43:00.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:43:00.192894424Z [2024-04-05T02:43:00.192+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:43:00.193024944Z [2024-04-05T02:43:00.192+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:43:00.193224999Z [2024-04-05T02:43:00.193+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:43:00.193410652Z [2024-04-05T02:43:00.193+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:43:00.463855237Z [2024-04-05T02:43:00.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:42:00+00:00 exited with status queued for try_number 1 2024-04-05T02:43:00.464204542Z [2024-04-05T02:43:00.463+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:42:00+00:00 exited with status queued for try_number 1 2024-04-05T02:43:00.464519768Z [2024-04-05T02:43:00.464+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:42:00+00:00 exited with status queued for try_number 1 2024-04-05T02:43:00.479082562Z [2024-04-05T02:43:00.478+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0e2e15ab-162c-46f9-8664-6424a2aa4c87 2024-04-05T02:43:00.479511606Z [2024-04-05T02:43:00.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to b6f53549-99d8-4822-bb54-f1270cd3c14d 2024-04-05T02:43:00.479790206Z [2024-04-05T02:43:00.479+0000] {scheduler_job.py:635} INFO - Setting external_id for to 041c0196-ce37-406b-82e4-8965fde58cfd 2024-04-05T02:43:02.738947117Z [2024-04-05T02:43:02.738+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:43:02.739784847Z [2024-04-05T02:43:02.739+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:42:00+00:00, run_id=scheduled__2024-04-05T02:42:00+00:00, run_start_date=2024-04-05 02:43:00.127969+00:00, run_end_date=2024-04-05 02:43:02.739099+00:00, run_duration=2.61113, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:42:00+00:00, data_interval_end=2024-04-05 02:43:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:43:02.756440823Z [2024-04-05T02:43:02.756+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:43:00+00:00, run_after=2024-04-05T02:44:00+00:00 2024-04-05T02:43:02.821436301Z [2024-04-05T02:43:02.820+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:42:00+00:00 exited with status success for try_number 1 2024-04-05T02:43:02.830687679Z [2024-04-05T02:43:02.830+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:42:00+00:00, map_index=-1, run_start_date=2024-04-05 02:43:01.749654+00:00, run_end_date=2024-04-05 02:43:02.522198+00:00, run_duration=0.772544, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1126, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:43:00.188358+00:00, queued_by_job_id=1, pid=16450 2024-04-05T02:43:06.138800744Z [2024-04-05T02:43:06.138+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:43:06.139198313Z [2024-04-05T02:43:06.138+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:42:00+00:00, run_id=scheduled__2024-04-05T02:42:00+00:00, run_start_date=2024-04-05 02:43:00.130427+00:00, run_end_date=2024-04-05 02:43:06.138702+00:00, run_duration=6.008275, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:42:00+00:00, data_interval_end=2024-04-05 02:43:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:43:06.154660248Z [2024-04-05T02:43:06.154+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:43:00+00:00, run_after=2024-04-05T02:44:00+00:00 2024-04-05T02:43:06.161506901Z [2024-04-05T02:43:06.161+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:43:06.161634308Z [2024-04-05T02:43:06.161+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:42:00+00:00, run_id=scheduled__2024-04-05T02:42:00+00:00, run_start_date=2024-04-05 02:43:00.132945+00:00, run_end_date=2024-04-05 02:43:06.161373+00:00, run_duration=6.028428, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:42:00+00:00, data_interval_end=2024-04-05 02:43:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:43:06.170236859Z [2024-04-05T02:43:06.169+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:43:00+00:00, run_after=2024-04-05T02:44:00+00:00 2024-04-05T02:43:06.202690943Z [2024-04-05T02:43:06.201+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:42:00+00:00 exited with status success for try_number 1 2024-04-05T02:43:06.206622649Z [2024-04-05T02:43:06.206+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:42:00+00:00, map_index=-1, run_start_date=2024-04-05 02:43:03.485678+00:00, run_end_date=2024-04-05 02:43:05.102880+00:00, run_duration=1.617202, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1127, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:43:00.188358+00:00, queued_by_job_id=1, pid=16463 2024-04-05T02:43:07.277700941Z [2024-04-05T02:43:07.277+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:42:00+00:00 exited with status success for try_number 1 2024-04-05T02:43:07.283973817Z [2024-04-05T02:43:07.282+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:42:00+00:00, map_index=-1, run_start_date=2024-04-05 02:43:03.812941+00:00, run_end_date=2024-04-05 02:43:06.073521+00:00, run_duration=2.26058, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1128, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:43:00.188358+00:00, queued_by_job_id=1, pid=16469 2024-04-05T02:44:00.774701737Z [2024-04-05T02:44:00.774+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:44:00+00:00, run_after=2024-04-05T02:45:00+00:00 2024-04-05T02:44:00.783429773Z [2024-04-05T02:44:00.783+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:44:00.791182715Z [2024-04-05T02:44:00.790+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:44:00.806571993Z [2024-04-05T02:44:00.806+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:44:00+00:00, run_after=2024-04-05T02:45:00+00:00 2024-04-05T02:44:00.889496346Z [2024-04-05T02:44:00.889+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:44:00.889523729Z 2024-04-05T02:44:00.889528013Z 2024-04-05T02:44:00.889531596Z 2024-04-05T02:44:00.889534945Z 2024-04-05T02:44:00.889551766Z [2024-04-05T02:44:00.889+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:44:00.889723898Z [2024-04-05T02:44:00.889+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:44:00.889851556Z [2024-04-05T02:44:00.889+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:44:00.890007581Z [2024-04-05T02:44:00.889+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:44:00.890670175Z [2024-04-05T02:44:00.890+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:44:00.890700377Z 2024-04-05T02:44:00.890705188Z 2024-04-05T02:44:00.890708480Z 2024-04-05T02:44:00.890711574Z 2024-04-05T02:44:00.894706045Z [2024-04-05T02:44:00.894+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:42:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:44:00.895267057Z [2024-04-05T02:44:00.894+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:44:00.895436610Z [2024-04-05T02:44:00.895+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:44:00.895783244Z [2024-04-05T02:44:00.895+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:44:00.896040519Z [2024-04-05T02:44:00.895+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:44:00.896233950Z [2024-04-05T02:44:00.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:44:00.896662683Z [2024-04-05T02:44:00.896+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:43:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:44:00.896933150Z [2024-04-05T02:44:00.896+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:44:01.679028573Z [2024-04-05T02:44:01.676+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:42:00+00:00 exited with status queued for try_number 1 2024-04-05T02:44:01.679459842Z [2024-04-05T02:44:01.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:43:00+00:00 exited with status queued for try_number 1 2024-04-05T02:44:01.679759436Z [2024-04-05T02:44:01.679+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:43:00+00:00 exited with status queued for try_number 1 2024-04-05T02:44:01.681677633Z [2024-04-05T02:44:01.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:43:00+00:00 exited with status queued for try_number 1 2024-04-05T02:44:01.706333455Z [2024-04-05T02:44:01.705+0000] {scheduler_job.py:635} INFO - Setting external_id for to 061f5f89-cb80-4e43-838d-0e35aa29c5e6 2024-04-05T02:44:01.706932902Z [2024-04-05T02:44:01.706+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1ad456fd-0ae0-48ba-93f7-5b864dd08aa3 2024-04-05T02:44:01.707256757Z [2024-04-05T02:44:01.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to 423a703e-ae4b-493f-aaa0-c3eda9ea54ae 2024-04-05T02:44:01.707761899Z [2024-04-05T02:44:01.707+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4bbbcbc6-95e1-4d66-9698-e0d10e68d50c 2024-04-05T02:44:03.769793166Z [2024-04-05T02:44:03.769+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:44:03.770682318Z [2024-04-05T02:44:03.770+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:42:00+00:00, run_id=scheduled__2024-04-05T02:42:00+00:00, run_start_date=2024-04-05 02:44:00.819002+00:00, run_end_date=2024-04-05 02:44:03.769964+00:00, run_duration=2.950962, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:42:00+00:00, data_interval_end=2024-04-05 02:44:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:44:03.786115956Z [2024-04-05T02:44:03.785+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:44:00+00:00, run_after=2024-04-05T02:46:00+00:00 2024-04-05T02:44:03.799704469Z [2024-04-05T02:44:03.799+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:44:03.800608781Z [2024-04-05T02:44:03.800+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:43:00+00:00, run_id=scheduled__2024-04-05T02:43:00+00:00, run_start_date=2024-04-05 02:44:00.820476+00:00, run_end_date=2024-04-05 02:44:03.799882+00:00, run_duration=2.979406, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:43:00+00:00, data_interval_end=2024-04-05 02:44:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:44:03.823157412Z [2024-04-05T02:44:03.822+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:44:00+00:00, run_after=2024-04-05T02:45:00+00:00 2024-04-05T02:44:03.902916870Z [2024-04-05T02:44:03.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:42:00+00:00 exited with status success for try_number 1 2024-04-05T02:44:03.902946180Z [2024-04-05T02:44:03.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:43:00+00:00 exited with status success for try_number 1 2024-04-05T02:44:03.916146810Z [2024-04-05T02:44:03.915+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:43:00+00:00, map_index=-1, run_start_date=2024-04-05 02:44:02.664246+00:00, run_end_date=2024-04-05 02:44:03.430622+00:00, run_duration=0.766376, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1129, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:44:00.891690+00:00, queued_by_job_id=1, pid=16503 2024-04-05T02:44:03.916365424Z [2024-04-05T02:44:03.916+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:42:00+00:00, map_index=-1, run_start_date=2024-04-05 02:44:02.773276+00:00, run_end_date=2024-04-05 02:44:03.527346+00:00, run_duration=0.75407, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1130, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:44:00.891690+00:00, queued_by_job_id=1, pid=16505 2024-04-05T02:44:07.270636644Z [2024-04-05T02:44:07.270+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:44:07.270913212Z [2024-04-05T02:44:07.270+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:43:00+00:00, run_id=scheduled__2024-04-05T02:43:00+00:00, run_start_date=2024-04-05 02:44:00.822170+00:00, run_end_date=2024-04-05 02:44:07.270503+00:00, run_duration=6.448333, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:43:00+00:00, data_interval_end=2024-04-05 02:44:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:44:07.286014354Z [2024-04-05T02:44:07.285+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:44:00+00:00, run_after=2024-04-05T02:45:00+00:00 2024-04-05T02:44:07.296916637Z [2024-04-05T02:44:07.296+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:44:07.297228849Z [2024-04-05T02:44:07.296+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:43:00+00:00, run_id=scheduled__2024-04-05T02:43:00+00:00, run_start_date=2024-04-05 02:44:00.823320+00:00, run_end_date=2024-04-05 02:44:07.296767+00:00, run_duration=6.473447, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:43:00+00:00, data_interval_end=2024-04-05 02:44:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:44:07.307478956Z [2024-04-05T02:44:07.307+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:44:00+00:00, run_after=2024-04-05T02:45:00+00:00 2024-04-05T02:44:07.338983084Z [2024-04-05T02:44:07.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:43:00+00:00 exited with status success for try_number 1 2024-04-05T02:44:07.339041404Z [2024-04-05T02:44:07.338+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:43:00+00:00 exited with status success for try_number 1 2024-04-05T02:44:07.349858346Z [2024-04-05T02:44:07.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:43:00+00:00, map_index=-1, run_start_date=2024-04-05 02:44:03.992852+00:00, run_end_date=2024-04-05 02:44:06.264996+00:00, run_duration=2.272144, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1131, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:44:00.891690+00:00, queued_by_job_id=1, pid=16526 2024-04-05T02:44:07.350109659Z [2024-04-05T02:44:07.349+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:43:00+00:00, map_index=-1, run_start_date=2024-04-05 02:44:04.097833+00:00, run_end_date=2024-04-05 02:44:07.122750+00:00, run_duration=3.024917, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1132, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:44:00.891690+00:00, queued_by_job_id=1, pid=16527 2024-04-05T02:45:00.821303934Z [2024-04-05T02:45:00.820+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:45:00+00:00, run_after=2024-04-05T02:46:00+00:00 2024-04-05T02:45:00.837033375Z [2024-04-05T02:45:00.836+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:45:00+00:00, run_after=2024-04-05T02:50:00+00:00 2024-04-05T02:45:00.845431875Z [2024-04-05T02:45:00.845+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:45:00.860272009Z [2024-04-05T02:45:00.859+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:45:00+00:00, run_after=2024-04-05T02:46:00+00:00 2024-04-05T02:45:00.946791249Z [2024-04-05T02:45:00.946+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:45:00.946827132Z 2024-04-05T02:45:00.946831537Z 2024-04-05T02:45:00.946834976Z 2024-04-05T02:45:00.946838446Z 2024-04-05T02:45:00.946848378Z [2024-04-05T02:45:00.946+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:45:00.946911201Z [2024-04-05T02:45:00.946+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:45:00.947001832Z [2024-04-05T02:45:00.946+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:45:00.947077925Z [2024-04-05T02:45:00.946+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:45:00.948341360Z [2024-04-05T02:45:00.947+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:45:00.948354156Z 2024-04-05T02:45:00.948357719Z 2024-04-05T02:45:00.948360998Z 2024-04-05T02:45:00.948364238Z 2024-04-05T02:45:00.952185790Z [2024-04-05T02:45:00.951+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:45:00.952226939Z [2024-04-05T02:45:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:45:00.952438768Z [2024-04-05T02:45:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:45:00.952517844Z [2024-04-05T02:45:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:45:00.952679819Z [2024-04-05T02:45:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:45:00.952782355Z [2024-04-05T02:45:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:45:00.952940264Z [2024-04-05T02:45:00.952+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:45:00.953006953Z [2024-04-05T02:45:00.952+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:45:01.496639221Z [2024-04-05T02:45:01.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status queued for try_number 1 2024-04-05T02:45:01.496779325Z [2024-04-05T02:45:01.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:44:00+00:00 exited with status queued for try_number 1 2024-04-05T02:45:01.497105919Z [2024-04-05T02:45:01.496+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:44:00+00:00 exited with status queued for try_number 1 2024-04-05T02:45:01.497242824Z [2024-04-05T02:45:01.497+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:44:00+00:00 exited with status queued for try_number 1 2024-04-05T02:45:01.506932776Z [2024-04-05T02:45:01.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90c6f343-fd68-4927-aebb-79a802a93184 2024-04-05T02:45:01.507125196Z [2024-04-05T02:45:01.506+0000] {scheduler_job.py:635} INFO - Setting external_id for to 66fbda7e-d351-482f-aaff-12a4ee38ec85 2024-04-05T02:45:01.507522917Z [2024-04-05T02:45:01.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to b5c505e9-9e65-44e3-9bd1-166077fc93aa 2024-04-05T02:45:01.507528738Z [2024-04-05T02:45:01.507+0000] {scheduler_job.py:635} INFO - Setting external_id for to bad606b4-d348-4fce-8116-941fbadef763 2024-04-05T02:45:04.000793698Z [2024-04-05T02:45:04.000+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:45:04.001379173Z [2024-04-05T02:45:04.001+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:44:00+00:00, run_id=scheduled__2024-04-05T02:44:00+00:00, run_start_date=2024-04-05 02:45:00.873987+00:00, run_end_date=2024-04-05 02:45:04.000828+00:00, run_duration=3.126841, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:44:00+00:00, data_interval_end=2024-04-05 02:45:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:45:04.040838660Z [2024-04-05T02:45:04.040+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:45:00+00:00, run_after=2024-04-05T02:46:00+00:00 2024-04-05T02:45:04.157231517Z [2024-04-05T02:45:04.156+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:44:00+00:00 exited with status success for try_number 1 2024-04-05T02:45:04.170143128Z [2024-04-05T02:45:04.169+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:44:00+00:00, map_index=-1, run_start_date=2024-04-05 02:45:03.173827+00:00, run_end_date=2024-04-05 02:45:03.842791+00:00, run_duration=0.668964, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1133, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:45:00.949341+00:00, queued_by_job_id=1, pid=16562 2024-04-05T02:45:05.999140305Z [2024-04-05T02:45:05.998+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:45:05.999912411Z [2024-04-05T02:45:05.999+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:44:00+00:00, run_id=scheduled__2024-04-05T02:44:00+00:00, run_start_date=2024-04-05 02:45:00.875026+00:00, run_end_date=2024-04-05 02:45:05.999294+00:00, run_duration=5.124268, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:44:00+00:00, data_interval_end=2024-04-05 02:45:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:45:06.024885138Z [2024-04-05T02:45:06.024+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:45:00+00:00, run_after=2024-04-05T02:46:00+00:00 2024-04-05T02:45:06.079583324Z [2024-04-05T02:45:06.079+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:45:06.079616568Z 2024-04-05T02:45:06.080097463Z [2024-04-05T02:45:06.079+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:45:06.081296856Z [2024-04-05T02:45:06.081+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:45:06.081313338Z 2024-04-05T02:45:06.087021726Z [2024-04-05T02:45:06.086+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:45:06.092568084Z [2024-04-05T02:45:06.091+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:45:06.259485323Z [2024-04-05T02:45:06.256+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status queued for try_number 1 2024-04-05T02:45:06.259517882Z [2024-04-05T02:45:06.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status success for try_number 1 2024-04-05T02:45:06.259524107Z [2024-04-05T02:45:06.257+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:44:00+00:00 exited with status success for try_number 1 2024-04-05T02:45:06.274505237Z [2024-04-05T02:45:06.273+0000] {scheduler_job.py:635} INFO - Setting external_id for to 391799ea-c825-46da-aef0-5729a4529e92 2024-04-05T02:45:06.274544165Z [2024-04-05T02:45:06.273+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:40:00+00:00, map_index=-1, run_start_date=2024-04-05 02:45:04.462222+00:00, run_end_date=2024-04-05 02:45:04.906096+00:00, run_duration=0.443874, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1136, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:45:00.949341+00:00, queued_by_job_id=1, pid=16586 2024-04-05T02:45:06.274552329Z [2024-04-05T02:45:06.274+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:44:00+00:00, map_index=-1, run_start_date=2024-04-05 02:45:04.277970+00:00, run_end_date=2024-04-05 02:45:05.892830+00:00, run_duration=1.61486, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1134, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:45:00.949341+00:00, queued_by_job_id=1, pid=16584 2024-04-05T02:45:07.549668146Z [2024-04-05T02:45:07.549+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:45:07.550353208Z [2024-04-05T02:45:07.549+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:44:00+00:00, run_id=scheduled__2024-04-05T02:44:00+00:00, run_start_date=2024-04-05 02:45:00.876153+00:00, run_end_date=2024-04-05 02:45:07.549556+00:00, run_duration=6.673403, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:44:00+00:00, data_interval_end=2024-04-05 02:45:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:45:07.568746869Z [2024-04-05T02:45:07.568+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:45:00+00:00, run_after=2024-04-05T02:46:00+00:00 2024-04-05T02:45:07.637090862Z [2024-04-05T02:45:07.636+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:44:00+00:00 exited with status success for try_number 1 2024-04-05T02:45:07.646040679Z [2024-04-05T02:45:07.645+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:44:00+00:00, map_index=-1, run_start_date=2024-04-05 02:45:04.366760+00:00, run_end_date=2024-04-05 02:45:06.311515+00:00, run_duration=1.944755, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1135, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:45:00.949341+00:00, queued_by_job_id=1, pid=16585 2024-04-05T02:45:08.897178251Z [2024-04-05T02:45:08.896+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:45:08.897204633Z 2024-04-05T02:45:08.897413818Z [2024-04-05T02:45:08.897+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:45:08.898414583Z [2024-04-05T02:45:08.898+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:45:08.898428926Z 2024-04-05T02:45:08.901932923Z [2024-04-05T02:45:08.901+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:40:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:45:08.902080008Z [2024-04-05T02:45:08.901+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:45:08.973786790Z [2024-04-05T02:45:08.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status queued for try_number 1 2024-04-05T02:45:08.973875423Z [2024-04-05T02:45:08.973+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status success for try_number 1 2024-04-05T02:45:08.980629404Z [2024-04-05T02:45:08.980+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6740fcac-ca0e-4f55-b13a-96c2f9c1748a 2024-04-05T02:45:08.980868268Z [2024-04-05T02:45:08.980+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T02:40:00+00:00, map_index=-1, run_start_date=2024-04-05 02:45:08.161091+00:00, run_end_date=2024-04-05 02:45:08.681721+00:00, run_duration=0.52063, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1137, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:45:06.083063+00:00, queued_by_job_id=1, pid=16609 2024-04-05T02:45:12.447844357Z [2024-04-05T02:45:12.447+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:45:12.447886231Z 2024-04-05T02:45:12.447941636Z [2024-04-05T02:45:12.447+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:45:12.448729054Z [2024-04-05T02:45:12.448+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:45:12.448747970Z 2024-04-05T02:45:12.451813854Z [2024-04-05T02:45:12.451+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:40:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:45:12.451888604Z [2024-04-05T02:45:12.451+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:45:12.507807100Z [2024-04-05T02:45:12.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status queued for try_number 1 2024-04-05T02:45:12.507959213Z [2024-04-05T02:45:12.507+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status success for try_number 1 2024-04-05T02:45:12.514862177Z [2024-04-05T02:45:12.514+0000] {scheduler_job.py:635} INFO - Setting external_id for to 90ba65ee-71ae-4091-8b1a-803aa74020d2 2024-04-05T02:45:12.515159034Z [2024-04-05T02:45:12.514+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:40:00+00:00, map_index=0, run_start_date=2024-04-05 02:45:10.916600+00:00, run_end_date=2024-04-05 02:45:11.469462+00:00, run_duration=0.552862, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1138, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:45:08.899021+00:00, queued_by_job_id=1, pid=16627 2024-04-05T02:45:14.810000847Z [2024-04-05T02:45:14.809+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:45:14.810917956Z [2024-04-05T02:45:14.810+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:40:00+00:00, run_id=scheduled__2024-04-05T02:40:00+00:00, run_start_date=2024-04-05 02:45:00.872759+00:00, run_end_date=2024-04-05 02:45:14.809942+00:00, run_duration=13.937183, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:40:00+00:00, data_interval_end=2024-04-05 02:45:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T02:45:14.818639526Z [2024-04-05T02:45:14.818+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:45:00+00:00, run_after=2024-04-05T02:50:00+00:00 2024-04-05T02:45:14.851804091Z [2024-04-05T02:45:14.851+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:40:00+00:00 exited with status success for try_number 1 2024-04-05T02:45:14.857619240Z [2024-04-05T02:45:14.857+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:40:00+00:00, map_index=-1, run_start_date=2024-04-05 02:45:14.319269+00:00, run_end_date=2024-04-05 02:45:14.679116+00:00, run_duration=0.359847, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1139, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:45:12.449225+00:00, queued_by_job_id=1, pid=16638 2024-04-05T02:45:42.243155255Z [2024-04-05T02:45:42.242+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:46:00.288786266Z [2024-04-05T02:46:00.288+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:46:00.302817795Z [2024-04-05T02:46:00.302+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:46:00+00:00, run_after=2024-04-05T02:47:00+00:00 2024-04-05T02:46:00.319495094Z [2024-04-05T02:46:00.319+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:46:00+00:00, run_after=2024-04-05T02:47:00+00:00 2024-04-05T02:46:00.328139836Z [2024-04-05T02:46:00.327+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:46:00.423658582Z [2024-04-05T02:46:00.423+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:46:00.423682279Z 2024-04-05T02:46:00.423686350Z 2024-04-05T02:46:00.423689785Z 2024-04-05T02:46:00.423693110Z 2024-04-05T02:46:00.423925020Z [2024-04-05T02:46:00.423+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:46:00.424028649Z [2024-04-05T02:46:00.423+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:46:00.424103187Z [2024-04-05T02:46:00.424+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:46:00.424192652Z [2024-04-05T02:46:00.424+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:46:00.424878895Z [2024-04-05T02:46:00.424+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:46:00.424892230Z 2024-04-05T02:46:00.424897717Z 2024-04-05T02:46:00.424902941Z 2024-04-05T02:46:00.424907845Z 2024-04-05T02:46:00.429284596Z [2024-04-05T02:46:00.428+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:44:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:46:00.429387928Z [2024-04-05T02:46:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:46:00.429805877Z [2024-04-05T02:46:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:46:00.429931217Z [2024-04-05T02:46:00.429+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:46:00.430141482Z [2024-04-05T02:46:00.429+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:46:00.430241491Z [2024-04-05T02:46:00.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:46:00.430444136Z [2024-04-05T02:46:00.430+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:46:00.430524018Z [2024-04-05T02:46:00.430+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:46:00.962157026Z [2024-04-05T02:46:00.961+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:44:00+00:00 exited with status queued for try_number 1 2024-04-05T02:46:00.962192422Z [2024-04-05T02:46:00.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status queued for try_number 1 2024-04-05T02:46:00.962291627Z [2024-04-05T02:46:00.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status queued for try_number 1 2024-04-05T02:46:00.962416334Z [2024-04-05T02:46:00.962+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status queued for try_number 1 2024-04-05T02:46:01.020786784Z [2024-04-05T02:46:01.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to 84b2809a-fccf-4d2d-af73-2bbea460a5fa 2024-04-05T02:46:01.021003820Z [2024-04-05T02:46:01.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5309af2e-1131-4348-a860-401e09b9e558 2024-04-05T02:46:01.021175641Z [2024-04-05T02:46:01.020+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0431be3a-fce6-4a6d-8087-93f07a14bcd9 2024-04-05T02:46:01.021310948Z [2024-04-05T02:46:01.021+0000] {scheduler_job.py:635} INFO - Setting external_id for to cb163c1b-e954-4c30-93b0-d1ed00c2ae2f 2024-04-05T02:46:02.562251050Z [2024-04-05T02:46:02.561+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:46:02.562526855Z [2024-04-05T02:46:02.562+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:45:00+00:00, run_id=scheduled__2024-04-05T02:45:00+00:00, run_start_date=2024-04-05 02:46:00.342912+00:00, run_end_date=2024-04-05 02:46:02.562155+00:00, run_duration=2.219243, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:45:00+00:00, data_interval_end=2024-04-05 02:46:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:46:02.595726930Z [2024-04-05T02:46:02.582+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:46:00+00:00, run_after=2024-04-05T02:47:00+00:00 2024-04-05T02:46:02.790734852Z [2024-04-05T02:46:02.790+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status success for try_number 1 2024-04-05T02:46:02.811158214Z [2024-04-05T02:46:02.810+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:45:00+00:00, map_index=-1, run_start_date=2024-04-05 02:46:01.518355+00:00, run_end_date=2024-04-05 02:46:02.087712+00:00, run_duration=0.569357, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1140, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:46:00.425925+00:00, queued_by_job_id=1, pid=16648 2024-04-05T02:46:03.897453595Z [2024-04-05T02:46:03.896+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:46:03.898172491Z [2024-04-05T02:46:03.897+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:44:00+00:00, run_id=scheduled__2024-04-05T02:44:00+00:00, run_start_date=2024-04-05 02:46:00.341078+00:00, run_end_date=2024-04-05 02:46:03.897610+00:00, run_duration=3.556532, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:44:00+00:00, data_interval_end=2024-04-05 02:46:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:46:03.915776783Z [2024-04-05T02:46:03.915+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:46:00+00:00, run_after=2024-04-05T02:48:00+00:00 2024-04-05T02:46:03.974973261Z [2024-04-05T02:46:03.974+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:44:00+00:00 exited with status success for try_number 1 2024-04-05T02:46:03.981238799Z [2024-04-05T02:46:03.980+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:44:00+00:00, map_index=-1, run_start_date=2024-04-05 02:46:02.476366+00:00, run_end_date=2024-04-05 02:46:03.167210+00:00, run_duration=0.690844, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1141, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:46:00.425925+00:00, queued_by_job_id=1, pid=16655 2024-04-05T02:46:06.118825246Z [2024-04-05T02:46:06.118+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:46:06.120989126Z [2024-04-05T02:46:06.119+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:45:00+00:00, run_id=scheduled__2024-04-05T02:45:00+00:00, run_start_date=2024-04-05 02:46:00.344348+00:00, run_end_date=2024-04-05 02:46:06.118764+00:00, run_duration=5.774416, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:45:00+00:00, data_interval_end=2024-04-05 02:46:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:46:06.131149188Z [2024-04-05T02:46:06.130+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:46:00+00:00, run_after=2024-04-05T02:47:00+00:00 2024-04-05T02:46:06.179240994Z [2024-04-05T02:46:06.178+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status success for try_number 1 2024-04-05T02:46:06.188133089Z [2024-04-05T02:46:06.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:45:00+00:00, map_index=-1, run_start_date=2024-04-05 02:46:03.614542+00:00, run_end_date=2024-04-05 02:46:05.005238+00:00, run_duration=1.390696, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1142, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:46:00.425925+00:00, queued_by_job_id=1, pid=16667 2024-04-05T02:46:07.270361733Z [2024-04-05T02:46:07.269+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:46:07.270750708Z [2024-04-05T02:46:07.270+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:45:00+00:00, run_id=scheduled__2024-04-05T02:45:00+00:00, run_start_date=2024-04-05 02:46:00.345508+00:00, run_end_date=2024-04-05 02:46:07.270230+00:00, run_duration=6.924722, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:45:00+00:00, data_interval_end=2024-04-05 02:46:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:46:07.282346304Z [2024-04-05T02:46:07.281+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:46:00+00:00, run_after=2024-04-05T02:47:00+00:00 2024-04-05T02:46:07.322721217Z [2024-04-05T02:46:07.322+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status success for try_number 1 2024-04-05T02:46:07.329674215Z [2024-04-05T02:46:07.329+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:45:00+00:00, map_index=-1, run_start_date=2024-04-05 02:46:04.161664+00:00, run_end_date=2024-04-05 02:46:06.546996+00:00, run_duration=2.385332, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1143, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:46:00.425925+00:00, queued_by_job_id=1, pid=16678 2024-04-05T02:47:00.674961678Z [2024-04-05T02:47:00.674+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:47:00+00:00, run_after=2024-04-05T02:48:00+00:00 2024-04-05T02:47:00.696439169Z [2024-04-05T02:47:00.695+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:47:00+00:00, run_after=2024-04-05T02:48:00+00:00 2024-04-05T02:47:00.718233200Z [2024-04-05T02:47:00.717+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:47:00.819683155Z [2024-04-05T02:47:00.819+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:47:00.819715933Z 2024-04-05T02:47:00.819721628Z 2024-04-05T02:47:00.819726664Z 2024-04-05T02:47:00.820084978Z [2024-04-05T02:47:00.819+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:47:00.820358718Z [2024-04-05T02:47:00.820+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:47:00.820624791Z [2024-04-05T02:47:00.820+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:47:00.821678387Z [2024-04-05T02:47:00.821+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:47:00.821695183Z 2024-04-05T02:47:00.821700871Z 2024-04-05T02:47:00.821705714Z 2024-04-05T02:47:00.828276392Z [2024-04-05T02:47:00.827+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:47:00.828743375Z [2024-04-05T02:47:00.828+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:47:00.829365337Z [2024-04-05T02:47:00.829+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:47:00.829700081Z [2024-04-05T02:47:00.829+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:47:00.830206987Z [2024-04-05T02:47:00.829+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:47:00.830535771Z [2024-04-05T02:47:00.830+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:47:01.344825730Z [2024-04-05T02:47:01.343+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:46:00+00:00 exited with status queued for try_number 1 2024-04-05T02:47:01.345106544Z [2024-04-05T02:47:01.344+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:46:00+00:00 exited with status queued for try_number 1 2024-04-05T02:47:01.345372178Z [2024-04-05T02:47:01.345+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:46:00+00:00 exited with status queued for try_number 1 2024-04-05T02:47:01.399179989Z [2024-04-05T02:47:01.398+0000] {scheduler_job.py:635} INFO - Setting external_id for to bda0a887-3156-4803-a7fd-eca0e997a788 2024-04-05T02:47:01.399412454Z [2024-04-05T02:47:01.399+0000] {scheduler_job.py:635} INFO - Setting external_id for to 599bf076-681d-40bd-bc9f-77e8477cab99 2024-04-05T02:47:01.403883228Z [2024-04-05T02:47:01.399+0000] {scheduler_job.py:635} INFO - Setting external_id for to f4fa9219-5b0f-48ab-a271-a3608077268a 2024-04-05T02:47:03.172518170Z [2024-04-05T02:47:03.171+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:47:03.173153781Z [2024-04-05T02:47:03.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:46:00+00:00, run_id=scheduled__2024-04-05T02:46:00+00:00, run_start_date=2024-04-05 02:47:00.734572+00:00, run_end_date=2024-04-05 02:47:03.172541+00:00, run_duration=2.437969, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:46:00+00:00, data_interval_end=2024-04-05 02:47:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:47:03.192937402Z [2024-04-05T02:47:03.192+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:47:00+00:00, run_after=2024-04-05T02:48:00+00:00 2024-04-05T02:47:04.347675108Z [2024-04-05T02:47:04.347+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:46:00+00:00 exited with status success for try_number 1 2024-04-05T02:47:04.356194593Z [2024-04-05T02:47:04.355+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:46:00+00:00, map_index=-1, run_start_date=2024-04-05 02:47:02.610116+00:00, run_end_date=2024-04-05 02:47:03.115490+00:00, run_duration=0.505374, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1144, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:47:00.823028+00:00, queued_by_job_id=1, pid=16705 2024-04-05T02:47:06.510570229Z [2024-04-05T02:47:06.510+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:47:06.510927516Z [2024-04-05T02:47:06.510+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:46:00+00:00, run_id=scheduled__2024-04-05T02:46:00+00:00, run_start_date=2024-04-05 02:47:00.738125+00:00, run_end_date=2024-04-05 02:47:06.510482+00:00, run_duration=5.772357, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:46:00+00:00, data_interval_end=2024-04-05 02:47:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:47:06.522921461Z [2024-04-05T02:47:06.522+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:47:00+00:00, run_after=2024-04-05T02:48:00+00:00 2024-04-05T02:47:06.532821589Z [2024-04-05T02:47:06.532+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:47:06.533198687Z [2024-04-05T02:47:06.532+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:46:00+00:00, run_id=scheduled__2024-04-05T02:46:00+00:00, run_start_date=2024-04-05 02:47:00.740087+00:00, run_end_date=2024-04-05 02:47:06.532734+00:00, run_duration=5.792647, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:46:00+00:00, data_interval_end=2024-04-05 02:47:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:47:06.546701092Z [2024-04-05T02:47:06.546+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:47:00+00:00, run_after=2024-04-05T02:48:00+00:00 2024-04-05T02:47:06.585889517Z [2024-04-05T02:47:06.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:46:00+00:00 exited with status success for try_number 1 2024-04-05T02:47:06.586047833Z [2024-04-05T02:47:06.585+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:46:00+00:00 exited with status success for try_number 1 2024-04-05T02:47:06.594392796Z [2024-04-05T02:47:06.593+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:46:00+00:00, map_index=-1, run_start_date=2024-04-05 02:47:03.763368+00:00, run_end_date=2024-04-05 02:47:06.076038+00:00, run_duration=2.31267, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1145, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:47:00.823028+00:00, queued_by_job_id=1, pid=16723 2024-04-05T02:47:06.594616533Z [2024-04-05T02:47:06.594+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:46:00+00:00, map_index=-1, run_start_date=2024-04-05 02:47:03.816038+00:00, run_end_date=2024-04-05 02:47:05.669306+00:00, run_duration=1.853268, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1146, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:47:00.823028+00:00, queued_by_job_id=1, pid=16724 2024-04-05T02:48:01.015869864Z [2024-04-05T02:48:01.015+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:48:01.032890227Z [2024-04-05T02:48:01.032+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:48:00+00:00, run_after=2024-04-05T02:49:00+00:00 2024-04-05T02:48:01.048593366Z [2024-04-05T02:48:01.048+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:48:00+00:00, run_after=2024-04-05T02:49:00+00:00 2024-04-05T02:48:01.057703914Z [2024-04-05T02:48:01.057+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:48:01.142543652Z [2024-04-05T02:48:01.142+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:48:01.142567297Z 2024-04-05T02:48:01.142590521Z 2024-04-05T02:48:01.142593948Z 2024-04-05T02:48:01.142597088Z 2024-04-05T02:48:01.142809153Z [2024-04-05T02:48:01.142+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:48:01.142997282Z [2024-04-05T02:48:01.142+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:48:01.143142310Z [2024-04-05T02:48:01.143+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:48:01.143282977Z [2024-04-05T02:48:01.143+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:48:01.144019972Z [2024-04-05T02:48:01.143+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:48:01.144033671Z 2024-04-05T02:48:01.144037515Z 2024-04-05T02:48:01.144040678Z 2024-04-05T02:48:01.144044162Z 2024-04-05T02:48:01.154086412Z [2024-04-05T02:48:01.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:46:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:48:01.154110837Z [2024-04-05T02:48:01.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:48:01.154116927Z [2024-04-05T02:48:01.153+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:48:01.154120649Z [2024-04-05T02:48:01.153+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:48:01.154148951Z [2024-04-05T02:48:01.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:48:01.154212347Z [2024-04-05T02:48:01.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:48:01.154359875Z [2024-04-05T02:48:01.154+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:47:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:48:01.154420271Z [2024-04-05T02:48:01.154+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:48:01.952922671Z [2024-04-05T02:48:01.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:46:00+00:00 exited with status queued for try_number 1 2024-04-05T02:48:01.955320044Z [2024-04-05T02:48:01.952+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:47:00+00:00 exited with status queued for try_number 1 2024-04-05T02:48:01.955434606Z [2024-04-05T02:48:01.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:47:00+00:00 exited with status queued for try_number 1 2024-04-05T02:48:01.955590393Z [2024-04-05T02:48:01.955+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:47:00+00:00 exited with status queued for try_number 1 2024-04-05T02:48:01.981434568Z [2024-04-05T02:48:01.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to e10d8313-9576-4a7f-acf1-7efa52ab1889 2024-04-05T02:48:01.981604887Z [2024-04-05T02:48:01.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to fe660270-7cc8-4fd9-a718-ae505ffbaacc 2024-04-05T02:48:01.981787411Z [2024-04-05T02:48:01.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to b125486c-fee3-401c-971d-af2d46254a2c 2024-04-05T02:48:01.981952815Z [2024-04-05T02:48:01.981+0000] {scheduler_job.py:635} INFO - Setting external_id for to dc8c240a-35cf-4581-9237-5c5064dd2fea 2024-04-05T02:48:02.902563461Z [2024-04-05T02:48:02.902+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:48:02.903538608Z [2024-04-05T02:48:02.903+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:46:00+00:00, run_id=scheduled__2024-04-05T02:46:00+00:00, run_start_date=2024-04-05 02:48:01.072009+00:00, run_end_date=2024-04-05 02:48:02.902808+00:00, run_duration=1.830799, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:46:00+00:00, data_interval_end=2024-04-05 02:48:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:48:02.924473957Z [2024-04-05T02:48:02.923+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:48:00+00:00, run_after=2024-04-05T02:50:00+00:00 2024-04-05T02:48:04.106681400Z [2024-04-05T02:48:04.106+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:48:04.107145374Z [2024-04-05T02:48:04.106+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:47:00+00:00, run_id=scheduled__2024-04-05T02:47:00+00:00, run_start_date=2024-04-05 02:48:01.073452+00:00, run_end_date=2024-04-05 02:48:04.106746+00:00, run_duration=3.033294, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:47:00+00:00, data_interval_end=2024-04-05 02:48:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:48:04.119008288Z [2024-04-05T02:48:04.118+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:48:00+00:00, run_after=2024-04-05T02:49:00+00:00 2024-04-05T02:48:04.177480691Z [2024-04-05T02:48:04.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:46:00+00:00 exited with status success for try_number 1 2024-04-05T02:48:04.179978733Z [2024-04-05T02:48:04.177+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:47:00+00:00 exited with status success for try_number 1 2024-04-05T02:48:04.187963530Z [2024-04-05T02:48:04.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:46:00+00:00, map_index=-1, run_start_date=2024-04-05 02:48:02.310687+00:00, run_end_date=2024-04-05 02:48:02.815336+00:00, run_duration=0.504649, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1147, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:48:01.146814+00:00, queued_by_job_id=1, pid=16757 2024-04-05T02:48:04.188388890Z [2024-04-05T02:48:04.188+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:47:00+00:00, map_index=-1, run_start_date=2024-04-05 02:48:02.380925+00:00, run_end_date=2024-04-05 02:48:02.967924+00:00, run_duration=0.586999, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1148, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:48:01.146814+00:00, queued_by_job_id=1, pid=16758 2024-04-05T02:48:08.100719286Z [2024-04-05T02:48:08.100+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:48:08.100856326Z [2024-04-05T02:48:08.100+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:47:00+00:00, run_id=scheduled__2024-04-05T02:47:00+00:00, run_start_date=2024-04-05 02:48:01.074862+00:00, run_end_date=2024-04-05 02:48:08.100434+00:00, run_duration=7.025572, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:47:00+00:00, data_interval_end=2024-04-05 02:48:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:48:08.113672181Z [2024-04-05T02:48:08.113+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:48:00+00:00, run_after=2024-04-05T02:49:00+00:00 2024-04-05T02:48:08.120838845Z [2024-04-05T02:48:08.120+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:48:08.121117753Z [2024-04-05T02:48:08.120+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:47:00+00:00, run_id=scheduled__2024-04-05T02:47:00+00:00, run_start_date=2024-04-05 02:48:01.076158+00:00, run_end_date=2024-04-05 02:48:08.120693+00:00, run_duration=7.044535, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:47:00+00:00, data_interval_end=2024-04-05 02:48:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:48:08.130262370Z [2024-04-05T02:48:08.129+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:48:00+00:00, run_after=2024-04-05T02:49:00+00:00 2024-04-05T02:48:08.174281414Z [2024-04-05T02:48:08.172+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:47:00+00:00 exited with status success for try_number 1 2024-04-05T02:48:08.174730162Z [2024-04-05T02:48:08.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:47:00+00:00 exited with status success for try_number 1 2024-04-05T02:48:08.186716066Z [2024-04-05T02:48:08.186+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:47:00+00:00, map_index=-1, run_start_date=2024-04-05 02:48:03.962798+00:00, run_end_date=2024-04-05 02:48:07.486648+00:00, run_duration=3.52385, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1150, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:48:01.146814+00:00, queued_by_job_id=1, pid=16782 2024-04-05T02:48:08.187405301Z [2024-04-05T02:48:08.187+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:47:00+00:00, map_index=-1, run_start_date=2024-04-05 02:48:03.941004+00:00, run_end_date=2024-04-05 02:48:07.582624+00:00, run_duration=3.64162, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1149, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:48:01.146814+00:00, queued_by_job_id=1, pid=16781 2024-04-05T02:49:00.338063627Z [2024-04-05T02:49:00.337+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:49:00+00:00, run_after=2024-04-05T02:50:00+00:00 2024-04-05T02:49:00.361312409Z [2024-04-05T02:49:00.360+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:49:00.389208925Z [2024-04-05T02:49:00.388+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:49:00+00:00, run_after=2024-04-05T02:50:00+00:00 2024-04-05T02:49:00.493525716Z [2024-04-05T02:49:00.493+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:49:00.493564694Z 2024-04-05T02:49:00.493584076Z 2024-04-05T02:49:00.493587323Z 2024-04-05T02:49:00.493917352Z [2024-04-05T02:49:00.493+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:49:00.494173879Z [2024-04-05T02:49:00.493+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:49:00.494381644Z [2024-04-05T02:49:00.494+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:49:00.495060795Z [2024-04-05T02:49:00.494+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:49:00.495076201Z 2024-04-05T02:49:00.495081391Z 2024-04-05T02:49:00.495085926Z 2024-04-05T02:49:00.500480058Z [2024-04-05T02:49:00.500+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:49:00.502872769Z [2024-04-05T02:49:00.500+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:49:00.503409054Z [2024-04-05T02:49:00.503+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:49:00.503751506Z [2024-04-05T02:49:00.503+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:49:00.504175681Z [2024-04-05T02:49:00.503+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:49:00.504464806Z [2024-04-05T02:49:00.504+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:49:00.905079530Z [2024-04-05T02:49:00.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:48:00+00:00 exited with status queued for try_number 1 2024-04-05T02:49:00.905126514Z [2024-04-05T02:49:00.904+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:48:00+00:00 exited with status queued for try_number 1 2024-04-05T02:49:00.905180935Z [2024-04-05T02:49:00.905+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:48:00+00:00 exited with status queued for try_number 1 2024-04-05T02:49:00.917145417Z [2024-04-05T02:49:00.916+0000] {scheduler_job.py:635} INFO - Setting external_id for to ecedcd98-4cf0-43a6-ae98-4d802a4c9d21 2024-04-05T02:49:00.917232481Z [2024-04-05T02:49:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to 598420d2-4f88-4e18-80e7-f12e3bb42265 2024-04-05T02:49:00.917295419Z [2024-04-05T02:49:00.917+0000] {scheduler_job.py:635} INFO - Setting external_id for to ce3477ff-bada-4ba7-81f5-2e144ea44919 2024-04-05T02:49:02.348842360Z [2024-04-05T02:49:02.348+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:49:02.349541896Z [2024-04-05T02:49:02.349+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:48:00+00:00, run_id=scheduled__2024-04-05T02:48:00+00:00, run_start_date=2024-04-05 02:49:00.404632+00:00, run_end_date=2024-04-05 02:49:02.349017+00:00, run_duration=1.944385, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:48:00+00:00, data_interval_end=2024-04-05 02:49:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:49:02.368189055Z [2024-04-05T02:49:02.367+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:49:00+00:00, run_after=2024-04-05T02:50:00+00:00 2024-04-05T02:49:03.574359301Z [2024-04-05T02:49:03.573+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:48:00+00:00 exited with status success for try_number 1 2024-04-05T02:49:03.582195582Z [2024-04-05T02:49:03.581+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:48:00+00:00, map_index=-1, run_start_date=2024-04-05 02:49:01.877130+00:00, run_end_date=2024-04-05 02:49:02.332441+00:00, run_duration=0.455311, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1151, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:49:00.496043+00:00, queued_by_job_id=1, pid=16814 2024-04-05T02:49:05.031784985Z [2024-04-05T02:49:05.031+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:49:05.032297543Z [2024-04-05T02:49:05.031+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:48:00+00:00, run_id=scheduled__2024-04-05T02:48:00+00:00, run_start_date=2024-04-05 02:49:00.406232+00:00, run_end_date=2024-04-05 02:49:05.031878+00:00, run_duration=4.625646, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:48:00+00:00, data_interval_end=2024-04-05 02:49:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:49:05.050277295Z [2024-04-05T02:49:05.049+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:49:00+00:00, run_after=2024-04-05T02:50:00+00:00 2024-04-05T02:49:05.061790763Z [2024-04-05T02:49:05.061+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:49:05.062768092Z [2024-04-05T02:49:05.062+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:48:00+00:00, run_id=scheduled__2024-04-05T02:48:00+00:00, run_start_date=2024-04-05 02:49:00.407852+00:00, run_end_date=2024-04-05 02:49:05.061973+00:00, run_duration=4.654121, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:48:00+00:00, data_interval_end=2024-04-05 02:49:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:49:05.085444075Z [2024-04-05T02:49:05.084+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:49:00+00:00, run_after=2024-04-05T02:50:00+00:00 2024-04-05T02:49:05.132336054Z [2024-04-05T02:49:05.131+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:48:00+00:00 exited with status success for try_number 1 2024-04-05T02:49:05.132538002Z [2024-04-05T02:49:05.132+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:48:00+00:00 exited with status success for try_number 1 2024-04-05T02:49:05.142097419Z [2024-04-05T02:49:05.141+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:48:00+00:00, map_index=-1, run_start_date=2024-04-05 02:49:03.085058+00:00, run_end_date=2024-04-05 02:49:04.564584+00:00, run_duration=1.479526, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1153, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:49:00.496043+00:00, queued_by_job_id=1, pid=16833 2024-04-05T02:49:05.142343957Z [2024-04-05T02:49:05.142+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:48:00+00:00, map_index=-1, run_start_date=2024-04-05 02:49:02.937299+00:00, run_end_date=2024-04-05 02:49:04.583503+00:00, run_duration=1.646204, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1152, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:49:00.496043+00:00, queued_by_job_id=1, pid=16832 2024-04-05T02:50:00.721466157Z [2024-04-05T02:50:00.721+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:50:00.734646715Z [2024-04-05T02:50:00.734+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:50:00+00:00, run_after=2024-04-05T02:51:00+00:00 2024-04-05T02:50:00.744140781Z [2024-04-05T02:50:00.743+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:50:00.760913746Z [2024-04-05T02:50:00.760+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:50:00+00:00, run_after=2024-04-05T02:51:00+00:00 2024-04-05T02:50:00.778912707Z [2024-04-05T02:50:00.778+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:50:00+00:00, run_after=2024-04-05T02:55:00+00:00 2024-04-05T02:50:00.892210643Z [2024-04-05T02:50:00.891+0000] {scheduler_job.py:360} INFO - 5 tasks up for execution: 2024-04-05T02:50:00.892234775Z 2024-04-05T02:50:00.892238373Z 2024-04-05T02:50:00.892242171Z 2024-04-05T02:50:00.892245626Z 2024-04-05T02:50:00.892248861Z 2024-04-05T02:50:00.892252003Z [2024-04-05T02:50:00.892+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:50:00.892296492Z [2024-04-05T02:50:00.892+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:50:00.892399970Z [2024-04-05T02:50:00.892+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:50:00.892461254Z [2024-04-05T02:50:00.892+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:50:00.892568199Z [2024-04-05T02:50:00.892+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:50:00.893281245Z [2024-04-05T02:50:00.893+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:50:00.893298629Z 2024-04-05T02:50:00.893303088Z 2024-04-05T02:50:00.893306580Z 2024-04-05T02:50:00.893309847Z 2024-04-05T02:50:00.893313267Z 2024-04-05T02:50:00.897608689Z [2024-04-05T02:50:00.897+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:50:00.897854276Z [2024-04-05T02:50:00.897+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:50:00.898557698Z [2024-04-05T02:50:00.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:48:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:50:00.898568469Z [2024-04-05T02:50:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:50:00.898764280Z [2024-04-05T02:50:00.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:50:00.898840943Z [2024-04-05T02:50:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:50:00.899034445Z [2024-04-05T02:50:00.898+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:50:00.899088875Z [2024-04-05T02:50:00.898+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:50:00.899258733Z [2024-04-05T02:50:00.899+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:49:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:50:00.899311535Z [2024-04-05T02:50:00.899+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:50:01.545608214Z [2024-04-05T02:50:01.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status queued for try_number 1 2024-04-05T02:50:01.546198024Z [2024-04-05T02:50:01.545+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:48:00+00:00 exited with status queued for try_number 1 2024-04-05T02:50:01.546480511Z [2024-04-05T02:50:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:49:00+00:00 exited with status queued for try_number 1 2024-04-05T02:50:01.546842105Z [2024-04-05T02:50:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:49:00+00:00 exited with status queued for try_number 1 2024-04-05T02:50:01.547823618Z [2024-04-05T02:50:01.546+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:49:00+00:00 exited with status queued for try_number 1 2024-04-05T02:50:01.581959914Z [2024-04-05T02:50:01.581+0000] {scheduler_job.py:635} INFO - Setting external_id for to cf518952-d71c-48bb-b045-12ec4c7416ea 2024-04-05T02:50:01.582066493Z [2024-04-05T02:50:01.581+0000] {scheduler_job.py:635} INFO - Setting external_id for to 8f61accb-09e7-49c0-8112-2899f9221e99 2024-04-05T02:50:01.582262486Z [2024-04-05T02:50:01.582+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71e40d07-5c22-4c69-bf41-e4a8c3a40fcb 2024-04-05T02:50:01.582427387Z [2024-04-05T02:50:01.582+0000] {scheduler_job.py:635} INFO - Setting external_id for to a2d7d43d-b7fc-4c99-a3b3-1fd1575afd5f 2024-04-05T02:50:01.582600881Z [2024-04-05T02:50:01.582+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6cf730b6-846d-470d-99e7-9abc83adb5fc 2024-04-05T02:50:04.246153948Z [2024-04-05T02:50:04.245+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:50:04.248379297Z [2024-04-05T02:50:04.248+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:48:00+00:00, run_id=scheduled__2024-04-05T02:48:00+00:00, run_start_date=2024-04-05 02:50:00.792550+00:00, run_end_date=2024-04-05 02:50:04.247805+00:00, run_duration=3.455255, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:48:00+00:00, data_interval_end=2024-04-05 02:50:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:50:04.261068158Z [2024-04-05T02:50:04.260+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:50:00+00:00, run_after=2024-04-05T02:52:00+00:00 2024-04-05T02:50:04.270953963Z [2024-04-05T02:50:04.270+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:50:04.271466749Z [2024-04-05T02:50:04.271+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:49:00+00:00, run_id=scheduled__2024-04-05T02:49:00+00:00, run_start_date=2024-04-05 02:50:00.794431+00:00, run_end_date=2024-04-05 02:50:04.271100+00:00, run_duration=3.476669, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:49:00+00:00, data_interval_end=2024-04-05 02:50:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:50:04.285751333Z [2024-04-05T02:50:04.285+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:50:00+00:00, run_after=2024-04-05T02:51:00+00:00 2024-04-05T02:50:04.435124357Z [2024-04-05T02:50:04.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:48:00+00:00 exited with status success for try_number 1 2024-04-05T02:50:04.435178071Z [2024-04-05T02:50:04.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:49:00+00:00 exited with status success for try_number 1 2024-04-05T02:50:04.443516587Z [2024-04-05T02:50:04.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:48:00+00:00, map_index=-1, run_start_date=2024-04-05 02:50:02.730310+00:00, run_end_date=2024-04-05 02:50:03.529350+00:00, run_duration=0.79904, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1154, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:50:00.894348+00:00, queued_by_job_id=1, pid=16867 2024-04-05T02:50:04.443858751Z [2024-04-05T02:50:04.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:49:00+00:00, map_index=-1, run_start_date=2024-04-05 02:50:03.001567+00:00, run_end_date=2024-04-05 02:50:03.725498+00:00, run_duration=0.723931, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1155, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:50:00.894348+00:00, queued_by_job_id=1, pid=16868 2024-04-05T02:50:05.990998152Z [2024-04-05T02:50:05.986+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:50:05.991038392Z 2024-04-05T02:50:05.991043642Z [2024-04-05T02:50:05.986+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:50:05.991047916Z [2024-04-05T02:50:05.987+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:50:05.991051241Z 2024-04-05T02:50:05.991055416Z [2024-04-05T02:50:05.990+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:50:05.991059341Z [2024-04-05T02:50:05.990+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:50:06.061709698Z [2024-04-05T02:50:06.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status queued for try_number 1 2024-04-05T02:50:06.061833049Z [2024-04-05T02:50:06.061+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status success for try_number 1 2024-04-05T02:50:06.071048883Z [2024-04-05T02:50:06.070+0000] {scheduler_job.py:635} INFO - Setting external_id for to 861e8dec-287c-43bf-beae-f278f35c806d 2024-04-05T02:50:06.071384613Z [2024-04-05T02:50:06.071+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:45:00+00:00, map_index=-1, run_start_date=2024-04-05 02:50:04.798254+00:00, run_end_date=2024-04-05 02:50:05.287113+00:00, run_duration=0.488859, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1158, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:50:00.894348+00:00, queued_by_job_id=1, pid=16898 2024-04-05T02:50:07.301904703Z [2024-04-05T02:50:07.301+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:50:07.302155719Z [2024-04-05T02:50:07.301+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:49:00+00:00, run_id=scheduled__2024-04-05T02:49:00+00:00, run_start_date=2024-04-05 02:50:00.796855+00:00, run_end_date=2024-04-05 02:50:07.301738+00:00, run_duration=6.504883, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:49:00+00:00, data_interval_end=2024-04-05 02:50:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:50:07.313588681Z [2024-04-05T02:50:07.313+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:50:00+00:00, run_after=2024-04-05T02:51:00+00:00 2024-04-05T02:50:07.324471535Z [2024-04-05T02:50:07.323+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:50:07.324653471Z [2024-04-05T02:50:07.324+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:49:00+00:00, run_id=scheduled__2024-04-05T02:49:00+00:00, run_start_date=2024-04-05 02:50:00.795618+00:00, run_end_date=2024-04-05 02:50:07.324330+00:00, run_duration=6.528712, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:49:00+00:00, data_interval_end=2024-04-05 02:50:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:50:07.336399025Z [2024-04-05T02:50:07.335+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:50:00+00:00, run_after=2024-04-05T02:51:00+00:00 2024-04-05T02:50:07.408001483Z [2024-04-05T02:50:07.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:49:00+00:00 exited with status success for try_number 1 2024-04-05T02:50:07.408288268Z [2024-04-05T02:50:07.407+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:49:00+00:00 exited with status success for try_number 1 2024-04-05T02:50:07.416897369Z [2024-04-05T02:50:07.416+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:49:00+00:00, map_index=-1, run_start_date=2024-04-05 02:50:04.508279+00:00, run_end_date=2024-04-05 02:50:06.290461+00:00, run_duration=1.782182, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1156, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:50:00.894348+00:00, queued_by_job_id=1, pid=16892 2024-04-05T02:50:07.417261071Z [2024-04-05T02:50:07.417+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:49:00+00:00, map_index=-1, run_start_date=2024-04-05 02:50:04.834750+00:00, run_end_date=2024-04-05 02:50:06.343981+00:00, run_duration=1.509231, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1157, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:50:00.894348+00:00, queued_by_job_id=1, pid=16899 2024-04-05T02:50:09.321005546Z [2024-04-05T02:50:09.320+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:50:09.321040743Z 2024-04-05T02:50:09.321363329Z [2024-04-05T02:50:09.321+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:50:09.322163875Z [2024-04-05T02:50:09.321+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:50:09.322178923Z 2024-04-05T02:50:09.325213527Z [2024-04-05T02:50:09.324+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:45:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:50:09.325466213Z [2024-04-05T02:50:09.325+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:50:09.414416328Z [2024-04-05T02:50:09.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status queued for try_number 1 2024-04-05T02:50:09.415992575Z [2024-04-05T02:50:09.414+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status success for try_number 1 2024-04-05T02:50:09.425597126Z [2024-04-05T02:50:09.425+0000] {scheduler_job.py:635} INFO - Setting external_id for to b50dedde-9561-46a2-951a-576342553069 2024-04-05T02:50:09.427201349Z [2024-04-05T02:50:09.425+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T02:45:00+00:00, map_index=-1, run_start_date=2024-04-05 02:50:07.993112+00:00, run_end_date=2024-04-05 02:50:08.474709+00:00, run_duration=0.481597, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1159, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:50:05.987822+00:00, queued_by_job_id=1, pid=16922 2024-04-05T02:50:12.804754787Z [2024-04-05T02:50:12.804+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:50:12.804788765Z 2024-04-05T02:50:12.805057578Z [2024-04-05T02:50:12.804+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:50:12.806134468Z [2024-04-05T02:50:12.805+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:50:12.806162098Z 2024-04-05T02:50:12.810644340Z [2024-04-05T02:50:12.810+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:45:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:50:12.810823588Z [2024-04-05T02:50:12.810+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:50:12.873817803Z [2024-04-05T02:50:12.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status queued for try_number 1 2024-04-05T02:50:12.874100558Z [2024-04-05T02:50:12.873+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status success for try_number 1 2024-04-05T02:50:12.886602614Z [2024-04-05T02:50:12.886+0000] {scheduler_job.py:635} INFO - Setting external_id for to 76332478-a785-460d-a39a-3ce0df60763a 2024-04-05T02:50:12.886938726Z [2024-04-05T02:50:12.886+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:45:00+00:00, map_index=0, run_start_date=2024-04-05 02:50:11.542057+00:00, run_end_date=2024-04-05 02:50:12.009116+00:00, run_duration=0.467059, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1160, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:50:09.322773+00:00, queued_by_job_id=1, pid=16943 2024-04-05T02:50:16.171177498Z [2024-04-05T02:50:16.170+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:50:16.171538188Z [2024-04-05T02:50:16.171+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:45:00+00:00, run_id=scheduled__2024-04-05T02:45:00+00:00, run_start_date=2024-04-05 02:50:00.791191+00:00, run_end_date=2024-04-05 02:50:16.171023+00:00, run_duration=15.379832, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:45:00+00:00, data_interval_end=2024-04-05 02:50:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T02:50:16.178551417Z [2024-04-05T02:50:16.178+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:50:00+00:00, run_after=2024-04-05T02:55:00+00:00 2024-04-05T02:50:16.221561252Z [2024-04-05T02:50:16.218+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:45:00+00:00 exited with status success for try_number 1 2024-04-05T02:50:16.229238034Z [2024-04-05T02:50:16.228+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:45:00+00:00, map_index=-1, run_start_date=2024-04-05 02:50:14.831922+00:00, run_end_date=2024-04-05 02:50:15.253306+00:00, run_duration=0.421384, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1161, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:50:12.806730+00:00, queued_by_job_id=1, pid=16951 2024-04-05T02:50:42.321475894Z [2024-04-05T02:50:42.320+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:51:00.652758618Z [2024-04-05T02:51:00.652+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:51:00+00:00, run_after=2024-04-05T02:52:00+00:00 2024-04-05T02:51:00.661787283Z [2024-04-05T02:51:00.661+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:51:00.675131421Z [2024-04-05T02:51:00.674+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:51:00+00:00, run_after=2024-04-05T02:52:00+00:00 2024-04-05T02:51:00.761914777Z [2024-04-05T02:51:00.761+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:51:00.761952420Z 2024-04-05T02:51:00.761959613Z 2024-04-05T02:51:00.761965660Z 2024-04-05T02:51:00.762148597Z [2024-04-05T02:51:00.761+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:51:00.762410639Z [2024-04-05T02:51:00.762+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:51:00.762582596Z [2024-04-05T02:51:00.762+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:51:00.763486044Z [2024-04-05T02:51:00.763+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:51:00.763496133Z 2024-04-05T02:51:00.763499491Z 2024-04-05T02:51:00.763502669Z 2024-04-05T02:51:00.767284810Z [2024-04-05T02:51:00.767+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:51:00.767427983Z [2024-04-05T02:51:00.767+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:51:00.767714684Z [2024-04-05T02:51:00.767+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:51:00.767872590Z [2024-04-05T02:51:00.767+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:51:00.768214133Z [2024-04-05T02:51:00.768+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:51:00.768409013Z [2024-04-05T02:51:00.768+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:51:01.258983222Z [2024-04-05T02:51:01.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status queued for try_number 1 2024-04-05T02:51:01.259604304Z [2024-04-05T02:51:01.258+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status queued for try_number 1 2024-04-05T02:51:01.259901050Z [2024-04-05T02:51:01.259+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status queued for try_number 1 2024-04-05T02:51:01.299652942Z [2024-04-05T02:51:01.299+0000] {scheduler_job.py:635} INFO - Setting external_id for to 633dd05c-38f0-4ec2-9779-0de5660100e5 2024-04-05T02:51:01.304112389Z [2024-04-05T02:51:01.299+0000] {scheduler_job.py:635} INFO - Setting external_id for to e74ea09e-941d-46cf-b7d4-66405b6494fd 2024-04-05T02:51:01.304315612Z [2024-04-05T02:51:01.304+0000] {scheduler_job.py:635} INFO - Setting external_id for to abfb2673-b796-408e-a164-a9a59145dcd8 2024-04-05T02:51:03.212039252Z [2024-04-05T02:51:03.211+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:51:03.212455212Z [2024-04-05T02:51:03.212+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:50:00+00:00, run_id=scheduled__2024-04-05T02:50:00+00:00, run_start_date=2024-04-05 02:51:00.686147+00:00, run_end_date=2024-04-05 02:51:03.211937+00:00, run_duration=2.52579, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:50:00+00:00, data_interval_end=2024-04-05 02:51:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:51:03.228645967Z [2024-04-05T02:51:03.228+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:51:00+00:00, run_after=2024-04-05T02:52:00+00:00 2024-04-05T02:51:03.299628548Z [2024-04-05T02:51:03.299+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status success for try_number 1 2024-04-05T02:51:03.307826322Z [2024-04-05T02:51:03.307+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:50:00+00:00, map_index=-1, run_start_date=2024-04-05 02:51:02.117488+00:00, run_end_date=2024-04-05 02:51:02.532143+00:00, run_duration=0.414655, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1162, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:51:00.764634+00:00, queued_by_job_id=1, pid=16960 2024-04-05T02:51:05.457258668Z [2024-04-05T02:51:05.456+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:51:05.457654343Z [2024-04-05T02:51:05.457+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:50:00+00:00, run_id=scheduled__2024-04-05T02:50:00+00:00, run_start_date=2024-04-05 02:51:00.689075+00:00, run_end_date=2024-04-05 02:51:05.457185+00:00, run_duration=4.76811, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:50:00+00:00, data_interval_end=2024-04-05 02:51:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:51:05.467525102Z [2024-04-05T02:51:05.467+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:51:00+00:00, run_after=2024-04-05T02:52:00+00:00 2024-04-05T02:51:05.475379844Z [2024-04-05T02:51:05.474+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:51:05.475837158Z [2024-04-05T02:51:05.475+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:50:00+00:00, run_id=scheduled__2024-04-05T02:50:00+00:00, run_start_date=2024-04-05 02:51:00.687523+00:00, run_end_date=2024-04-05 02:51:05.475267+00:00, run_duration=4.787744, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:50:00+00:00, data_interval_end=2024-04-05 02:51:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:51:05.487606751Z [2024-04-05T02:51:05.487+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:51:00+00:00, run_after=2024-04-05T02:52:00+00:00 2024-04-05T02:51:05.517322298Z [2024-04-05T02:51:05.516+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status success for try_number 1 2024-04-05T02:51:05.517521243Z [2024-04-05T02:51:05.517+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status success for try_number 1 2024-04-05T02:51:05.524361449Z [2024-04-05T02:51:05.524+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:50:00+00:00, map_index=-1, run_start_date=2024-04-05 02:51:03.176975+00:00, run_end_date=2024-04-05 02:51:04.530423+00:00, run_duration=1.353448, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1164, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:51:00.764634+00:00, queued_by_job_id=1, pid=16979 2024-04-05T02:51:05.524692480Z [2024-04-05T02:51:05.524+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:50:00+00:00, map_index=-1, run_start_date=2024-04-05 02:51:03.074705+00:00, run_end_date=2024-04-05 02:51:04.693479+00:00, run_duration=1.618774, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1163, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:51:00.764634+00:00, queued_by_job_id=1, pid=16978 2024-04-05T02:52:00.225571662Z [2024-04-05T02:52:00.225+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:52:00.242862309Z [2024-04-05T02:52:00.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:52:00+00:00, run_after=2024-04-05T02:53:00+00:00 2024-04-05T02:52:00.260297213Z [2024-04-05T02:52:00.260+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:52:00+00:00, run_after=2024-04-05T02:53:00+00:00 2024-04-05T02:52:00.273925342Z [2024-04-05T02:52:00.273+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:52:00.373929010Z [2024-04-05T02:52:00.373+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:52:00.373953762Z 2024-04-05T02:52:00.373958636Z 2024-04-05T02:52:00.373962313Z 2024-04-05T02:52:00.373965614Z 2024-04-05T02:52:00.374091180Z [2024-04-05T02:52:00.373+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:52:00.374325471Z [2024-04-05T02:52:00.374+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:52:00.374520636Z [2024-04-05T02:52:00.374+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:52:00.374698087Z [2024-04-05T02:52:00.374+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:52:00.375346694Z [2024-04-05T02:52:00.375+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:52:00.375358821Z 2024-04-05T02:52:00.375362665Z 2024-04-05T02:52:00.375394157Z 2024-04-05T02:52:00.375397734Z 2024-04-05T02:52:00.379289434Z [2024-04-05T02:52:00.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:52:00.379616590Z [2024-04-05T02:52:00.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:52:00.379887535Z [2024-04-05T02:52:00.379+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:52:00.380024405Z [2024-04-05T02:52:00.379+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:52:00.380292661Z [2024-04-05T02:52:00.380+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:52:00.380479163Z [2024-04-05T02:52:00.380+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:52:00.380712725Z [2024-04-05T02:52:00.380+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:51:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:52:00.380892377Z [2024-04-05T02:52:00.380+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:52:00.903258921Z [2024-04-05T02:52:00.902+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status queued for try_number 1 2024-04-05T02:52:00.908075877Z [2024-04-05T02:52:00.907+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:51:00+00:00 exited with status queued for try_number 1 2024-04-05T02:52:00.908305037Z [2024-04-05T02:52:00.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:51:00+00:00 exited with status queued for try_number 1 2024-04-05T02:52:00.908472467Z [2024-04-05T02:52:00.908+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:51:00+00:00 exited with status queued for try_number 1 2024-04-05T02:52:00.920727148Z [2024-04-05T02:52:00.920+0000] {scheduler_job.py:635} INFO - Setting external_id for to debe630f-1bb3-4a89-9b79-be45fb11329b 2024-04-05T02:52:00.922397861Z [2024-04-05T02:52:00.922+0000] {scheduler_job.py:635} INFO - Setting external_id for to 3027393c-52e8-4785-9b75-aa36609b6ceb 2024-04-05T02:52:00.922858420Z [2024-04-05T02:52:00.922+0000] {scheduler_job.py:635} INFO - Setting external_id for to b7b82df7-7556-4466-9c32-9090c413596c 2024-04-05T02:52:00.924075483Z [2024-04-05T02:52:00.923+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81300670-24ce-4cc3-9e6f-17c60ef472ef 2024-04-05T02:52:02.491784775Z [2024-04-05T02:52:02.491+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:52:02.492250661Z [2024-04-05T02:52:02.491+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:50:00+00:00, run_id=scheduled__2024-04-05T02:50:00+00:00, run_start_date=2024-04-05 02:52:00.295864+00:00, run_end_date=2024-04-05 02:52:02.491683+00:00, run_duration=2.195819, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:50:00+00:00, data_interval_end=2024-04-05 02:52:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:52:02.504954300Z [2024-04-05T02:52:02.504+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:52:00+00:00, run_after=2024-04-05T02:54:00+00:00 2024-04-05T02:52:02.524647231Z [2024-04-05T02:52:02.524+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:52:02.524854136Z [2024-04-05T02:52:02.524+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:51:00+00:00, run_id=scheduled__2024-04-05T02:51:00+00:00, run_start_date=2024-04-05 02:52:00.298468+00:00, run_end_date=2024-04-05 02:52:02.524513+00:00, run_duration=2.226045, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:51:00+00:00, data_interval_end=2024-04-05 02:52:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:52:02.548937074Z [2024-04-05T02:52:02.546+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:52:00+00:00, run_after=2024-04-05T02:53:00+00:00 2024-04-05T02:52:03.792607209Z [2024-04-05T02:52:03.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status success for try_number 1 2024-04-05T02:52:03.793798975Z [2024-04-05T02:52:03.792+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:51:00+00:00 exited with status success for try_number 1 2024-04-05T02:52:03.805878926Z [2024-04-05T02:52:03.805+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:50:00+00:00, map_index=-1, run_start_date=2024-04-05 02:52:01.885149+00:00, run_end_date=2024-04-05 02:52:02.445295+00:00, run_duration=0.560146, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1166, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:52:00.376594+00:00, queued_by_job_id=1, pid=17014 2024-04-05T02:52:03.806285559Z [2024-04-05T02:52:03.805+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:51:00+00:00, map_index=-1, run_start_date=2024-04-05 02:52:01.797326+00:00, run_end_date=2024-04-05 02:52:02.424906+00:00, run_duration=0.62758, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1165, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:52:00.376594+00:00, queued_by_job_id=1, pid=17013 2024-04-05T02:52:05.954548735Z [2024-04-05T02:52:05.954+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:52:05.955004911Z [2024-04-05T02:52:05.954+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:51:00+00:00, run_id=scheduled__2024-04-05T02:51:00+00:00, run_start_date=2024-04-05 02:52:00.300903+00:00, run_end_date=2024-04-05 02:52:05.954390+00:00, run_duration=5.653487, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:51:00+00:00, data_interval_end=2024-04-05 02:52:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:52:05.965149071Z [2024-04-05T02:52:05.964+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:52:00+00:00, run_after=2024-04-05T02:53:00+00:00 2024-04-05T02:52:05.975137566Z [2024-04-05T02:52:05.974+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:52:05.975685241Z [2024-04-05T02:52:05.975+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:51:00+00:00, run_id=scheduled__2024-04-05T02:51:00+00:00, run_start_date=2024-04-05 02:52:00.299809+00:00, run_end_date=2024-04-05 02:52:05.974958+00:00, run_duration=5.675149, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:51:00+00:00, data_interval_end=2024-04-05 02:52:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:52:05.987268570Z [2024-04-05T02:52:05.986+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:52:00+00:00, run_after=2024-04-05T02:53:00+00:00 2024-04-05T02:52:06.033386363Z [2024-04-05T02:52:06.032+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:51:00+00:00 exited with status success for try_number 1 2024-04-05T02:52:06.033448303Z [2024-04-05T02:52:06.033+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:51:00+00:00 exited with status success for try_number 1 2024-04-05T02:52:06.041301905Z [2024-04-05T02:52:06.040+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:51:00+00:00, map_index=-1, run_start_date=2024-04-05 02:52:03.923145+00:00, run_end_date=2024-04-05 02:52:05.434311+00:00, run_duration=1.511166, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1168, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:52:00.376594+00:00, queued_by_job_id=1, pid=17038 2024-04-05T02:52:06.041628715Z [2024-04-05T02:52:06.041+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:51:00+00:00, map_index=-1, run_start_date=2024-04-05 02:52:03.584104+00:00, run_end_date=2024-04-05 02:52:05.645402+00:00, run_duration=2.061298, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1167, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:52:00.376594+00:00, queued_by_job_id=1, pid=17032 2024-04-05T02:53:00.238370267Z [2024-04-05T02:53:00.237+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:53:00+00:00, run_after=2024-04-05T02:54:00+00:00 2024-04-05T02:53:00.247213011Z [2024-04-05T02:53:00.246+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:53:00.260278604Z [2024-04-05T02:53:00.259+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:53:00+00:00, run_after=2024-04-05T02:54:00+00:00 2024-04-05T02:53:00.348037751Z [2024-04-05T02:53:00.347+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:53:00.348048213Z 2024-04-05T02:53:00.348051913Z 2024-04-05T02:53:00.348055566Z 2024-04-05T02:53:00.348401327Z [2024-04-05T02:53:00.348+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:53:00.348701465Z [2024-04-05T02:53:00.348+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:53:00.348991980Z [2024-04-05T02:53:00.348+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:53:00.349832554Z [2024-04-05T02:53:00.349+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:53:00.349846805Z 2024-04-05T02:53:00.349850617Z 2024-04-05T02:53:00.349854015Z 2024-04-05T02:53:00.359283627Z [2024-04-05T02:53:00.358+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:53:00.359676036Z [2024-04-05T02:53:00.359+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:53:00.360208958Z [2024-04-05T02:53:00.359+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:53:00.360667268Z [2024-04-05T02:53:00.360+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:53:00.361150324Z [2024-04-05T02:53:00.360+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:53:00.361430588Z [2024-04-05T02:53:00.361+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:53:00.693294249Z [2024-04-05T02:53:00.692+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:52:00+00:00 exited with status queued for try_number 1 2024-04-05T02:53:00.697416859Z [2024-04-05T02:53:00.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:52:00+00:00 exited with status queued for try_number 1 2024-04-05T02:53:00.697592000Z [2024-04-05T02:53:00.697+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:52:00+00:00 exited with status queued for try_number 1 2024-04-05T02:53:00.712115926Z [2024-04-05T02:53:00.711+0000] {scheduler_job.py:635} INFO - Setting external_id for to f5ab6df7-ece0-4bbd-90ff-dcfdb028530d 2024-04-05T02:53:00.712424186Z [2024-04-05T02:53:00.712+0000] {scheduler_job.py:635} INFO - Setting external_id for to 779ec70a-30fa-47b1-9865-009eba2f6aa1 2024-04-05T02:53:00.712626205Z [2024-04-05T02:53:00.712+0000] {scheduler_job.py:635} INFO - Setting external_id for to a091cad6-c360-466b-a645-7e6f92c75bf3 2024-04-05T02:53:02.959845752Z [2024-04-05T02:53:02.959+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:53:02.960546296Z [2024-04-05T02:53:02.960+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:52:00+00:00, run_id=scheduled__2024-04-05T02:52:00+00:00, run_start_date=2024-04-05 02:53:00.274799+00:00, run_end_date=2024-04-05 02:53:02.960054+00:00, run_duration=2.685255, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:52:00+00:00, data_interval_end=2024-04-05 02:53:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:53:02.979139159Z [2024-04-05T02:53:02.978+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:53:00+00:00, run_after=2024-04-05T02:54:00+00:00 2024-04-05T02:53:03.056562186Z [2024-04-05T02:53:03.056+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:52:00+00:00 exited with status success for try_number 1 2024-04-05T02:53:03.065341521Z [2024-04-05T02:53:03.064+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:52:00+00:00, map_index=-1, run_start_date=2024-04-05 02:53:02.010087+00:00, run_end_date=2024-04-05 02:53:02.590591+00:00, run_duration=0.580504, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1169, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:53:00.350653+00:00, queued_by_job_id=1, pid=17070 2024-04-05T02:53:06.512487461Z [2024-04-05T02:53:06.511+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:53:06.512884107Z [2024-04-05T02:53:06.512+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:52:00+00:00, run_id=scheduled__2024-04-05T02:52:00+00:00, run_start_date=2024-04-05 02:53:00.276924+00:00, run_end_date=2024-04-05 02:53:06.512490+00:00, run_duration=6.235566, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:52:00+00:00, data_interval_end=2024-04-05 02:53:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:53:06.522224992Z [2024-04-05T02:53:06.521+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:53:00+00:00, run_after=2024-04-05T02:54:00+00:00 2024-04-05T02:53:06.569753186Z [2024-04-05T02:53:06.569+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:52:00+00:00 exited with status success for try_number 1 2024-04-05T02:53:06.576126312Z [2024-04-05T02:53:06.575+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:52:00+00:00, map_index=-1, run_start_date=2024-04-05 02:53:03.814601+00:00, run_end_date=2024-04-05 02:53:05.910938+00:00, run_duration=2.096337, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1170, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:53:00.350653+00:00, queued_by_job_id=1, pid=17088 2024-04-05T02:53:07.625397869Z [2024-04-05T02:53:07.624+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:53:07.625683973Z [2024-04-05T02:53:07.625+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:52:00+00:00, run_id=scheduled__2024-04-05T02:52:00+00:00, run_start_date=2024-04-05 02:53:00.278590+00:00, run_end_date=2024-04-05 02:53:07.625228+00:00, run_duration=7.346638, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:52:00+00:00, data_interval_end=2024-04-05 02:53:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:53:07.636729463Z [2024-04-05T02:53:07.636+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:53:00+00:00, run_after=2024-04-05T02:54:00+00:00 2024-04-05T02:53:07.682445547Z [2024-04-05T02:53:07.681+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:52:00+00:00 exited with status success for try_number 1 2024-04-05T02:53:07.689450337Z [2024-04-05T02:53:07.688+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:52:00+00:00, map_index=-1, run_start_date=2024-04-05 02:53:03.949752+00:00, run_end_date=2024-04-05 02:53:06.775412+00:00, run_duration=2.82566, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1171, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:53:00.350653+00:00, queued_by_job_id=1, pid=17089 2024-04-05T02:54:00.095226128Z [2024-04-05T02:54:00.094+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:54:00.121552135Z [2024-04-05T02:54:00.121+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:54:00+00:00, run_after=2024-04-05T02:55:00+00:00 2024-04-05T02:54:00.147936912Z [2024-04-05T02:54:00.147+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:54:00+00:00, run_after=2024-04-05T02:55:00+00:00 2024-04-05T02:54:00.162273926Z [2024-04-05T02:54:00.161+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:54:00.244967489Z [2024-04-05T02:54:00.244+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:54:00.244999177Z 2024-04-05T02:54:00.245010261Z 2024-04-05T02:54:00.245014088Z 2024-04-05T02:54:00.245017252Z 2024-04-05T02:54:00.245397867Z [2024-04-05T02:54:00.245+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:54:00.245647721Z [2024-04-05T02:54:00.245+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:54:00.245872066Z [2024-04-05T02:54:00.245+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:54:00.246100866Z [2024-04-05T02:54:00.245+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:54:00.246802268Z [2024-04-05T02:54:00.246+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:54:00.246813528Z 2024-04-05T02:54:00.246817148Z 2024-04-05T02:54:00.246820319Z 2024-04-05T02:54:00.246823318Z 2024-04-05T02:54:00.250209800Z [2024-04-05T02:54:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:52:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:54:00.250542588Z [2024-04-05T02:54:00.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:54:00.250902424Z [2024-04-05T02:54:00.250+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:54:00.251139796Z [2024-04-05T02:54:00.250+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:54:00.251458450Z [2024-04-05T02:54:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:54:00.251743448Z [2024-04-05T02:54:00.251+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:54:00.252094282Z [2024-04-05T02:54:00.251+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:53:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:54:00.252318234Z [2024-04-05T02:54:00.252+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:54:00.602487242Z [2024-04-05T02:54:00.601+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:52:00+00:00 exited with status queued for try_number 1 2024-04-05T02:54:00.602567105Z [2024-04-05T02:54:00.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:53:00+00:00 exited with status queued for try_number 1 2024-04-05T02:54:00.602571669Z [2024-04-05T02:54:00.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:53:00+00:00 exited with status queued for try_number 1 2024-04-05T02:54:00.602636011Z [2024-04-05T02:54:00.602+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:53:00+00:00 exited with status queued for try_number 1 2024-04-05T02:54:00.629303916Z [2024-04-05T02:54:00.628+0000] {scheduler_job.py:635} INFO - Setting external_id for to 71f40cdd-54c9-4f99-9b9d-d0eea7bbd8d0 2024-04-05T02:54:00.629358526Z [2024-04-05T02:54:00.629+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5fec0745-b6b2-4bc4-b4f2-55376e8be5fb 2024-04-05T02:54:00.629388027Z [2024-04-05T02:54:00.629+0000] {scheduler_job.py:635} INFO - Setting external_id for to 50d7cde0-2fc3-4aed-bcd4-d716b6bfaa80 2024-04-05T02:54:00.629505152Z [2024-04-05T02:54:00.629+0000] {scheduler_job.py:635} INFO - Setting external_id for to 0a5342a2-7379-45ec-8bc5-4419b9f7f9f5 2024-04-05T02:54:03.233712242Z [2024-04-05T02:54:03.233+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:54:03.234087471Z [2024-04-05T02:54:03.233+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:52:00+00:00, run_id=scheduled__2024-04-05T02:52:00+00:00, run_start_date=2024-04-05 02:54:00.184455+00:00, run_end_date=2024-04-05 02:54:03.233647+00:00, run_duration=3.049192, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:52:00+00:00, data_interval_end=2024-04-05 02:54:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:54:03.245293881Z [2024-04-05T02:54:03.244+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:54:00+00:00, run_after=2024-04-05T02:56:00+00:00 2024-04-05T02:54:03.276926601Z [2024-04-05T02:54:03.276+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:54:03.277497417Z [2024-04-05T02:54:03.277+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:53:00+00:00, run_id=scheduled__2024-04-05T02:53:00+00:00, run_start_date=2024-04-05 02:54:00.186099+00:00, run_end_date=2024-04-05 02:54:03.277041+00:00, run_duration=3.090942, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:53:00+00:00, data_interval_end=2024-04-05 02:54:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:54:03.310286904Z [2024-04-05T02:54:03.309+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:54:00+00:00, run_after=2024-04-05T02:55:00+00:00 2024-04-05T02:54:03.358154766Z [2024-04-05T02:54:03.357+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:52:00+00:00 exited with status success for try_number 1 2024-04-05T02:54:03.358477339Z [2024-04-05T02:54:03.358+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:53:00+00:00 exited with status success for try_number 1 2024-04-05T02:54:03.371135412Z [2024-04-05T02:54:03.370+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:52:00+00:00, map_index=-1, run_start_date=2024-04-05 02:54:01.486893+00:00, run_end_date=2024-04-05 02:54:02.293325+00:00, run_duration=0.806432, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1172, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:54:00.247762+00:00, queued_by_job_id=1, pid=17122 2024-04-05T02:54:03.371642401Z [2024-04-05T02:54:03.371+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:53:00+00:00, map_index=-1, run_start_date=2024-04-05 02:54:01.863243+00:00, run_end_date=2024-04-05 02:54:02.813642+00:00, run_duration=0.950399, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1173, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:54:00.247762+00:00, queued_by_job_id=1, pid=17123 2024-04-05T02:54:06.366117690Z [2024-04-05T02:54:06.365+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:54:06.366398070Z [2024-04-05T02:54:06.366+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:53:00+00:00, run_id=scheduled__2024-04-05T02:53:00+00:00, run_start_date=2024-04-05 02:54:00.189174+00:00, run_end_date=2024-04-05 02:54:06.366060+00:00, run_duration=6.176886, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:53:00+00:00, data_interval_end=2024-04-05 02:54:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:54:06.375203327Z [2024-04-05T02:54:06.374+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:54:00+00:00, run_after=2024-04-05T02:55:00+00:00 2024-04-05T02:54:06.385094614Z [2024-04-05T02:54:06.384+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:54:06.385915430Z [2024-04-05T02:54:06.385+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:53:00+00:00, run_id=scheduled__2024-04-05T02:53:00+00:00, run_start_date=2024-04-05 02:54:00.187164+00:00, run_end_date=2024-04-05 02:54:06.385467+00:00, run_duration=6.198303, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:53:00+00:00, data_interval_end=2024-04-05 02:54:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:54:06.404380431Z [2024-04-05T02:54:06.404+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:54:00+00:00, run_after=2024-04-05T02:55:00+00:00 2024-04-05T02:54:06.435137543Z [2024-04-05T02:54:06.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:53:00+00:00 exited with status success for try_number 1 2024-04-05T02:54:06.435157992Z [2024-04-05T02:54:06.434+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:53:00+00:00 exited with status success for try_number 1 2024-04-05T02:54:06.443103625Z [2024-04-05T02:54:06.442+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:53:00+00:00, map_index=-1, run_start_date=2024-04-05 02:54:03.747841+00:00, run_end_date=2024-04-05 02:54:05.489833+00:00, run_duration=1.741992, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1175, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:54:00.247762+00:00, queued_by_job_id=1, pid=17147 2024-04-05T02:54:06.443354771Z [2024-04-05T02:54:06.443+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:53:00+00:00, map_index=-1, run_start_date=2024-04-05 02:54:03.706952+00:00, run_end_date=2024-04-05 02:54:05.942890+00:00, run_duration=2.235938, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1174, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:54:00.247762+00:00, queued_by_job_id=1, pid=17146 2024-04-05T02:55:00.908152674Z [2024-04-05T02:55:00.907+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:55:00.921109159Z [2024-04-05T02:55:00.918+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:55:00+00:00, run_after=2024-04-05T03:00:00+00:00 2024-04-05T02:55:00.930720876Z [2024-04-05T02:55:00.930+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:55:00+00:00, run_after=2024-04-05T02:56:00+00:00 2024-04-05T02:55:00.944014352Z [2024-04-05T02:55:00.943+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:55:00+00:00, run_after=2024-04-05T02:56:00+00:00 2024-04-05T02:55:01.016376800Z [2024-04-05T02:55:01.016+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:55:01.016402123Z 2024-04-05T02:55:01.016406417Z 2024-04-05T02:55:01.016409740Z 2024-04-05T02:55:01.016413363Z 2024-04-05T02:55:01.016423299Z [2024-04-05T02:55:01.016+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:55:01.016551090Z [2024-04-05T02:55:01.016+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:55:01.016715162Z [2024-04-05T02:55:01.016+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:55:01.016920229Z [2024-04-05T02:55:01.016+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:55:01.017557699Z [2024-04-05T02:55:01.017+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:55:01.017571582Z 2024-04-05T02:55:01.017575479Z 2024-04-05T02:55:01.017578890Z 2024-04-05T02:55:01.017582209Z 2024-04-05T02:55:01.021285604Z [2024-04-05T02:55:01.020+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='extract_metrics_from_vnfrs', run_id='scheduled__2024-04-05T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 4 and queue default 2024-04-05T02:55:01.021381460Z [2024-04-05T02:55:01.021+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-05T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:55:01.021702374Z [2024-04-05T02:55:01.021+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:55:01.021871072Z [2024-04-05T02:55:01.021+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:55:01.022139796Z [2024-04-05T02:55:01.021+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:55:01.022287380Z [2024-04-05T02:55:01.022+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:55:01.022544173Z [2024-04-05T02:55:01.022+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:55:01.022690331Z [2024-04-05T02:55:01.022+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:55:01.748027835Z [2024-04-05T02:55:01.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status queued for try_number 1 2024-04-05T02:55:01.748411636Z [2024-04-05T02:55:01.747+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status queued for try_number 1 2024-04-05T02:55:01.748719446Z [2024-04-05T02:55:01.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status queued for try_number 1 2024-04-05T02:55:01.748960864Z [2024-04-05T02:55:01.748+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status queued for try_number 1 2024-04-05T02:55:01.784778686Z [2024-04-05T02:55:01.780+0000] {scheduler_job.py:635} INFO - Setting external_id for to a8410924-d9b2-48e7-a07a-ce305c5f64b5 2024-04-05T02:55:01.784808445Z [2024-04-05T02:55:01.780+0000] {scheduler_job.py:635} INFO - Setting external_id for to 536644cc-6065-4f5c-b48c-3cc2a7530db7 2024-04-05T02:55:01.784812731Z [2024-04-05T02:55:01.780+0000] {scheduler_job.py:635} INFO - Setting external_id for to e11ba1f4-3d7c-4296-9687-0e921a8fb580 2024-04-05T02:55:01.784836173Z [2024-04-05T02:55:01.780+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6e4e8d75-779e-4300-8cb0-4503115448ee 2024-04-05T02:55:03.282217898Z [2024-04-05T02:55:03.281+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:55:03.283479383Z [2024-04-05T02:55:03.282+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:54:00+00:00, run_id=scheduled__2024-04-05T02:54:00+00:00, run_start_date=2024-04-05 02:55:00.955458+00:00, run_end_date=2024-04-05 02:55:03.282308+00:00, run_duration=2.32685, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:54:00+00:00, data_interval_end=2024-04-05 02:55:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:55:03.340553958Z [2024-04-05T02:55:03.339+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:55:00+00:00, run_after=2024-04-05T02:56:00+00:00 2024-04-05T02:55:03.413667739Z [2024-04-05T02:55:03.413+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status success for try_number 1 2024-04-05T02:55:03.422756495Z [2024-04-05T02:55:03.422+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:54:00+00:00, map_index=-1, run_start_date=2024-04-05 02:55:02.523257+00:00, run_end_date=2024-04-05 02:55:03.079340+00:00, run_duration=0.556083, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1176, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:55:01.018449+00:00, queued_by_job_id=1, pid=17181 2024-04-05T02:55:04.895706981Z [2024-04-05T02:55:04.895+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:55:04.895738299Z 2024-04-05T02:55:04.896014655Z [2024-04-05T02:55:04.895+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:55:04.897094853Z [2024-04-05T02:55:04.896+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:55:04.897108939Z 2024-04-05T02:55:04.901313087Z [2024-04-05T02:55:04.900+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='split_metrics', run_id='scheduled__2024-04-05T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default 2024-04-05T02:55:04.902010109Z [2024-04-05T02:55:04.901+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'split_metrics', 'scheduled__2024-04-05T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:55:04.964742880Z [2024-04-05T02:55:04.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status queued for try_number 1 2024-04-05T02:55:04.964778440Z [2024-04-05T02:55:04.964+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.extract_metrics_from_vnfrs run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status success for try_number 1 2024-04-05T02:55:04.971410804Z [2024-04-05T02:55:04.971+0000] {scheduler_job.py:635} INFO - Setting external_id for to 570115ec-f31f-4b44-ac90-4df79032debc 2024-04-05T02:55:04.971614565Z [2024-04-05T02:55:04.971+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=extract_metrics_from_vnfrs, run_id=scheduled__2024-04-05T02:50:00+00:00, map_index=-1, run_start_date=2024-04-05 02:55:03.792870+00:00, run_end_date=2024-04-05 02:55:04.217968+00:00, run_duration=0.425098, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1178, pool=default_pool, queue=default, priority_weight=4, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:55:01.018449+00:00, queued_by_job_id=1, pid=17205 2024-04-05T02:55:06.185017876Z [2024-04-05T02:55:06.184+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:55:06.185528826Z [2024-04-05T02:55:06.185+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:54:00+00:00, run_id=scheduled__2024-04-05T02:54:00+00:00, run_start_date=2024-04-05 02:55:00.956547+00:00, run_end_date=2024-04-05 02:55:06.185039+00:00, run_duration=5.228492, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:54:00+00:00, data_interval_end=2024-04-05 02:55:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:55:06.203714094Z [2024-04-05T02:55:06.202+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:55:00+00:00, run_after=2024-04-05T02:56:00+00:00 2024-04-05T02:55:06.224967205Z [2024-04-05T02:55:06.224+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:55:06.228125982Z [2024-04-05T02:55:06.227+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:54:00+00:00, run_id=scheduled__2024-04-05T02:54:00+00:00, run_start_date=2024-04-05 02:55:00.957583+00:00, run_end_date=2024-04-05 02:55:06.224866+00:00, run_duration=5.267283, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:54:00+00:00, data_interval_end=2024-04-05 02:55:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:55:06.243311059Z [2024-04-05T02:55:06.242+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:55:00+00:00, run_after=2024-04-05T02:56:00+00:00 2024-04-05T02:55:06.314025644Z [2024-04-05T02:55:06.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status success for try_number 1 2024-04-05T02:55:06.314055221Z [2024-04-05T02:55:06.312+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status success for try_number 1 2024-04-05T02:55:06.331718565Z [2024-04-05T02:55:06.323+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:54:00+00:00, map_index=-1, run_start_date=2024-04-05 02:55:03.598374+00:00, run_end_date=2024-04-05 02:55:05.421180+00:00, run_duration=1.822806, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1177, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:55:01.018449+00:00, queued_by_job_id=1, pid=17204 2024-04-05T02:55:06.331747481Z [2024-04-05T02:55:06.324+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:54:00+00:00, map_index=-1, run_start_date=2024-04-05 02:55:03.815150+00:00, run_end_date=2024-04-05 02:55:05.236127+00:00, run_duration=1.420977, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1179, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:55:01.018449+00:00, queued_by_job_id=1, pid=17206 2024-04-05T02:55:08.484702014Z [2024-04-05T02:55:08.484+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:55:08.484758153Z 2024-04-05T02:55:08.485013746Z [2024-04-05T02:55:08.484+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:55:08.485735482Z [2024-04-05T02:55:08.485+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:55:08.485749733Z 2024-04-05T02:55:08.488618051Z [2024-04-05T02:55:08.488+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='collect_metrics', run_id='scheduled__2024-04-05T02:50:00+00:00', try_number=1, map_index=0) to executor with priority 2 and queue default 2024-04-05T02:55:08.488905354Z [2024-04-05T02:55:08.488+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'collect_metrics', 'scheduled__2024-04-05T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-05T02:55:08.552772732Z [2024-04-05T02:55:08.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status queued for try_number 1 2024-04-05T02:55:08.553161152Z [2024-04-05T02:55:08.552+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.split_metrics run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status success for try_number 1 2024-04-05T02:55:08.562148713Z [2024-04-05T02:55:08.561+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5cc8ee29-6318-406e-8c40-ea51cbdaef0f 2024-04-05T02:55:08.562387790Z [2024-04-05T02:55:08.562+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=split_metrics, run_id=scheduled__2024-04-05T02:50:00+00:00, map_index=-1, run_start_date=2024-04-05 02:55:06.895968+00:00, run_end_date=2024-04-05 02:55:07.289296+00:00, run_duration=0.393328, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1180, pool=default_pool, queue=default, priority_weight=3, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:55:04.897768+00:00, queued_by_job_id=1, pid=17229 2024-04-05T02:55:11.715782342Z [2024-04-05T02:55:11.715+0000] {scheduler_job.py:360} INFO - 1 tasks up for execution: 2024-04-05T02:55:11.715858221Z 2024-04-05T02:55:11.715865029Z [2024-04-05T02:55:11.715+0000] {scheduler_job.py:425} INFO - DAG vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:55:11.716665926Z [2024-04-05T02:55:11.716+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:55:11.716687587Z 2024-04-05T02:55:11.721043525Z [2024-04-05T02:55:11.720+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='send_prometheus', run_id='scheduled__2024-04-05T02:50:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:55:11.721258325Z [2024-04-05T02:55:11.720+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'send_prometheus', 'scheduled__2024-04-05T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-05T02:55:11.813188806Z [2024-04-05T02:55:11.812+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status queued for try_number 1 2024-04-05T02:55:11.813642992Z [2024-04-05T02:55:11.813+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.collect_metrics run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status success for try_number 1 2024-04-05T02:55:11.822637477Z [2024-04-05T02:55:11.822+0000] {scheduler_job.py:635} INFO - Setting external_id for to 125dc02b-92b4-484d-ae9e-0f9603ec5f85 2024-04-05T02:55:11.823034907Z [2024-04-05T02:55:11.822+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=collect_metrics, run_id=scheduled__2024-04-05T02:50:00+00:00, map_index=0, run_start_date=2024-04-05 02:55:10.459165+00:00, run_end_date=2024-04-05 02:55:10.854097+00:00, run_duration=0.394932, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1181, pool=default_pool, queue=default, priority_weight=2, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:55:08.486233+00:00, queued_by_job_id=1, pid=17246 2024-04-05T02:55:14.951674342Z [2024-04-05T02:55:14.950+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:55:14.952144049Z [2024-04-05T02:55:14.951+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:50:00+00:00, run_id=scheduled__2024-04-05T02:50:00+00:00, run_start_date=2024-04-05 02:55:00.954116+00:00, run_end_date=2024-04-05 02:55:14.951582+00:00, run_duration=13.997466, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:50:00+00:00, data_interval_end=2024-04-05 02:55:00+00:00, dag_hash=2827eb88968e3ad9fbd14ae5881d6f4e 2024-04-05T02:55:14.959459592Z [2024-04-05T02:55:14.959+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:55:00+00:00, run_after=2024-04-05T03:00:00+00:00 2024-04-05T02:55:14.991274965Z [2024-04-05T02:55:14.990+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.send_prometheus run_id=scheduled__2024-04-05T02:50:00+00:00 exited with status success for try_number 1 2024-04-05T02:55:14.999284698Z [2024-04-05T02:55:14.998+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_metrics_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=send_prometheus, run_id=scheduled__2024-04-05T02:50:00+00:00, map_index=-1, run_start_date=2024-04-05 02:55:13.573116+00:00, run_end_date=2024-04-05 02:55:14.016862+00:00, run_duration=0.443746, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1182, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:55:11.717441+00:00, queued_by_job_id=1, pid=17257 2024-04-05T02:55:42.393256534Z [2024-04-05T02:55:42.392+0000] {scheduler_job.py:1410} INFO - Resetting orphaned tasks for active dag runs 2024-04-05T02:56:00.082407759Z [2024-04-05T02:56:00.082+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:56:00.097554249Z [2024-04-05T02:56:00.097+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:56:00+00:00, run_after=2024-04-05T02:57:00+00:00 2024-04-05T02:56:00.105100327Z [2024-04-05T02:56:00.104+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:56:00.117053482Z [2024-04-05T02:56:00.116+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:56:00+00:00, run_after=2024-04-05T02:57:00+00:00 2024-04-05T02:56:00.185853573Z [2024-04-05T02:56:00.185+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:56:00.185877148Z 2024-04-05T02:56:00.185886006Z 2024-04-05T02:56:00.185889346Z 2024-04-05T02:56:00.185892590Z 2024-04-05T02:56:00.185951294Z [2024-04-05T02:56:00.185+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:56:00.185955847Z [2024-04-05T02:56:00.185+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:56:00.186020812Z [2024-04-05T02:56:00.185+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:56:00.186096706Z [2024-04-05T02:56:00.186+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:56:00.186615043Z [2024-04-05T02:56:00.186+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:56:00.186626374Z 2024-04-05T02:56:00.186630387Z 2024-04-05T02:56:00.186633604Z 2024-04-05T02:56:00.186636884Z 2024-04-05T02:56:00.190168129Z [2024-04-05T02:56:00.189+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:54:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:56:00.190226884Z [2024-04-05T02:56:00.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:56:00.190412478Z [2024-04-05T02:56:00.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:56:00.190555556Z [2024-04-05T02:56:00.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:56:00.190759825Z [2024-04-05T02:56:00.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:56:00.190831869Z [2024-04-05T02:56:00.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:56:00.191004380Z [2024-04-05T02:56:00.190+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:55:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:56:00.191076096Z [2024-04-05T02:56:00.190+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:56:00.544047083Z [2024-04-05T02:56:00.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status queued for try_number 1 2024-04-05T02:56:00.544144218Z [2024-04-05T02:56:00.543+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status queued for try_number 1 2024-04-05T02:56:00.544149956Z [2024-04-05T02:56:00.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status queued for try_number 1 2024-04-05T02:56:00.544205808Z [2024-04-05T02:56:00.544+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status queued for try_number 1 2024-04-05T02:56:00.563330490Z [2024-04-05T02:56:00.562+0000] {scheduler_job.py:635} INFO - Setting external_id for to 5241aab5-c8f4-4569-b056-1eca317fbe05 2024-04-05T02:56:00.563428443Z [2024-04-05T02:56:00.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to 4db28cdc-2b1c-4ffc-a8b3-263259c7b0bc 2024-04-05T02:56:00.563499387Z [2024-04-05T02:56:00.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to a4ca1a1a-4ace-44cb-b75d-6d6f3cfca9dc 2024-04-05T02:56:00.563615304Z [2024-04-05T02:56:00.563+0000] {scheduler_job.py:635} INFO - Setting external_id for to 92d22274-7ebc-4d42-bbd7-5784a4194c31 2024-04-05T02:56:03.282720064Z [2024-04-05T02:56:03.282+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:56:03.283492675Z [2024-04-05T02:56:03.283+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:54:00+00:00, run_id=scheduled__2024-04-05T02:54:00+00:00, run_start_date=2024-04-05 02:56:00.127780+00:00, run_end_date=2024-04-05 02:56:03.282943+00:00, run_duration=3.155163, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:54:00+00:00, data_interval_end=2024-04-05 02:56:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:56:03.297640693Z [2024-04-05T02:56:03.297+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:56:00+00:00, run_after=2024-04-05T02:58:00+00:00 2024-04-05T02:56:03.308809080Z [2024-04-05T02:56:03.308+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:56:03.309522006Z [2024-04-05T02:56:03.309+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:55:00+00:00, run_id=scheduled__2024-04-05T02:55:00+00:00, run_start_date=2024-04-05 02:56:00.129054+00:00, run_end_date=2024-04-05 02:56:03.309022+00:00, run_duration=3.179968, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:55:00+00:00, data_interval_end=2024-04-05 02:56:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:56:03.324651787Z [2024-04-05T02:56:03.324+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:56:00+00:00, run_after=2024-04-05T02:57:00+00:00 2024-04-05T02:56:03.401699291Z [2024-04-05T02:56:03.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:54:00+00:00 exited with status success for try_number 1 2024-04-05T02:56:03.402107021Z [2024-04-05T02:56:03.401+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status success for try_number 1 2024-04-05T02:56:03.411961081Z [2024-04-05T02:56:03.411+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:55:00+00:00, map_index=-1, run_start_date=2024-04-05 02:56:01.296457+00:00, run_end_date=2024-04-05 02:56:02.261358+00:00, run_duration=0.964901, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1183, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:56:00.187352+00:00, queued_by_job_id=1, pid=17267 2024-04-05T02:56:03.412515926Z [2024-04-05T02:56:03.412+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:54:00+00:00, map_index=-1, run_start_date=2024-04-05 02:56:02.453036+00:00, run_end_date=2024-04-05 02:56:02.954750+00:00, run_duration=0.501714, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1184, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:56:00.187352+00:00, queued_by_job_id=1, pid=17274 2024-04-05T02:56:06.110292550Z [2024-04-05T02:56:06.109+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:56:06.110466772Z [2024-04-05T02:56:06.110+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:55:00+00:00, run_id=scheduled__2024-04-05T02:55:00+00:00, run_start_date=2024-04-05 02:56:00.131142+00:00, run_end_date=2024-04-05 02:56:06.110197+00:00, run_duration=5.979055, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:55:00+00:00, data_interval_end=2024-04-05 02:56:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:56:06.122646311Z [2024-04-05T02:56:06.122+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:56:00+00:00, run_after=2024-04-05T02:57:00+00:00 2024-04-05T02:56:06.131336445Z [2024-04-05T02:56:06.130+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:56:06.131426763Z [2024-04-05T02:56:06.131+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:55:00+00:00, run_id=scheduled__2024-04-05T02:55:00+00:00, run_start_date=2024-04-05 02:56:00.130168+00:00, run_end_date=2024-04-05 02:56:06.131166+00:00, run_duration=6.000998, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:55:00+00:00, data_interval_end=2024-04-05 02:56:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:56:06.141610682Z [2024-04-05T02:56:06.141+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:56:00+00:00, run_after=2024-04-05T02:57:00+00:00 2024-04-05T02:56:06.174668409Z [2024-04-05T02:56:06.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status success for try_number 1 2024-04-05T02:56:06.174708791Z [2024-04-05T02:56:06.174+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:55:00+00:00 exited with status success for try_number 1 2024-04-05T02:56:06.181397927Z [2024-04-05T02:56:06.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:55:00+00:00, map_index=-1, run_start_date=2024-04-05 02:56:03.633112+00:00, run_end_date=2024-04-05 02:56:05.331922+00:00, run_duration=1.69881, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1186, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:56:00.187352+00:00, queued_by_job_id=1, pid=17296 2024-04-05T02:56:06.181496189Z [2024-04-05T02:56:06.181+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:55:00+00:00, map_index=-1, run_start_date=2024-04-05 02:56:03.271907+00:00, run_end_date=2024-04-05 02:56:05.558698+00:00, run_duration=2.286791, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1185, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:56:00.187352+00:00, queued_by_job_id=1, pid=17286 2024-04-05T02:57:01.001412397Z [2024-04-05T02:57:01.000+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:57:01.038842340Z [2024-04-05T02:57:01.037+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:57:00+00:00, run_after=2024-04-05T02:58:00+00:00 2024-04-05T02:57:01.071228894Z [2024-04-05T02:57:01.070+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:57:00+00:00, run_after=2024-04-05T02:58:00+00:00 2024-04-05T02:57:01.167917341Z [2024-04-05T02:57:01.162+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:57:01.167950604Z 2024-04-05T02:57:01.167956973Z 2024-04-05T02:57:01.167962542Z 2024-04-05T02:57:01.167968025Z [2024-04-05T02:57:01.162+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:57:01.167973824Z [2024-04-05T02:57:01.163+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:57:01.167979422Z [2024-04-05T02:57:01.163+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:57:01.167986926Z [2024-04-05T02:57:01.163+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:57:01.167992190Z 2024-04-05T02:57:01.167998194Z 2024-04-05T02:57:01.168003614Z 2024-04-05T02:57:01.183810373Z [2024-04-05T02:57:01.167+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:57:01.183845979Z [2024-04-05T02:57:01.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:57:01.183852230Z [2024-04-05T02:57:01.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:57:01.183858401Z [2024-04-05T02:57:01.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:57:01.183863985Z [2024-04-05T02:57:01.168+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:57:01.183873361Z [2024-04-05T02:57:01.168+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:57:01.633024432Z [2024-04-05T02:57:01.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:56:00+00:00 exited with status queued for try_number 1 2024-04-05T02:57:01.633128648Z [2024-04-05T02:57:01.632+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:56:00+00:00 exited with status queued for try_number 1 2024-04-05T02:57:01.633178823Z [2024-04-05T02:57:01.633+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:56:00+00:00 exited with status queued for try_number 1 2024-04-05T02:57:01.645508944Z [2024-04-05T02:57:01.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to 2036eeb3-7041-4e83-ba36-139632430332 2024-04-05T02:57:01.645608813Z [2024-04-05T02:57:01.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to d99c3354-e418-4312-9b90-bf64b46c240e 2024-04-05T02:57:01.645853568Z [2024-04-05T02:57:01.645+0000] {scheduler_job.py:635} INFO - Setting external_id for to a479568d-bcc8-48da-8978-f5cf13f46bee 2024-04-05T02:57:03.116999691Z [2024-04-05T02:57:03.116+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:57:03.117496132Z [2024-04-05T02:57:03.117+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:56:00+00:00, run_id=scheduled__2024-04-05T02:56:00+00:00, run_start_date=2024-04-05 02:57:01.085866+00:00, run_end_date=2024-04-05 02:57:03.116959+00:00, run_duration=2.031093, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:56:00+00:00, data_interval_end=2024-04-05 02:57:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:57:03.140409086Z [2024-04-05T02:57:03.139+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:57:00+00:00, run_after=2024-04-05T02:58:00+00:00 2024-04-05T02:57:03.213087408Z [2024-04-05T02:57:03.212+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:56:00+00:00 exited with status success for try_number 1 2024-04-05T02:57:03.222164656Z [2024-04-05T02:57:03.221+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:56:00+00:00, map_index=-1, run_start_date=2024-04-05 02:57:02.327133+00:00, run_end_date=2024-04-05 02:57:02.907678+00:00, run_duration=0.580545, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1187, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:57:01.164618+00:00, queued_by_job_id=1, pid=17324 2024-04-05T02:57:06.769411889Z [2024-04-05T02:57:06.768+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:57:06.769800564Z [2024-04-05T02:57:06.769+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:56:00+00:00, run_id=scheduled__2024-04-05T02:56:00+00:00, run_start_date=2024-04-05 02:57:01.087668+00:00, run_end_date=2024-04-05 02:57:06.769329+00:00, run_duration=5.681661, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:56:00+00:00, data_interval_end=2024-04-05 02:57:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:57:06.783753145Z [2024-04-05T02:57:06.783+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:57:00+00:00, run_after=2024-04-05T02:58:00+00:00 2024-04-05T02:57:06.836450071Z [2024-04-05T02:57:06.836+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:56:00+00:00 exited with status success for try_number 1 2024-04-05T02:57:06.843008446Z [2024-04-05T02:57:06.842+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:56:00+00:00, map_index=-1, run_start_date=2024-04-05 02:57:03.526003+00:00, run_end_date=2024-04-05 02:57:06.393579+00:00, run_duration=2.867576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1188, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:57:01.164618+00:00, queued_by_job_id=1, pid=17337 2024-04-05T02:57:08.159669580Z [2024-04-05T02:57:08.159+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:57:08.160639543Z [2024-04-05T02:57:08.159+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:56:00+00:00, run_id=scheduled__2024-04-05T02:56:00+00:00, run_start_date=2024-04-05 02:57:01.089318+00:00, run_end_date=2024-04-05 02:57:08.159465+00:00, run_duration=7.070147, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:56:00+00:00, data_interval_end=2024-04-05 02:57:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:57:08.183552764Z [2024-04-05T02:57:08.183+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:57:00+00:00, run_after=2024-04-05T02:58:00+00:00 2024-04-05T02:57:08.217028369Z [2024-04-05T02:57:08.216+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:56:00+00:00 exited with status success for try_number 1 2024-04-05T02:57:08.223129969Z [2024-04-05T02:57:08.222+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:56:00+00:00, map_index=-1, run_start_date=2024-04-05 02:57:03.830904+00:00, run_end_date=2024-04-05 02:57:07.386910+00:00, run_duration=3.556006, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1189, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:57:01.164618+00:00, queued_by_job_id=1, pid=17347 2024-04-05T02:58:00.970124792Z [2024-04-05T02:58:00.969+0000] {scheduler_job.py:1197} INFO - DAG ns_topology is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:58:00.983303945Z [2024-04-05T02:58:00.982+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:58:01.020788072Z [2024-04-05T02:58:01.020+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:58:00+00:00, run_after=2024-04-05T02:59:00+00:00 2024-04-05T02:58:01.045548619Z [2024-04-05T02:58:01.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:58:00+00:00, run_after=2024-04-05T02:59:00+00:00 2024-04-05T02:58:01.197165345Z [2024-04-05T02:58:01.189+0000] {scheduler_job.py:360} INFO - 4 tasks up for execution: 2024-04-05T02:58:01.197190705Z 2024-04-05T02:58:01.197200323Z 2024-04-05T02:58:01.197203862Z 2024-04-05T02:58:01.197207035Z 2024-04-05T02:58:01.197212318Z [2024-04-05T02:58:01.189+0000] {scheduler_job.py:425} INFO - DAG ns_topology has 0/16 running and queued tasks 2024-04-05T02:58:01.197215633Z [2024-04-05T02:58:01.189+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:58:01.197218892Z [2024-04-05T02:58:01.189+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:58:01.197221843Z [2024-04-05T02:58:01.189+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:58:01.197224890Z [2024-04-05T02:58:01.190+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:58:01.197227976Z 2024-04-05T02:58:01.197231293Z 2024-04-05T02:58:01.197234264Z 2024-04-05T02:58:01.197237240Z 2024-04-05T02:58:01.197242176Z [2024-04-05T02:58:01.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='ns_topology', task_id='get_topology', run_id='scheduled__2024-04-05T02:56:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:58:01.197247264Z [2024-04-05T02:58:01.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-05T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-05T02:58:01.197251270Z [2024-04-05T02:58:01.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:58:01.197273285Z [2024-04-05T02:58:01.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:58:01.197278507Z [2024-04-05T02:58:01.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:58:01.197283229Z [2024-04-05T02:58:01.194+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:58:01.197290458Z [2024-04-05T02:58:01.194+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:57:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:58:01.197302708Z [2024-04-05T02:58:01.195+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:58:02.002880164Z [2024-04-05T02:58:02.002+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:56:00+00:00 exited with status queued for try_number 1 2024-04-05T02:58:02.002915720Z [2024-04-05T02:58:02.002+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:57:00+00:00 exited with status queued for try_number 1 2024-04-05T02:58:02.002973341Z [2024-04-05T02:58:02.002+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:57:00+00:00 exited with status queued for try_number 1 2024-04-05T02:58:02.003052730Z [2024-04-05T02:58:02.002+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:57:00+00:00 exited with status queued for try_number 1 2024-04-05T02:58:02.017764115Z [2024-04-05T02:58:02.017+0000] {scheduler_job.py:635} INFO - Setting external_id for to 69bd404e-76be-47d3-b88a-7429d99bc604 2024-04-05T02:58:02.017806614Z [2024-04-05T02:58:02.017+0000] {scheduler_job.py:635} INFO - Setting external_id for to 6487735a-25a0-4bf3-8e86-94ad4ab15922 2024-04-05T02:58:02.017946251Z [2024-04-05T02:58:02.017+0000] {scheduler_job.py:635} INFO - Setting external_id for to eafdc397-adb5-464a-861d-c13122f2b18e 2024-04-05T02:58:02.018024159Z [2024-04-05T02:58:02.017+0000] {scheduler_job.py:635} INFO - Setting external_id for to 1f71c25e-35ef-4ba5-ac06-296d7561a3e7 2024-04-05T02:58:04.207852547Z [2024-04-05T02:58:04.207+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:58:04.208684724Z [2024-04-05T02:58:04.208+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=ns_topology, execution_date=2024-04-05 02:56:00+00:00, run_id=scheduled__2024-04-05T02:56:00+00:00, run_start_date=2024-04-05 02:58:01.066791+00:00, run_end_date=2024-04-05 02:58:04.208016+00:00, run_duration=3.141225, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:56:00+00:00, data_interval_end=2024-04-05 02:58:00+00:00, dag_hash=e360c04dc0c257e4994be7d04f1a0de1 2024-04-05T02:58:04.220824514Z [2024-04-05T02:58:04.220+0000] {dag.py:3452} INFO - Setting next_dagrun for ns_topology to 2024-04-05T02:58:00+00:00, run_after=2024-04-05T03:00:00+00:00 2024-04-05T02:58:04.232573851Z [2024-04-05T02:58:04.231+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:58:04.233398015Z [2024-04-05T02:58:04.232+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:57:00+00:00, run_id=scheduled__2024-04-05T02:57:00+00:00, run_start_date=2024-04-05 02:58:01.070160+00:00, run_end_date=2024-04-05 02:58:04.232701+00:00, run_duration=3.162541, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:57:00+00:00, data_interval_end=2024-04-05 02:58:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:58:04.254217290Z [2024-04-05T02:58:04.253+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:58:00+00:00, run_after=2024-04-05T02:59:00+00:00 2024-04-05T02:58:04.329904504Z [2024-04-05T02:58:04.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of ns_topology.get_topology run_id=scheduled__2024-04-05T02:56:00+00:00 exited with status success for try_number 1 2024-04-05T02:58:04.330150507Z [2024-04-05T02:58:04.329+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:57:00+00:00 exited with status success for try_number 1 2024-04-05T02:58:04.346425101Z [2024-04-05T02:58:04.345+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=ns_topology, task_id=get_topology, run_id=scheduled__2024-04-05T02:56:00+00:00, map_index=-1, run_start_date=2024-04-05 02:58:03.020832+00:00, run_end_date=2024-04-05 02:58:03.626028+00:00, run_duration=0.605196, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1190, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:58:01.191119+00:00, queued_by_job_id=1, pid=17375 2024-04-05T02:58:04.348896422Z [2024-04-05T02:58:04.348+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:57:00+00:00, map_index=-1, run_start_date=2024-04-05 02:58:03.087189+00:00, run_end_date=2024-04-05 02:58:03.816277+00:00, run_duration=0.729088, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1191, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:58:01.191119+00:00, queued_by_job_id=1, pid=17376 2024-04-05T02:58:07.153107071Z [2024-04-05T02:58:07.152+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:58:07.153443906Z [2024-04-05T02:58:07.153+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:57:00+00:00, run_id=scheduled__2024-04-05T02:57:00+00:00, run_start_date=2024-04-05 02:58:01.073046+00:00, run_end_date=2024-04-05 02:58:07.153102+00:00, run_duration=6.080056, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:57:00+00:00, data_interval_end=2024-04-05 02:58:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:58:07.164409814Z [2024-04-05T02:58:07.164+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:58:00+00:00, run_after=2024-04-05T02:59:00+00:00 2024-04-05T02:58:07.172290258Z [2024-04-05T02:58:07.171+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:58:07.172578959Z [2024-04-05T02:58:07.172+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:57:00+00:00, run_id=scheduled__2024-04-05T02:57:00+00:00, run_start_date=2024-04-05 02:58:01.071657+00:00, run_end_date=2024-04-05 02:58:07.172285+00:00, run_duration=6.100628, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:57:00+00:00, data_interval_end=2024-04-05 02:58:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:58:07.183307877Z [2024-04-05T02:58:07.182+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:58:00+00:00, run_after=2024-04-05T02:59:00+00:00 2024-04-05T02:58:07.211514772Z [2024-04-05T02:58:07.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:57:00+00:00 exited with status success for try_number 1 2024-04-05T02:58:07.211708863Z [2024-04-05T02:58:07.211+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:57:00+00:00 exited with status success for try_number 1 2024-04-05T02:58:07.218534480Z [2024-04-05T02:58:07.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:57:00+00:00, map_index=-1, run_start_date=2024-04-05 02:58:04.585364+00:00, run_end_date=2024-04-05 02:58:06.121045+00:00, run_duration=1.535681, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1192, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:58:01.191119+00:00, queued_by_job_id=1, pid=17399 2024-04-05T02:58:07.218852856Z [2024-04-05T02:58:07.218+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:57:00+00:00, map_index=-1, run_start_date=2024-04-05 02:58:04.705281+00:00, run_end_date=2024-04-05 02:58:06.756969+00:00, run_duration=2.051688, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1193, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:58:01.191119+00:00, queued_by_job_id=1, pid=17400 2024-04-05T02:59:01.031655905Z [2024-04-05T02:59:01.031+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:59:00+00:00, run_after=2024-04-05T03:00:00+00:00 2024-04-05T02:59:01.046225169Z [2024-04-05T02:59:01.045+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:59:00+00:00, run_after=2024-04-05T03:00:00+00:00 2024-04-05T02:59:01.054061381Z [2024-04-05T02:59:01.053+0000] {scheduler_job.py:1197} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 is at (or above) max_active_runs (1 of 1), not creating any more runs 2024-04-05T02:59:01.120185271Z [2024-04-05T02:59:01.119+0000] {scheduler_job.py:360} INFO - 3 tasks up for execution: 2024-04-05T02:59:01.120213902Z 2024-04-05T02:59:01.120217938Z 2024-04-05T02:59:01.120221516Z 2024-04-05T02:59:01.120225303Z [2024-04-05T02:59:01.120+0000] {scheduler_job.py:425} INFO - DAG vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:59:01.120236918Z [2024-04-05T02:59:01.120+0000] {scheduler_job.py:425} INFO - DAG sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 has 0/16 running and queued tasks 2024-04-05T02:59:01.120345469Z [2024-04-05T02:59:01.120+0000] {scheduler_job.py:425} INFO - DAG vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 has 0/16 running and queued tasks 2024-04-05T02:59:01.120985406Z [2024-04-05T02:59:01.120+0000] {scheduler_job.py:511} INFO - Setting the following tasks to queued state: 2024-04-05T02:59:01.120996021Z 2024-04-05T02:59:01.120999752Z 2024-04-05T02:59:01.121003200Z 2024-04-05T02:59:01.124637250Z [2024-04-05T02:59:01.124+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_vim_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:59:01.124699123Z [2024-04-05T02:59:01.124+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-05T02:59:01.124915316Z [2024-04-05T02:59:01.124+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', task_id='get_sdnc_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:59:01.124998507Z [2024-04-05T02:59:01.124+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-05T02:59:01.125175063Z [2024-04-05T02:59:01.125+0000] {scheduler_job.py:550} INFO - Sending TaskInstanceKey(dag_id='vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', task_id='get_all_vm_status_and_send_to_prometheus', run_id='scheduled__2024-04-05T02:58:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default 2024-04-05T02:59:01.125427603Z [2024-04-05T02:59:01.125+0000] {base_executor.py:93} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-05T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-05T02:59:01.650337358Z [2024-04-05T02:59:01.649+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:58:00+00:00 exited with status queued for try_number 1 2024-04-05T02:59:01.650651674Z [2024-04-05T02:59:01.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:58:00+00:00 exited with status queued for try_number 1 2024-04-05T02:59:01.650845393Z [2024-04-05T02:59:01.650+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:58:00+00:00 exited with status queued for try_number 1 2024-04-05T02:59:01.659687148Z [2024-04-05T02:59:01.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to 81ef73bc-d584-4af5-a240-d494e3a1256d 2024-04-05T02:59:01.659928133Z [2024-04-05T02:59:01.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to d0efd99f-6d48-45fe-badf-18e439f7c5f6 2024-04-05T02:59:01.660154859Z [2024-04-05T02:59:01.659+0000] {scheduler_job.py:635} INFO - Setting external_id for to a6f0d451-f5bc-40cf-a2a4-f4729c1706dc 2024-04-05T02:59:04.021489647Z [2024-04-05T02:59:04.021+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:59:04.022124191Z [2024-04-05T02:59:04.021+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, execution_date=2024-04-05 02:58:00+00:00, run_id=scheduled__2024-04-05T02:58:00+00:00, run_start_date=2024-04-05 02:59:01.064335+00:00, run_end_date=2024-04-05 02:59:04.021381+00:00, run_duration=2.957046, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:58:00+00:00, data_interval_end=2024-04-05 02:59:00+00:00, dag_hash=06966cd0810dcb653410ba0c3de23543 2024-04-05T02:59:04.040046971Z [2024-04-05T02:59:04.039+0000] {dag.py:3452} INFO - Setting next_dagrun for sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65 to 2024-04-05T02:59:00+00:00, run_after=2024-04-05T03:00:00+00:00 2024-04-05T02:59:04.099938616Z [2024-04-05T02:59:04.099+0000] {scheduler_job.py:602} INFO - Executor reports execution of sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65.get_sdnc_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:58:00+00:00 exited with status success for try_number 1 2024-04-05T02:59:04.107337222Z [2024-04-05T02:59:04.106+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=sdnc_status_c09e13c7-9d25-4280-81a8-755c0a7c8b65, task_id=get_sdnc_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:58:00+00:00, map_index=-1, run_start_date=2024-04-05 02:59:02.533961+00:00, run_end_date=2024-04-05 02:59:03.104660+00:00, run_duration=0.570699, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1194, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:59:01.121698+00:00, queued_by_job_id=1, pid=17433 2024-04-05T02:59:06.520863291Z [2024-04-05T02:59:06.520+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:59:06.521118476Z [2024-04-05T02:59:06.520+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:58:00+00:00, run_id=scheduled__2024-04-05T02:58:00+00:00, run_start_date=2024-04-05 02:59:01.065594+00:00, run_end_date=2024-04-05 02:59:06.520746+00:00, run_duration=5.455152, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:58:00+00:00, data_interval_end=2024-04-05 02:59:00+00:00, dag_hash=59994e035c0ef36d269dcd4f67c79d91 2024-04-05T02:59:06.532085470Z [2024-04-05T02:59:06.531+0000] {dag.py:3452} INFO - Setting next_dagrun for vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:59:00+00:00, run_after=2024-04-05T03:00:00+00:00 2024-04-05T02:59:06.579179016Z [2024-04-05T02:59:06.578+0000] {scheduler_job.py:602} INFO - Executor reports execution of vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_vim_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:58:00+00:00 exited with status success for try_number 1 2024-04-05T02:59:06.588680111Z [2024-04-05T02:59:06.588+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vim_status_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_vim_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:58:00+00:00, map_index=-1, run_start_date=2024-04-05 02:59:03.592807+00:00, run_end_date=2024-04-05 02:59:05.508848+00:00, run_duration=1.916041, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1195, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:59:01.121698+00:00, queued_by_job_id=1, pid=17446 2024-04-05T02:59:07.649144268Z [2024-04-05T02:59:07.648+0000] {dagrun.py:607} INFO - Marking run successful 2024-04-05T02:59:07.649703062Z [2024-04-05T02:59:07.649+0000] {dagrun.py:658} INFO - DagRun Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, execution_date=2024-04-05 02:58:00+00:00, run_id=scheduled__2024-04-05T02:58:00+00:00, run_start_date=2024-04-05 02:59:01.066705+00:00, run_end_date=2024-04-05 02:59:07.649041+00:00, run_duration=6.582336, state=success, external_trigger=False, run_type=scheduled, data_interval_start=2024-04-05 02:58:00+00:00, data_interval_end=2024-04-05 02:59:00+00:00, dag_hash=390d00d144288c58a6508ffa804b3bce 2024-04-05T02:59:07.660302303Z [2024-04-05T02:59:07.659+0000] {dag.py:3452} INFO - Setting next_dagrun for vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12 to 2024-04-05T02:59:00+00:00, run_after=2024-04-05T03:00:00+00:00 2024-04-05T02:59:07.704558724Z [2024-04-05T02:59:07.703+0000] {scheduler_job.py:602} INFO - Executor reports execution of vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12.get_all_vm_status_and_send_to_prometheus run_id=scheduled__2024-04-05T02:58:00+00:00 exited with status success for try_number 1 2024-04-05T02:59:07.713566239Z [2024-04-05T02:59:07.713+0000] {scheduler_job.py:645} INFO - TaskInstance Finished: dag_id=vm_status_vim_24594418-3ec7-4e4f-905e-c5ddc6806c12, task_id=get_all_vm_status_and_send_to_prometheus, run_id=scheduled__2024-04-05T02:58:00+00:00, map_index=-1, run_start_date=2024-04-05 02:59:04.050717+00:00, run_end_date=2024-04-05 02:59:07.115293+00:00, run_duration=3.064576, state=success, executor_state=success, try_number=1, max_tries=1, job_id=1196, pool=default_pool, queue=default, priority_weight=1, operator=_PythonDecoratedOperator, queued_dttm=2024-04-05 02:59:01.121698+00:00, queued_by_job_id=1, pid=17457 2024-04-04T22:25:25.999437270Z 2024-04-04T22:25:26.003993069Z Cleaning logs every 900 seconds 2024-04-04T22:25:26.004016620Z Trimming airflow logs to 15 days. 2024-04-04T22:30:00.127407940Z Trimming airflow logs to 15 days. 2024-04-04T22:30:01.164118224Z Trimming airflow logs to 15 days. 2024-04-04T22:45:00.186650353Z Trimming airflow logs to 15 days. 2024-04-04T22:45:01.227862424Z Trimming airflow logs to 15 days. 2024-04-04T23:00:00.291902429Z Trimming airflow logs to 15 days. 2024-04-04T23:00:01.311640163Z Trimming airflow logs to 15 days. 2024-04-04T23:15:00.468745843Z Trimming airflow logs to 15 days. 2024-04-04T23:15:01.520044779Z Trimming airflow logs to 15 days. 2024-04-04T23:30:00.568030429Z Trimming airflow logs to 15 days. 2024-04-04T23:30:01.602183545Z Trimming airflow logs to 15 days. 2024-04-04T23:45:00.652139355Z Trimming airflow logs to 15 days. 2024-04-04T23:45:01.695863343Z Trimming airflow logs to 15 days. 2024-04-05T00:00:00.739519257Z Trimming airflow logs to 15 days. 2024-04-05T00:00:01.771690307Z Trimming airflow logs to 15 days. 2024-04-05T00:15:01.016378337Z Trimming airflow logs to 15 days. 2024-04-05T00:30:00.064250078Z Trimming airflow logs to 15 days. 2024-04-05T00:30:01.094358339Z Trimming airflow logs to 15 days. 2024-04-05T00:45:00.132013056Z Trimming airflow logs to 15 days. 2024-04-05T00:45:01.190641540Z Trimming airflow logs to 15 days. 2024-04-05T01:00:00.348254229Z Trimming airflow logs to 15 days. 2024-04-05T01:00:01.390181939Z Trimming airflow logs to 15 days. 2024-04-05T01:15:00.446301911Z Trimming airflow logs to 15 days. 2024-04-05T01:15:01.472055708Z Trimming airflow logs to 15 days. 2024-04-05T01:30:00.511162050Z Trimming airflow logs to 15 days. 2024-04-05T01:30:01.535893554Z Trimming airflow logs to 15 days. 2024-04-05T01:45:00.612232930Z Trimming airflow logs to 15 days. 2024-04-05T01:45:01.669192002Z Trimming airflow logs to 15 days. 2024-04-05T02:00:00.776151151Z Trimming airflow logs to 15 days. 2024-04-05T02:00:01.818839410Z Trimming airflow logs to 15 days. 2024-04-05T02:15:00.943243451Z Trimming airflow logs to 15 days. 2024-04-05T02:15:01.961687462Z Trimming airflow logs to 15 days. 2024-04-05T02:30:00.997991196Z Trimming airflow logs to 15 days. 2024-04-05T02:45:00.096110756Z Trimming airflow logs to 15 days. 2024-04-05T02:45:01.159990729Z Trimming airflow logs to 15 days.